Home
last modified time | relevance | path

Searched refs:qmaxDouble (Results 1 – 1 of 1) sorted by relevance

/llvm-project-15.0.7/mlir/lib/Dialect/Quant/Utils/
H A DFakeQuantSupport.cpp71 const double qmaxDouble = qmax; in getNudgedScaleAndZeroPoint() local
72 scale = (rmax - rmin) / (qmaxDouble - qminDouble); in getNudgedScaleAndZeroPoint()
84 const double zeroPointFromMax = qmaxDouble - rmax / scale; in getNudgedScaleAndZeroPoint()
86 std::abs(qmaxDouble) + std::abs(rmax / scale); in getNudgedScaleAndZeroPoint()
96 } else if (zeroPointDouble > qmaxDouble) { in getNudgedScaleAndZeroPoint()