Searched refs:DecimalBPP (Results 1 – 3 of 3) sorted by relevance
3262 double DecimalBPP, in TruncToValidBPP() argument3304 if (DecimalBPP < 6) in TruncToValidBPP()3309 return dml_floor(16 * DecimalBPP, 1) / 16.0; in TruncToValidBPP()3311 if (DecimalBPP < 6 in TruncToValidBPP()3314 || DecimalBPP < DesiredBPP) { in TruncToValidBPP()3322 if (DecimalBPP < 7) in TruncToValidBPP()3329 if (DecimalBPP < 7 in TruncToValidBPP()3332 || DecimalBPP < DesiredBPP) { in TruncToValidBPP()3340 if (DecimalBPP < 8) in TruncToValidBPP()3347 if (DecimalBPP < 8 in TruncToValidBPP()[all …]
3189 double DecimalBPP, in TruncToValidBPP() argument3197 if (DecimalBPP >= 18) in TruncToValidBPP()3199 else if (DecimalBPP >= 15) in TruncToValidBPP()3201 else if (DecimalBPP >= 12) in TruncToValidBPP()3206 if (DecimalBPP >= 36) in TruncToValidBPP()3229 if (DecimalBPP < 6) in TruncToValidBPP()3236 if (DecimalBPP < 7) in TruncToValidBPP()3243 if (DecimalBPP < 8) in TruncToValidBPP()3251 if (DecimalBPP >= 18) in TruncToValidBPP()3260 if (DecimalBPP >= 24) in TruncToValidBPP()[all …]
3268 double DecimalBPP, in TruncToValidBPP() argument3310 if (DecimalBPP < 6) in TruncToValidBPP()3315 return dml_floor(16 * DecimalBPP, 1) / 16.0; in TruncToValidBPP()3317 if (DecimalBPP < 6 in TruncToValidBPP()3320 || DecimalBPP < DesiredBPP) { in TruncToValidBPP()3328 if (DecimalBPP < 7) in TruncToValidBPP()3335 if (DecimalBPP < 7 in TruncToValidBPP()3338 || DecimalBPP < DesiredBPP) { in TruncToValidBPP()3346 if (DecimalBPP < 8) in TruncToValidBPP()3353 if (DecimalBPP < 8 in TruncToValidBPP()[all …]