Details
-
Bug
-
Status: Closed
-
Major
-
Resolution: Fixed
-
9.0
-
None
Description
mod function query uses DualFloatFunction. This eventualy does a conversion
(float)value
converting an integer (32bit) into a float which has a 24bit mantissa ,resulting in a loss of precision.
This means that for integers > 2^24 this returns an incorrect modulus due to this loss of precision.
Should we use integer only, or perhaps cast to double (so then create a DualDoubleFunction) which has a 52bit mantissa, so can convert int to double without loss of precision?
This issue may also affect the other function queries?
Attachments
Issue Links
- links to