06-23-2014 11:34 AM
Hi,
Sometimes, despite the tact that my LV code module returns the data with -exactly - two significant digits of precision, in TS report I see a number with sixteen digits of precision.
For example the data returned (not only displayed) by the code module is -0.09 (DBL), but TS reports displays it to me as -0.0899999999999999.
Why it is like that?
Solved! Go to Solution.
06-23-2014 11:37 AM
Because you are transferring a double precision floating point number. The display has nothing to do with the actual data.