Increment Numeric Control, E-4

[Djiroo]

I use LabVIEW 2010. I have a Numeric Control, type Double. I go to Numeric Properties/Data Entry to set the increment. I would like this to be 6.6666E-4. The LabVIEW keeps rounding it to 0.0007. I tried to use 0.00066666, 66,666E-5 and all equivalent combination. Always rounded 0.0007. Now if I would want 6.6666E-5 or anything smaller, LabVIEW has no issue. So apparently the problem is not the precision, but it just like to round up everything with 0.000XYZ...., and leave as it is everything 0.0000XYZ...or more 0s after the period.

So how does this make sense? Or how can I fix my problem?

Thank you.

[GerdW]

Hi Djiroo,

I think it's just a matter of internal (bad) programming of that dialog. This also has been complained about before...

That dialog accepts more precise numbers, but the display is rounding them - and I think it's only the display.

If you want to be on the safe side you could use a property node of that control instead and wire a BD constant for setting the increment.

Keep in mind the limited precision of all floating point numbers! You might get strange side effects when setting increments which can't be represented by a floating number...