LabVIEW

cancel
Showing results for 
Search instead for 
Did you mean: 

converting an engineering string to a general number

Solved!
Go to solution

Old thread, I know. 

0.11 is not same as 0.110000. The first one has two significant figures. The second one has 6 significant figures. Many times I get answers in Exponent form to get a lower number of significant figures.

0 Kudos
Message 11 of 12
(95 Views)

@Shakti211 wrote:

Many times I get answers in Exponent form to get a lower number of significant figures.


Exponent form is convenient if the values are very small or very large.

The number of significant digits is given by the problem and independent of any formatting.

0 Kudos
Message 12 of 12
(75 Views)