LabVIEW

cancel
Showing results for 
Search instead for 
Did you mean: 

Accuracy in writing to file

When data is written to a text file it appears to have 7 figure accuracy.  Is it possible to increase this?  If a binary file is used instead how much accuracy does this keep?
 
Sorry if this obvious but I'm a newbie to LabVIEW.
0 Kudos
Message 1 of 4
(2,468 Views)
When saving to ASCII, default is six decimal places (after the ".").

If you save in binary, full precision is retained based on your data type......

What version of LV are you using?

I believe you can use the "Array to spreadsheet string" function to define your decimal places in ASCII, but if you can save binary, it's probably best.

Shane
Using LV 6.1 and 8.2.1 on W2k (SP4) and WXP (SP2)
0 Kudos
Message 2 of 4
(2,459 Views)
Ok, thanks.  I'm using 8.2
0 Kudos
Message 3 of 4
(2,454 Views)
What function are you using to write to file?

If you use the "Write to spreadsheet file", you can specify the formatting.

By wiring %.9f, you get 9 decimal places....  %.12f gives you 12 and so on.

The connector is a string at the top of the function.

Shane.
Using LV 6.1 and 8.2.1 on W2k (SP4) and WXP (SP2)
0 Kudos
Message 4 of 4
(2,451 Views)