when i got fetch waveform data from oscilloscope(model TDS5104), i want more decimal point.for example, oscilloscope output a point which print is 1.5214mV , but i fetch the point which is 1.52 by labveiw progam. how can i get more decimal point.i used a attached instrument driver.thanks.

The waveform Y is DBL, so it internally has plenty of resolution. The number of displayed digits is just a cosmetic property and can be freely chosen. How do you tell that the resolution is less? I cannot tell from the VI you have attached. If you want more digits showing on the Y scale of the graph, just change the formatting.

LabVIEW

how can i get more decimal point.

Solved!

I am not really familiar with the commands for the instrument but it looks like you tell the instrument to send 1 or 2 bytes per data point. Then you cast the string sent from the instrument to an array of I8 integers which is then coerced to Double.

I think you need to get more data from the instrument and handle it appropriately.

Lynn