read large data from binary file(.dat) and plot

[mikeporter]

In terms of "binary file" format I meant simply saving the data as a 2D binary array - not TDMS. For what you want to do you need to be able to do random access of the data in the file. To do that with a straight binary file is very easy. With a text or TDMS file it is more complex.

Look for examples related to random access of binary files.

Mike...

[PeterTeoh]

just a comment about out of memory error:   clearly you don't need to process every single byte of data AT THE SAME TIME.   so the strategies is selectively (you need to understand the data first before doing this) identify the data to process, or process it from a coarse level (where you will throw away a lot of details) to a finer level (where you have to zoom down only to a specific row for example).

Understanding a TDMS database:   https://www.ni.com/en/support/documentation/supplemental/06/the-ni-tdms-file-format.html

If you can how about select only a specific channel from the TDMS data, for each row, and after reading the row, remember to close it (closing will free up memory for the next open() function).

Just a general suggestion, I may be incorrect in the details, but you get the idea :-).