Hello All, I need a help in writing a large1-D array ( array size up to 600M) of double to binary files. I am trying to use Producer/Consumer Design Pattern to do this. In Producer Loop I am acquiring data from single channel of the card, 100k samples per iteration.When I try to build an array the memory is full about 70M size of array. It is possible to write this large array? I would like to write every 50M samples into separated binary file and I guess I have to do this in Consumer Loop, but I can't figure out how. The second problem is how to read this entire 600M array from binary files and process it in FFT? I placed SineWave block instead of block accountable for acquiring data from card, because I can't post the original program. I am using LabVIEW 2010 on Windows 7 32bit. I don't know whether my approach is applicable to so large data. Any help in this case will be appreciated...Regards.

LabVIEW

How to write and process large 600M array?

Hi ortiga,

the reason why you are able to acquire, process and display data in older program without memory problem is that you throw away data after each iteration (data is only displayed) and wait until processing is done, then measure another chunk of data. In newer program with queues acquires data with no delay and FFT is slower than acquiring so queue works as a buffer which is filling the RAM and this is causing memory problems.

The only solution I see here is only to upgrade HW (mainly processing speed) to make FFT processing faster (but this still does not solve problem totally) or decrease number of samples or sampling rate. Be aware that you are trying to do very difficult task in perspective of processing power so duration about 1 minute is something you have to deal with.

Best regards,

Martin