TDM Import Error

[BLivingston]

I'm trying to open my data file in Excel spread sheet. There are 5000 sheets and Excel stops at sheet 4749 on two different computers.

"TDM Importer" " An unknown error occured: 0x80004003.

I'm using Excel 2010 32 bit version with the TDM importer add-In , I have the tdms.dll installed.

Any reason why it crashes?

Thanks

[TroyK]

The number of sheets you can open in Excel is "Limited by available memory and system resources".

5000 sheets sounds like a lot of data. How much data is contained in record 4749? Is opening it making you run out of memory?

[BLivingston]

2 main sheets with the data summary, then each cycle sheet contains 2 columns with ~ 12,000 rows.

File size is 950, 000 KB.

Is there a way to split the TDMS file into smaller sections?

[BLivingston]

What about opening the data in Access? is there a file conversion?

[Hooovahh]

Really the TDMS file viewer would be best for this large amount of data.  It can then open subset of the data without having to load the entire file into memory.  An example viewer ships with LabVIEW, DIAdem can do this, and Scout by SignalX can also deal with large TDMS files much better than the importer utility.

[BLivingston]

I tried Scout. It had memory errors.

[Hooovahh]

---

@BLivingston wrote:

I tried Scout. It had memory errors.

---

I think SignalX would be interested in hearing this.  As far as I know they use the native TDMS functions for reading subsets of data, and really should have this issue.  Are you sure the TDMS file itself doesn't have issues?

[TroyK]

I've never seen a file import/conversion for Access but that doesn't mean one doesn't exist.

The error code 0x80004003 appears to be an invalid pointer. Perhaps the TDMS file is corrupt or the excel importer can't handle something about that  measurement group.

Hooovahh is right, the TDMS file viewer would probably do the job.

Assuming you have LabVIEW installed: Programming > File I/O > TDMS Streaming > TDMS File Viewer.

If you only have the TDMS files but no LabVIEW then the TDMS Excel import function recommends NI DIAdem for large data sets.

Looks like someone has compiled a stand-alone version of the viewer here.

[Hooovahh]

If the TDMS file is corrupted somehow, you can still get usable data out of it.  Here is a thread where a TDMS file existed with a corrupt segment.  The file could be spit at the segments, and then the data before the corrupt segment can be retrieved.

http://forums.ni.com/t5/LabVIEW/Corrupted-TDMS-File/td-p/2165954/page/3