LabVIEW

cancel
Showing results for 
Search instead for 
Did you mean: 

Corrupted TDMS File

I have a 3.2GB tdms file from an 30 hour data logging session that ended in an error that I have yet to debug. I need to get the data though.

The file too big to open with the traditional viewer, so I tried to open and read the first 1000 points. Nothing.

 

I tried the program here and got a memory error (heh, loading 3.2GB all at once.. should have read the code first).

 

Either I have 3.2GB of nothing (not likely since the logger works for shorter runs), or the error corrupted part of the file. Any ideas? Does a TDMS have metadata at the end of the file?

 

Josh
Software is never really finished, it's just an acceptable level of broken
0 Kudos
Message 1 of 35
(7,172 Views)

Give this link a try.  Convert TDMS file to Text.  Got nothing to loose at this point.

 

https://decibel.ni.com/content/docs/DOC-17246

 

 

Matthew Fitzsimons

Certified LabVIEW Architect
LabVIEW 6.1 ... 2013, LVOOP, GOOP, TestStand, DAQ, and Vison
Message 2 of 35
(7,164 Views)

Is there exist possible ways that we can get your corrupted TDMS file and do investigations? Or can you contact NI AE to offer this file so that corresponding NI developer can try to help ?

Message 3 of 35
(7,153 Views)

@deppSu wrote:

Is there exist possible ways that we can get your corrupted TDMS file and do investigations? Or can you contact NI AE to offer this file so that corresponding NI developer can try to help ?


 

Nothing proprietary is in the file, so it should be fine.

 

However, it IS 3.2GB and we have annoying IT policies. Not sure how I can pull it off.

Josh
Software is never really finished, it's just an acceptable level of broken
0 Kudos
Message 4 of 35
(7,133 Views)

@mfitzsimons wrote:

Give this link a try.  Convert TDMS file to Text.  Got nothing to loose at this point.

 

https://decibel.ni.com/content/docs/DOC-17246

 

 


Nope. Unfortunately this VI suffers the same fate. Not even opening the file. Error -2500 in "TDMS Open in TDMS_to_Text File_SE Format_LV2010.vi". I have a feeling this VI wouldn't work anyway since it loads the entire file into memory first. Thanks though.

 

When opened in a hex editor, I do see data and ASCII metadata. I see hex values up until 0xBBDA5B89 or 3.185204105e9, which is the size of the file. The data is there.

Josh
Software is never really finished, it's just an acceptable level of broken
0 Kudos
Message 5 of 35
(7,133 Views)

Here is a link of several suggestions on how to recover the file.

 

http://forums.ni.com/t5/DIAdem/Retreive-data-from-corrupt-TDMS-files/m-p/1103269

 

 

Matt Fitzsimons
NI Alliance Member
LabVIEW Champion
NI Certified LabVIEW Architect
LabVIEW, LV-RT, Vision, DAQ, Motion, and FPGA
Message 6 of 35
(7,123 Views)

@CAS_MattF wrote:

Here is a link of several suggestions on how to recover the file.

 

http://forums.ni.com/t5/DIAdem/Retreive-data-from-corrupt-TDMS-files/m-p/1103269

 

 


I had already tried the attached VI. Same problem, it attempts to open the entire file into memory. I'll try to reverse engineer it and see if I can try a buffered approach (hopefully this is my problem)

 

I don't have Diadem, but I may install the trial. Does it try to recover a corrupted TDMS, or just suffer from the same problem?

 

I do need to look into automatic file splitting. Doesn't help with my current predicament.

 

Then there is a stray post by someone with 1 total post about a poorly documented software that I'm a little scared to install.

 

(Thanks for the attempt... I hate shooting down suggestions like this)

 

Josh
Software is never really finished, it's just an acceptable level of broken
0 Kudos
Message 7 of 35
(7,118 Views)

I just threw this VI together really quick.  It's an attempt at breaking up the TDMS file to make several smaller files.  Saved in 2011.

NOTE:  I have not done any debugging, so it may no be perfect.


GCentral
There are only two ways to tell somebody thanks: Kudos and Marked Solutions
Unofficial Forum Rules and Guidelines
"Not that we are sufficient in ourselves to claim anything as coming from us, but our sufficiency is from God" - 2 Corinthians 3:5
Message 8 of 35
(7,105 Views)

@crossrulz wrote:

I just threw this VI together really quick.  It's an attempt at breaking up the TDMS file to make several smaller files.  Saved in 2011.

NOTE:  I have not done any debugging, so it may no be perfect.


The error occurs at the TDMS open. Whatever the solution is, I can't use the traditional TDMS VIs.

 

Thanks.

Josh
Software is never really finished, it's just an acceptable level of broken
0 Kudos
Message 9 of 35
(7,100 Views)

Diadem comes up with an "File has an invalid format" (Error no. 11). A 7 day evaluation? Heh, won't have time to play with it.

 

Still working on a buffered solution to the recovery VI above.

 

Implimented file splitting into the TDMS streaming. Live and learn.

Josh
Software is never really finished, it's just an acceptable level of broken
0 Kudos
Message 10 of 35
(7,098 Views)