write to spreadsheet more than 1048576 rows

[Mong1995]

Hi, I wanted to log data more than than1048576 rows(max.numb of rows in excel), how can I do it?

I am using the write to spreadsheet

I tried adding sheet but it did not work out (using report generation toolkit)as it affects my other structures

so I was thinking to add a new log path after the first sheet of excel is full 1048576  

[RavensFan]

Yes.  Limitation of Excel.  Older versions were limited to only 65536.

Do just what you said, keep track of how many rows you've created.  When your next row is going to be greater than the ~1 million limit, have it go into a case structure that creates  a new file name and discards the old.

[Mong1995]

I cant, I need about 3mil rows to log and I need a program to record them all without stopping the program as I am doing a test, pls tell me how you make it automatically log the data to the second log path continuously after 1 mil rows without prompting (predefined all log paths before the program is started)

(I am doing a test for 3 months, about 1mil data each month, I cant stop the test in the middle)

[JÞB]

What are you doing with 3 million data points?  I mean, what are you doing with the data?  You have to analyze it somehow and get a result (or, it is not a TEST right?)

Now that you are looking at the real problem,  have you considered using the date as part of the filename?

[altenbach]

Simple: Don't use excel. Write to a simple delimited file (or preferably to a suitable binary file) instead.

Your program knows at all times how much was written (e.g. by incrementing the counts in a shift register), so you can automatically increment the file name at regular intervals if you want to keep the files manageable.

[RavensFan]

---

@Mong1995 wrote:

I cant, I need about 3mil rows to log and I need a program to record them all without stopping the program as I am doing a test, pls tell me how you make it automatically log the data to the second log path continuously after 1 mil rows without prompting (predefined all log paths before the program is started)

(I am doing a test for 3 months, about 1mil data each month, I cant stop the test in the middle)

---

When did I i ever say your program would stop?  Or that your program would be prompting you for new filenames?

I figured you should already know how to programmatically assign a filename without any file dialogs prompting you.  And how to build a filename such as a based file name plus a number that is inserted into it that you could increment each time you need a new file.

And as others have said, although Excel can now open files with over 1 millions rows, it can be come dog slow in trying to work with that much data.

[Mong1995]

I must use excel, reasons being;

1-getting graphs

2-modifiable cells

3-need to make a report base on excel

[Mong1995]

It wont be too slow, I tried a demo, just couple of seconds.

Still the question is unsolved, I must use excel,

Problem is how to log 3mil data to excel without prompting or stopping the program, it has to log the data continuously to a second excel after the first 1mil is reached on first excel, and so the third excel for the last 1mil.

Kindly put on your vi here thanks for help.

[RavensFan]

I gave you an answer on, but apparently you didn't understand.

Here is a screen shot example.

[altenbach]

---

@Mong1995 wrote:

I must use excel, reasons being;

1-getting graphs

2-modifiable cells

3-need to make a report base on excel

---

Excel can open simple tab delimited text files and still do all that with the imported data.