Info about how indexing can make accessing your data much faster: https://chartio.com/learn/databases/how-does-indexing-work/
SQLite VI Package: http://sine.ni.com/nips/cds/view/p/lang/en/nid/212894
Free Viewer for SQLite databases: https://sqlitebrowser.org/dl/
General info about SQLite: https://sqlite.org/about.html
File Format
|
Pro
|
Con
|
CSV/TDS
|
- Can be read with notepad
- Easy to program
|
- Hard to add new columns
- Hard to add meta data
- Hard to escape control characters
- No binary support
- No indexing
|
TDMS
|
- Excellent performance for data logging
- Some indexing
- Self description
|
- Poor support for other data types for example, images
- File extension must be TDMS
- Tools for reading TDMS are bulky
- Poor cross compatibility
|
JSON/XML
|
- Self description
- Good tools
- Good mutation
- Viewable with notepad
|
- No binary support
- No indexing
|
INI
|
- Good tools
- Good mutation
- Can be read with notepad
|
- Poor support for other data types for example, tables
- No indexing
|
Binary
|
High speed
|
- File is probably totally meaningless outside the software
- No indexing
- Mutation is challenging
|
SQLite
|
- Good self description
- Good speed
- Good cross compatibility
- Free tools for viewing
- Excellent mutation
|
- Probably more upfront programming effort
- Can't view with notepad
|
CLED (2016)