I have a bunch of columns ( around 30). Out of which there are arrays, text fields with multiple line space (Word document) etc. I think CSV will not be an apt format because of multiple new lines. I am thinking of using Parquet format.
The file itself needs to be generated via NodeJS.
- Is there a preferred library for Parquet?
- Also, is there any recommendation for a specific file format for big query?
Any pointers would be helpful