How to load and index files with parquet format to elasticsearch?

user_3679431 0
Viewed 10411

I have a very large parquet file which I need to import it to elasticsearch. I searched on the net but could not find useful result. I wonder if latest version of elasticsearch would support such format?

parquet elasticsearch
2 Answers

I'm the author of Moshe/elasticsearch_loader
I wrote ESL for this exact problem.
You can download it with pip:

pip install elasticsearch-loader[parquet]

And then you will be able to load parquet files into elasticsearch by issuing:

elasticsearch_loader --index incidents --type incident parquet file1.parquet file2.parquet
user_45401230
Related