How to configure Parquet write setting when using Flink's ParquetAvroWriters.forReflectRecord

Viewed 12

We're using Flink 1.14.4, and creating the Parquet file sink via:

StreamingFileSink<SomePOJO> sink = StreamingFileSink.forBulkFormat(
       new Path(outputDir),
       ParquetAvroWriters.forReflectRecord(SomePOJO.class))
    .build();

In following the forReflectRecord() code, I don't see where any of the Parquet configuration values are set up, versus how ParquetRowDataBuilder.FlinkParquetBuilder sets up page size, etc.

Do I need to implement my own version of ParquetAvroWriters that does this, or am I missing something here?

0 Answers
Related