Even after setting the "orc.force.positional.evolution" to false hive is still picking up based on position

Viewed 31

I have an external table where I have added few new columns and wanted to ensure that data in orc format file should be written from Spark dataframe to Hive external table based on the column name and not based on position and so have set "orc.force.positional.evolution"="false" in TBLPROPERTIES but still data is written based on a position which is incorrect.

Please suggest what I am missing here. I have used below question as a reference:

Hive external table with ORC format- how to map the column names in the orc file to the hive table columns?

I have a workaround of using select on spark Dataframe but looking for better options without making any code changes.

Hive version I am using is 3.1

0 Answers
Related