Athena type INT64 in parquet is incompatible with type double defined in table schema

Viewed 1132

I have converted data from csv to parquet file format using pyspark infer schema and tried to read data using Athena.

    df.printSchehma()
    test_num : double (nullable = true)

Athena also using double data type when we create table with Glue crawler, we cant query table with below issue.

Error:

   test_num : type INT64 in parquet is incompatible with type double defined in table schema

Any suggestions to resolve this issue ? appreciate your help.

0 Answers
Related