I have converted data from csv to parquet file format using pyspark infer schema and tried to read data using Athena.
df.printSchehma()
test_num : double (nullable = true)
Athena also using double data type when we create table with Glue crawler, we cant query table with below issue.
Error:
test_num : type INT64 in parquet is incompatible with type double defined in table schema
Any suggestions to resolve this issue ? appreciate your help.