Sparklyr - How to change the parquet data types

Viewed 1083

Is there a way to change data types of columns when reading parquet files? I'm using the spark_read_parquet function from Sparklyr, but it doesn't have the columns option (from spark_read_csv) to change it.

In csv files, I would do something like:

data_tbl <- spark_read_csv(sc, "data", path, infer_schema = FALSE, columns = list_with_data_types)

How could I do something similar with parquet files?

1 Answers
Related