Spark SQL: Repartition by column Exception "REPARTITION Hint expects a partition number as parameter"

Viewed 399

I want to repartition a table on a specific column (keeping the default number of partitions), cache it and use it for a number of subsequent joins with other tables. According to the documentation the syntax should be:

CREATE TEMPORARY VIEW V24 AS SELECT /*+ REPARTITION(c) */ * FROM t

But I am getting the exception "REPARTITION Hint expects a partition number as parameter". I also tried REPARTITION('c'), REPARTITION("c") and REPARTITION(col("c")), but nothing seems to work.

I am usign Spark 2.4.3.

0 Answers
Related