I want to repartition a table on a specific column (keeping the default number of partitions), cache it and use it for a number of subsequent joins with other tables. According to the documentation the syntax should be:
CREATE TEMPORARY VIEW V24 AS SELECT /*+ REPARTITION(c) */ * FROM t
But I am getting the exception "REPARTITION Hint expects a partition number as parameter". I also tried REPARTITION('c'), REPARTITION("c") and REPARTITION(col("c")), but nothing seems to work.
I am usign Spark 2.4.3.