I'm Using Spark 2.0.2 in combination with sparklyr 0.5.4-9004 on RStudio, in a windows server.
Every once in a while, when I try to collect, read or write data from the spark server, I'm getting the following error:
Error in UseMethod("invoke") :
no applicable method for 'invoke' applied to an object of class "character"
I'm not sure if it's a server issue, or some problem with sparklyr.
So far, the only way I have to solve this, is restarting the sparklyr connection with Spark.
Here is the simple code I'm using:
sc <- spark_connect(master = "spark://####:7077")
tibble_file_parquet <- spark_read_parquet(
sc, "file_parquet", path, overwrite = TRUE)
result <- tibble_file_parquet %>% count(x, y)
collect(result)