There are some options to access R libraries in Spark:
- directly using sparkr
- using language bindings like rpy2 or
rscala - using standalone service like opencpu
It looks like SparkR is quite limited, OpenCPU requires keeping additional service and bindings can have stability issue. Is there something else specific to Spark architecture which make using any solution not easy.
Do you have any experience with integrating R and Spark you can share?