How can I add class to classpath in pyspark?

Viewed 38

I am trying to create a temporary function like this:

spark.sql("create temporary function ptyUnprotectStr as 'com.protegrity.hive.udf.ptyUnprotectStr'")

Error I get is:

AnalysisException: "Can not load class 'com.protegrity.hive.udf.ptyUnprotectStr' when regisitering the function 'ptyUnprotectStr' please make sure it is on the classpath"

So how can I add 'com.protegrity.hive.udf.ptyUnprotectStr' to the classpath? I am using Pyspark in Jupyter on Anaconda enterprise.

0 Answers
Related