apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
java.lang.ClassNotFoundException: org.apache.spark.sql.sources.v2.DataSourceV2 for Spark 3.0.0
user_38058990
•
3
3
6143
pyspark apache-spark scala java
Dynamically pass columns into when otherwise functions in Spark SQL
user_7270790
•
2
1
405
apache-spark-sql apache-spark scala
Querying Delta Lake from Inside of UDF in Databricks
user_118874920
•
2
1
703
delta-lake spark-structured-streaming databricks apache-spark user-defined-functions
how do I install parckage(such as mmlspark) to CDH cluster without network access?
user_16376730
•
4
2
983
pyspark apache-spark installation python java
Exception "com.google.common.util.concurrent.MoreExecutors.directExecutor()Ljava/util/concurrent/Executor" in scala Application
user_140135690
•
2
1
217
google-cloud-storage apache-spark google-cloud-platform scala
manage dataproc cluster access using service account and IAM roles
user_103166890
•
3
1
725
sre google-cloud-storage google-cloud-dataproc apache-spark google-cloud-platform
how to split one spark dataframe column into two columns by conditional when
user_34480110
•
2
1
474
pyspark apache-spark dataframe
Cannot convert Catalyst type IntegerType to Avro type ["null","int"]
user_88389300
•
3
1
1839
pyspark apache-kafka avro apache-spark
Overloaded method foreachBatch with alternatives
user_129924020
•
6
3
3282
apache-spark scala
Spark: Read dat file with a special case
user_37254910
•
3
3
5556
apache-spark-sql apache-spark
Hot Questions