apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
PySpark: Compare array values in one dataFrame with array values in another dataFrame to get the intersection
user_41683970
•
4
1
1953
pyspark apache-spark-sql apache-spark
Reading JSON files into Spark Dataset and adding columns from a separate Map
user_40094510
•
8
2
1480
apache-spark-dataset apache-spark-sql apache-spark scala json
MapWithState gives java.lang.ClassCastException: org.apache.spark.util.SerializableConfiguration cannot be cast while recovering from checkpoint
user_33393560
•
3
1
776
checkpointing spark-streaming apache-spark broadcast serialization
Specify dependency with classifier in Zeppelin
user_2981040
•
5
1
350
emr apache-zeppelin apache-spark maven scala
Save and load two ML models in pyspark
user_39564600
•
11
1
14977
apache-spark-ml pyspark apache-spark python
Spark (scala) dataframes - Check whether strings in column contain any items from a set
user_74695640
•
3
3
11697
apache-spark scala
Cannot have circular references in bean class, but got the circular reference of class class org.apache.avro.Schema
user_22601490
•
8
1
5004
apache-spark java
How to connect with JMX remotely to Spark worker on Dataproc
user_9924260
•
7
2
3421
hadoop-yarn google-cloud-dataproc apache-spark
Change the timestamp to UTC format in Pyspark
user_83936220
•
6
2
28215
spark-dataframe pyspark apache-spark
Writing SQL vs using Dataframe APIs in Spark SQL
user_52459180
•
43
4
26766
hdfs apache-spark-sql apache-spark hive
Hot Questions