apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
a MapType causes an AnalysisException in Spark 3.x : Encoders.bean to an object containg a map<String, someClass> fails, that works fine in Spark 2.4
user_28271810
•
7
1
996
apache-spark java
How to remove rows in a spark dataset on the basis of count of a specific group
user_90315120
•
2
2
1217
pyspark apache-spark-sql apache-spark
Scala/Spark - Create Dataset with one column from another Dataset
user_31343830
•
2
1
195
apache-spark scala
How to split one into multiple in spark?
user_53527480
•
2
1
109
pyspark apache-spark python
efficient symmertic computation in spark
user_10028990
•
6
1
228
pyspark apache-spark python
AWS EMR PySpark Jupyter notebook not running
user_60635790
•
2
1
697
amazon-emr pyspark apache-spark
Spark UDF deserialization error from sample Java program
user_30440
•
2
1
1184
apache-spark-sql apache-spark scala java
Unable to initialize main class org.apache.spark.deploy.SparkSubmit when trying to run pyspark
user_10565630
•
3
2
2472
conda pyspark apache-spark python
Spark - Find total occurrence of each distinct value in two different columns
user_144228620
•
2
2
240
apache-spark scala
Pyspark count on any sliding window for any ID
user_18571250
•
2
1
803
sliding-window pyspark apache-spark window-functions python
Hot Questions