apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to add python list to a pyspark column?
user_107955960
•
2
1
192
pyspark apache-spark
Pyspark: change values in an array column based on another array column
user_130514080
•
2
1
676
pyspark apache-spark-sql apache-spark python
How to execute operations every batch?
user_132789060
•
2
1
96
spark-structured-streaming pyspark apache-kafka apache-spark
How to configure a custom Spark Plugin in Databricks?
user_77211780
•
3
1
532
aws-databricks azure-databricks databricks apache-spark-sql apache-spark
spark-shell exception org.apache.spark.SparkException: Exception thrown in awaitResult
user_63644790
•
2
1
551
spark-shell hadoop-yarn apache-spark
round to precision value based on another column pyspark
user_101408210
•
2
2
132
pyspark apache-spark
Exception in thread "main" java.lang.IllegalAccessError: class org.apache.spark.storage.StorageUtils$
user_139004540
•
10
1
8051
sparkcore apache-spark-sql apache-spark scala
Why do year and month functions result in long overflow in Spark?
user_120486000
•
4
1
475
spark-cassandra-connector apache-spark cassandra scala
Convert Spark DF to a DS with different fields names
user_75512110
•
3
2
243
apache-spark-dataset apache-spark-sql apache-spark pojo java
Sorting values of an array type in RDD using pySpark
user_94706430
•
2
1
218
rdd pyspark apache-spark sorting
Hot Questions