apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
java.lang.UnsupportedOperationException: Cannot have circular references in bean class but got the circular reference of class java.time.ZoneOffset
user_194804520
•
2
1
111
offsetdatetime apache-spark java
Does using python anonymous function in pyspark higher order function require data serialization?
user_71731190
•
3
0
33
pyspark apache-spark python
Sum up the values based on conditions coming form list and dict
user_56270230
•
2
2
60
pyspark apache-spark aggregate dictionary python
Is there a difference between these two different forms of Sort (orderBy) in pySpark?
user_58517590
•
2
2
49
pyspark apache-spark syntax
OOM using Spark window function with 30 days interval
user_194667450
•
2
1
149
apache-spark-sql apache-spark out-of-memory window-functions python
Date filtering in PySpark using between
user_167628810
•
1
1
104
pyspark apache-spark between filter date
SparkJob on GCP dataproc failing with error - java.lang.NoSuchMethodError: io.netty.buffer.PooledByteBufAllocator.<init>(ZIIIIIIZ)V
user_194623480
•
4
1
76
google-cloud-dataproc apache-spark google-cloud-platform
How to repartition spark dataframe into smaller partitions
user_71731190
•
1
1
70
pyspark apache-spark-sql apache-spark
Spark/Scala - Join resultset giving type mismatch error while performing withColumn operation; found : org.apache.spark.sql.Column required: Boolean
user_79130390
•
1
1
65
typeerror apache-spark-sql apache-spark dataframe scala
Pyspark: Comparing Datasets and Identify Unchanged Records
user_142193900
•
1
1
21
pyspark apache-spark anti-join null
Hot Questions