apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Spark Java saveAsTable failes with ArrayIndexOutOfBoundsException
user_43689540
•
8
3
3214
apache-spark scala java
Spark: RDD Left Outer Join Optimization for Duplicate Keys
user_20730810
•
3
1
1924
rdd apache-spark join
Spark failing because S3 files are updated. How to eliminate this error?
user_19557200
•
2
2
3679
apache-spark-sql apache-spark amazon-s3
Transferring unroll memory to storage memory failed
user_89012920
•
6
1
2681
pyspark apache-spark
Create boolean flag based on column value containing element of a List
user_92528150
•
3
1
1325
apache-spark conditional-statements dataframe dataset scala
spark date format MMM dd, yyyy hh:mm:ss AM to timestamp in df
user_68670480
•
2
4
12229
apache-spark-sql apache-spark
How to preserve milliseconds when converting a date and time string to timestamp using PySpark?
user_61199080
•
9
1
981
pyspark apache-spark python-3.x timestamp python
How to set PYSPARK_SUBMIT_ARGS environment variables on Linux on a Windows Machine?
user_106529950
•
8
0
3732
pyspark apache-spark python-3.x python
How can I sum multiple columns in a spark dataframe in pyspark?
user_89477390
•
13
3
32996
pyspark apache-spark-sql apache-spark python
spark does not read all orc files from different folder using merge schema
user_36076980
•
3
1
1379
orc apache-spark-sql apache-spark
Hot Questions