apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Spark Dataframe Write to CSV creates _temporary directory file in Standalone Cluster Mode
user_21043030
•
7
3
6646
apache-spark-sql apache-spark dataframe csv java
Spark-sql Insert OVERWRITE append data instead of overwriting
user_6553060
•
3
1
9508
apache-spark-sql
Pyspark: java.lang.OutOfMemoryError: GC overhead limit exceeded
user_57716170
•
6
2
8354
pyspark apache-spark-sql apache-spark
How to add any new library like spark-sftp into my Pyspark code?
user_102869970
•
3
1
2180
pyspark apache-spark-sql apache-spark scala
java.lang.AssertionError: assertion failed: No plan for HiveTableRelation
user_60444960
•
8
2
5430
apache-spark-sql apache-spark hive amazon-s3 scala
Filter Pyspark Dataframe with udf on entire row
user_23999730
•
4
1
12672
pyspark apache-spark-sql user-defined-functions
Iterate over elements of columns Scala
user_17708510
•
4
2
2191
apache-spark-sql apache-spark scala
Limiting maximum size of dataframe partition
user_76480
•
13
2
12053
apache-spark-sql apache-spark scala
Long GC Pause on Apache Spark Structured Streaming on Kubernetes
user_102804470
•
5
1
1434
apache-spark-sql apache-spark kubernetes jvm garbage-collection
Why does persist(StorageLevel.MEMORY_AND_DISK) give different results than cache() with HBase?
user_71360910
•
3
1
2505
apache-spark-1.6 java-8 apache-spark-sql apache-spark hbase
Hot Questions