apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Joining PySpark dataframes with conditional result column
user_27535010
•
2
4
95
pyspark-dataframes pyspark apache-spark-sql apache-spark python
Why does spark application crash with exception java.net.SocketException: Connection reset even after providing sufficient memory & partitioning?
user_71195010
•
3
1
1462
google-cloud-dataproc pyspark apache-spark
Create a csv file with timestamp as file name using a dataframe scala
user_113736390
•
2
2
1671
apache-spark dataframe csv scala
java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.azurebfs.SecureAzureBlobFileSystem not found
user_16409220
•
4
2
3240
azure-data-lake-gen2 apache-spark kubernetes hadoop java
Spark 2.3: Remove rows if between 3 minutes of two consecutive occurrence
user_109533680
•
2
1
77
apache-spark scala
Is RDD kept in memory or is it immediately flushed out of memory after an action is completed?
user_80550250
•
2
1
194
rdd apache-spark
Parquet file size using Spark
user_8181190
•
2
0
133
parquet apache-spark
Dangling metacharacter * sparksql
user_150972680
•
3
2
312
metacharacters regexp-replace apache-spark regex-group regex
How is a Spark Dataframe partitioned by default?
user_7608070
•
3
1
1428
rdd apache-spark-sql apache-spark
How to fix "CommunicationsException: Communications link failure"?
user_16822930
•
3
0
105
amazon-emr pyspark apache-spark mysql
Hot Questions