apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
EMR - Spark creating randomly corrupted parquet snappy files - FAILED_TO_UNCOMPRESS
user_10297220
•
3
0
223
amazon-emr apache-spark
spark select column returns reference of old dataframe
user_70677370
•
3
2
145
pyspark apache-spark-sql apache-spark dataframe
Apache Spark s3a committer - thread stack - out of memory issues
user_42095280
•
2
2
403
pyspark apache-spark hadoop amazon-s3 java
Order Spark RDD based on ordering in another RDD
user_145947340
•
2
1
86
apache-spark scala
Possible to view Spark History Server Logs in JSON?
user_17877510
•
2
0
91
apache-spark-sql apache-spark
Combine month and year columns to create date column
user_165252630
•
2
3
1042
pyspark apache-spark-sql apache-spark python
Is there a way to access dbutils within RStudio Server built on top of a databricks cluster?
user_174720250
•
2
1
129
rstudio-server sparklyr azure-databricks databricks apache-spark
Py4JJavaError: An error occurred while calling o389.parquet when trying to write rdd dataframe as parquet files on local directory
user_174046290
•
2
2
3921
typeerror parquet pyspark apache-spark python
PySpark - Issue with CPU heavy cartesian join when using multiple join columns
user_58693160
•
2
1
115
aws-glue pyspark apache-spark
How to provide the relative path of certificates packaged inside jar?
user_80547210
•
2
0
92
google-cloud-dataproc apache-spark scala
Hot Questions