apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Spark: Replicate each row but with change in one column value
user_141220300
•
3
3
952
rdd apache-spark-sql apache-spark scala
How to reduce the time taken to write parquet files to s3 using AWS Glue
user_139709550
•
2
4
3937
aws-glue pyspark apache-spark amazon-s3
How to get the count of number of records in structured streaming?
user_134998730
•
2
0
135
spark-streaming spark-structured-streaming apache-spark scala
How to open spark web ui while running pyspark code in pycharm?
user_82360290
•
3
2
2690
pyspark apache-spark pycharm
Filter dataframe with a window which contains at least one particular value
user_39550220
•
2
2
491
pyspark apache-spark
Spark sql Resolved exception: attribute(s) missing from in operator !Project
user_5067530
•
2
0
231
apache-spark-sql apache-spark sql
Many Dead Executors EMR
user_31499950
•
2
2
1537
amazon-emr apache-spark amazon-web-services cpu scala
Spark schema management at single place
user_27615090
•
7
2
726
aws-glue databricks apache-spark hive
Spark driver pod getting killed with 'OOMKilled' status
user_133608350
•
9
1
1685
spark-streaming apache-spark kubernetes out-of-memory
pyspark pandas udf RuntimeError: Number of columns of the returned doesn't match specified schema
user_130005660
•
7
1
1248
pandas apache-spark python
Hot Questions