apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Pyspark: how to split a dataframe into chunks and save them?
user_35900670
•
4
1
10732
pyspark-dataframes pyspark apache-spark-sql apache-spark python
Execute python script with spark
user_42964070
•
2
1
489
jupyter-notebook pyspark apache-spark python
Overwrite to S3 Bucket from EMR taking long time
user_140424430
•
2
1
555
amazon-emr aws-glue apache-spark amazon-web-services amazon-s3
Unable to start spark-shell failing to submit spark-submit
user_34898850
•
9
1
3425
spark-streaming apache-spark-sql apache-spark
Strange problem with from_utc_timestamp function and timezones in spark
user_140433300
•
2
0
176
apache-spark timezone datetime
Converting StringType to TimestampType in Spark 3.0
user_34330500
•
2
2
3162
pyspark apache-spark-sql apache-spark
Does the User Defined Functions (UDF) in SPARK works in a distributed way?
user_82273990
•
3
1
728
pyspark databricks apache-spark distributed-computing
Spark GraphX pregel the number of iterations is greater than 3, resulting in FULL GC
user_139045720
•
2
0
133
apache-spark graph garbage-collection scala
Higher Order functions in Spark SQL
user_140292220
•
2
1
1380
apache-spark-sql apache-spark
How can I update application progress on Spark UI?
user_98418860
•
2
0
157
apache-spark jobs scala
Hot Questions