apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Is the checkpoint requires for the delta lake merge operation in a streaming job
user_100173480
•
1
1
90
delta-lake databricks apache-spark upsert
PySpark: creating aggregated columns out of a string type column different values
user_154110760
•
1
1
21
pyspark apache-spark-sql apache-spark
How to pass dynamic number of columns?
user_120282230
•
1
1
43
columnsorting pyspark apache-spark-sql apache-spark dataframe
Databricks/python - what is a best practice approach to create a robust long running job
user_165084060
•
2
1
127
databricks apache-spark python
Modifying element in nested array of struct
user_26693830
•
1
1
41
pyspark apache-spark-sql apache-spark arrays python
Spark streaming read exception - java.net.SocketException; py4j.Py4JNetworkException
user_104349320
•
1
0
56
py4j spark-streaming pyspark apache-spark java
How reliable is spark stream join with static databricks delta table
user_100173480
•
2
1
240
delta-lake spark-structured-streaming databricks apache-spark
What is the difference between Core and Task node in EMR
user_163422820
•
1
0
222
amazon-emr pyspark apache-spark
Spark "Hello World" failure: java.util.NoSuchElementException: spark.app.id
user_16413000
•
2
0
233
pyspark apache-spark
Overwrite specific CSV partitions pyspark
user_68095200
•
1
3
221
pyspark apache-spark csv python
Hot Questions