apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Stateful Structured Spark Streaming: Timeout is not getting triggered
user_5450860
•
2
1
140
spark-structured-streaming databricks apache-spark scala
How to compute a cumulative sum under a limit with Spark?
user_19617710
•
3
5
689
apache-spark scala sql
What does the metric "data size" (in Exchange step) represent in the Spark UI's SQL tab?
user_65800800
•
3
0
126
apache-spark-sql apache-spark
Pass column and a Map to a Scala UDF
user_70180700
•
2
1
562
apache-spark user-defined-functions scala
While trying to use SCALA UDF in PySpark, despite providing the --jars : ERROR : pyspark.sql.utils.AnalysisException: u'Can not load class
user_129005000
•
2
0
669
pyspark apache-spark user-defined-functions scala
how to write.stream in append mode
user_130038640
•
2
1
307
spark-streaming pyspark apache-spark python
Avoid lazy evaluation of code in spark without cache
user_54881730
•
2
2
2688
apache-spark-sql apache-spark
partitionBy & overwrite strategy in an Azure DataLake using PySpark in Databricks
user_93751020
•
8
3
11060
databricks apache-spark-sql apache-spark azure python
Upsert data in postgresql using spark structured streaming
user_5205540
•
3
1
852
spark-structured-streaming apache-spark
Error Connecting to Databricks from local machine
user_29627860
•
4
1
3139
databricks-connect azure-databricks databricks apache-spark
Hot Questions