apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Spark : writeStream' can be called only on streaming Dataset/DataFrame
user_139876430
•
2
1
2162
spark-structured-streaming elasticsearch pyspark apache-kafka apache-spark
best way to run 300+ concurrent spark jobs in Dataproc?
user_74988880
•
2
1
122
dataproc google-cloud-dataproc apache-spark
Pyspark nullable uuid type uuid but expression is of type character varying
user_5794770
•
3
3
1143
pyspark apache-spark postgresql python
repartitioning by multiple columns for Pyspark dataframe
user_72989790
•
3
1
5688
pyspark apache-spark python
Purpose of spark worker directories in /work/app-xxxxxxx/{0, 1, 2, ...} and periodic cleanup
user_44143360
•
3
1
1117
spark-streaming apache-spark
Using broadcast values inside PySpark UDF throwing "java.io.IOException: Failed to delete original file"
user_30267950
•
3
0
187
pyspark-dataframes pyspark apache-spark python
How to use windowing functions efficiently to decide next N number of rows based on N number of previous values
user_138837230
•
4
1
379
windowing apache-spark-sql apache-spark mysql
How to add new Column in pyspark and insert multiple values with based on rows?
user_114152500
•
2
1
785
pyspark apache-spark-sql apache-spark python
SBT with Spark-Core 3.0.1 Exception NoClassDefFound for org/apache/log4j/Logger
user_145368480
•
2
1
387
apache-spark sbt intellij-idea log4j scala
What does "% of Queue" refer to in the hadoop yarn UI
user_120172530
•
3
1
380
hadoop-yarn apache-spark hadoop
Hot Questions