apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to set batch size in one micro-batch of spark structured streaming
user_74866210
•
3
1
3359
spark-structured-streaming pyspark apache-kafka apache-spark
How to generate large word count file in Spark?
user_73950990
•
2
3
255
apache-spark
PySpark equivalent of function "typedLit" from Scala API
user_72203860
•
7
3
3954
pyspark apache-spark-sql apache-spark scala arrays
How to persist the list which we made dynamically from dataFrame in scala spark
user_135420050
•
2
2
332
apache-spark scala
Error:'java.lang.UnsupportedOperationException' for Pyspark pandas_udf documentation code
user_115838660
•
12
5
5225
pyspark apache-spark-sql apache-spark
Efficiently batching Spark dataframes to call an API
user_136489030
•
2
1
1111
spotipy pyspark apache-spark-sql apache-spark
Why does spark-submit ignore the package that I include as part of the configuration of my spark session?
user_96677210
•
4
3
1104
pyspark apache-spark-sql apache-spark
Spark submit fails in k8s Cluster
user_124283670
•
2
2
1261
pyspark apache-spark kubernetes
pySpark:ConnectionResetError: [WinError 10054] An existing connection was forcibly closed by the remote host
user_124645040
•
4
0
596
pyspark apache-spark python-3.x python
Gremlin traversal queries on spark graph
user_74256490
•
2
1
1600
spark-graphx gremlin apache-spark graph-databases
Hot Questions