pyspark

4047 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Spark/PySpark "java.lang.IllegalStateException: LiveListenerBus is stopped."
user_42095280
•
2
1
351
pyspark apache-spark-sql apache-spark
Pyspark, create RDD with line number and list of words in line
user_11617120
•
1
2
231
rdd pyspark apache-spark python
Join Pyspark Dataframes where two lists share a value
user_156989790
•
1
1
94
pyspark apache-spark dataframe python
I'm looking for a pyspark alternative to the sklearn cosine similarity package
user_176877760
•
1
0
36
cosine-similarity pyspark apache-spark
Spark driver keep running 1 hour after the job finished
user_152850050
•
4
0
218
pyspark apache-spark-sql apache-spark
Writing Pyspark Dataframe to TFrecords file
user_100434720
•
2
1
297
pyspark tensorflow databricks apache-spark
How to apply F.when condition separately for unique subsets of the data
user_60675280
•
1
1
41
pyspark python
How to automatically create ERD diagrams from pyspark tables?
user_106809540
•
1
0
205
pyspark erd python-3.x
Can Cassandra or ScyllaDB give incomplete data while reading with PySpark if either clusters are left un-repaired forever?
user_137974320
•
3
3
73
scylla pyspark cassandra
Structured Streaming runs out of memory after running for a while even with spark.catalog.clearCache()
user_126447550
•
1
0
252
spark-structured-streaming pyspark apache-kafka apache-spark
Hot Questions