pyspark

4047 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Detect when certain column value changes from value1 to value2 in pyspark
user_131267940
•
4
1
570
pyspark dataframe python-3.x
Pyspark - column item in another column list
user_103062240
•
2
2
815
pyspark-sql pyspark-dataframes pyspark python
Pyspark Data Frame: Access to a Column (TypeError: Column is not iterable)
user_48666570
•
2
1
1021
pyspark databricks
Figure not updated on jupyter notebook (sparkmagic)
user_109114800
•
2
0
84
livy jupyter jupyter-notebook pyspark python
In a Spark cluster, is a copy of a broadcast variable kept on every executor process or only on every machine?
user_88128450
•
2
1
137
pyspark apache-spark
Execute PySpark code from a Java/Scala application
user_49269420
•
4
0
101
pyspark-dataframes pyspark apache-spark
Facing NoClassDefFoundError error at Kafka-Spark Structured Streaming integration via PySpark
user_113520770
•
2
2
4260
pyspark-sql spark-structured-streaming pyspark apache-kafka apache-spark
Using tensorflow.keras model in pyspark UDF generates a pickle error
user_132389640
•
4
2
4254
pyspark keras tensorflow apache-spark user-defined-functions
Pyspark: For each month, make a cumulative sum of the previous 3 months
user_106928990
•
3
1
2226
partition pyspark cumulative-sum window
Make groupby.apply more efficient or convert to spark
user_116438700
•
3
2
186
pandas-groupby pyspark pandas apache-spark-sql dataframe
Hot Questions