pyspark

4047 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to request the spark session object from a background-running Spark application from within a python script?
user_106809540
•
2
1
103
pyspark apache-spark python
Spark streaming reads file twice from NFS
user_169918410
•
7
1
318
spark-streaming pyspark apache-spark duplicates
Spark "first" Window function is taking much longer than "last"
user_5296180
•
7
1
511
pyspark apache-spark-sql apache-spark window-functions performance
Add rows to a PySpark df based on a condition
user_122253000
•
2
1
89
pyspark apache-spark
Pyspark : TypeError: unsupported operand type(s) for +: 'int' and 'str'
user_151130290
•
2
1
837
pyspark apache-spark-sql
Find out the closest value PySpark
user_100376890
•
1
1
150
pyspark apache-spark dataframe python
PySpark / Spark SQL DataFrame - Error while parsing Struct Type when data is null
user_67630330
•
3
1
662
pyspark azure-databricks apache-spark-sql apache-spark dataframe
Dataframe Won't Print
user_147226760
•
1
1
31
pyspark syntax-error sql
How to solve an assignment problem (like Hungarian/linear_sum_assignment) with an edge case in PySpark UDF
user_76506350
•
10
1
463
hungarian-algorithm scipy-optimize pyspark apache-spark python
In PySpark how to round a timestamp value to the nearest minute?
user_23638340
•
2
1
237
apache-zeppelin aws-glue pyspark timestamp python
Hot Questions