pyspark

4047 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
PySpark: applying varying window sizes to a dataframe in pyspark
user_178322650
•
2
1
272
pyspark apache-spark-sql apache-spark window python
How to get rows where at least two distinct values are in a column?
user_108652100
•
2
1
52
pyspark apache-spark-sql apache-spark
what is spark doing after insertInto?
user_64711400
•
2
0
78
pyspark apache-spark hive
Exporting data from delta lake to single jsonl file and preserve nested field names (struct issue)
user_99919470
•
4
0
371
delta-lake pyspark pandas databricks azure
PySpark - create multiple aggregative map columns without using UDF or join
user_108522000
•
2
1
134
pyspark apache-spark-sql apache-spark user-defined-functions join
Facing issue with integrating code with Aws glue code, ray and pyspark
user_78284020
•
4
0
210
aws-glue-spark ray aws-glue pyspark python-3.x
Why Iterator of Series to Iterator of Series pandasUDF (PandasUDFType.SCALAR_ITER) when Series to Series (PandasUDFType.SCALAR) is available?
user_80896950
•
2
1
402
pyspark apache-spark-sql apache-spark
PySpark withColumn & withField TypeError: 'Column' object is not callable
user_93990330
•
3
1
6756
pyspark apache-spark-sql apache-spark
ParseExpection: no viable alternative at input
user_110270850
•
2
1
12068
pyspark azure-databricks apache-spark-sql apache-spark sql
Pyspark dataframe remove duplicate in AWS Glue Script
user_97044150
•
2
1
1603
aws-glue-spark aws-glue pyspark apache-spark-sql dataframe
Hot Questions