pyspark-dataframes

95 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Creating PySpark UDFs from python method with numpy array input, to calculate and return a single float value
user_151689300
•
2
1
839
pyspark-dataframes pyspark apache-spark-sql user-defined-functions numpy
How to find the mean value of a array column and then subtract the mean from each element in a pyspark dataframe?
user_52293380
•
2
1
341
pyspark-dataframes pyspark apache-spark-sql apache-spark python
pyspark dataframes: Why can I select some nested fields but not others?
user_151488260
•
2
2
66
pyspark-dataframes pyspark apache-spark-sql apache-spark python-3.x
Update the Nested Json with another Nested Json using Python
user_50389740
•
2
1
397
pyspark-dataframes pyspark apache-spark python-3.x
Filter nested JSON structure and get field names as values in Pyspark
user_4229300
•
2
1
1593
pyspark-dataframes pyspark apache-spark-sql apache-spark python
Is there an Enum type in PySpark?
user_101120480
•
6
0
657
pyspark-dataframes pyspark apache-spark-sql apache-spark
Converting CSV to JSON using pyspark with filter and additional columns
user_109511100
•
2
1
101
pyspark-dataframes pyspark apache-spark-sql join json
Pyspark: Selecting a value after exploding an array
user_37114820
•
2
1
105
pyspark-dataframes pyspark apache-spark-sql apache-spark
Using broadcast values inside PySpark UDF throwing "java.io.IOException: Failed to delete original file"
user_30267950
•
3
0
187
pyspark-dataframes pyspark apache-spark python
How to read/load local files in Databricks?
user_96990170
•
2
1
7246
pyspark-dataframes azure-databricks databricks apache-spark-sql apache-spark
Hot Questions