pyspark

4047 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Dataproc - Pyspark - java.lang.ClassNotFoundException - although the dependency jars are in the classpath
user_88304430
•
2
0
52
google-cloud-dataproc pyspark apache-spark google-cloud-platform java
How to return none type in pandas GROUPEDMAP UDF
user_27711690
•
1
0
39
pyspark apache-spark user-defined-functions
Continous data generator from Azure Databricks to Azure Event Hubs using Spark with Kafka API but no data is streamed
user_146818270
•
1
1
55
data-stream azure-eventhub pyspark azure-databricks apache-spark
Why is a DataFrameStatFunctions object not equal to a copy of itself?
user_45656200
•
1
0
20
pyspark python
In Foundry, how can I Hive partition with only 1 parquet file per value?
user_34514270
•
1
1
69
foundry-code-workbooks hive-partitions foundry-code-repositories pyspark palantir-foundry
Databricks Cannot perform Merge as multiple source rows matched and attempted to modify the same target row in the Delta table
user_155206150
•
3
2
2053
pyspark azure-databricks apache-spark
Spark Data writing in Delta format
user_22612780
•
2
1
243
delta-lake pyspark
Groupby column and create lists for other columns, preserving order
user_164116180
•
3
1
70
pyspark apache-spark-sql apache-spark dataframe python
Spark SQL column doesn't exist
user_193483950
•
1
1
38
pyspark sql
Parse JSON column then add new column in the same dataframe with parsed value
user_191681380
•
1
1
95
aws-glue pyspark apache-spark-sql apache-spark json
Hot Questions