pyspark

4047 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
pyspark structured streaming not updating query metrics with query.lastProgress or other standard metrics
user_71649610
•
2
1
616
spark-structured-streaming pyspark apache-spark
How do you find feature names for Decision Tree Classification?
user_130662960
•
2
1
389
apache-spark-mllib pyspark databricks apache-spark python
Delta lake merge doesn't update schema (automatic schema evolution enabled)
user_122904690
•
4
4
2308
delta-lake pyspark databricks
How to write pytest by taking dataframe as an input to fetch all the required values in palantir foundry
user_144410170
•
2
1
240
foundry-code-repositories pyspark palantir-foundry pytest
Efficient reading/transforming partitioned data in delta lake
user_99919470
•
3
1
1138
delta-lake pyspark apache-spark-sql apache-spark
PYSPARK DF MAP: Get value for given key in spark map
user_109729590
•
4
1
3257
pyspark apache-spark-sql apache-spark
Why is the Spark Property spark.sql.optimizer.metadataOnly being Deprecated
user_98132030
•
2
0
269
pyspark apache-spark
How can Databricks tables be copied retaining history (timestamp and version) to another Databricks in a new subscription?
user_34731610
•
2
1
243
pyspark azure-databricks databricks azure-storage azure
Kryo serialization failed: Buffer overflow
user_105287330
•
2
0
687
amazon-emr pyspark apache-spark-sql apache-spark
Pyspark: Selecting a value after exploding an array
user_37114820
•
2
1
105
pyspark-dataframes pyspark apache-spark-sql apache-spark
Hot Questions