pyspark

4047 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Collect rows as an array of a Spark dataframe after a group by using PySpark
user_74758790
•
1
1
816
pyspark apache-spark-sql apache-spark
How do I control the file counts inside my Hive-partitioned dataset?
user12474509_149459390
•
2
1
123
foundry-python-transform foundry-code-repositories pyspark palantir-foundry
Pyspark - Difference between 2 dataframes - Identify inserts, updates and deletes
user_21110090
•
3
2
620
pyspark apache-spark-sql apache-spark python
Writing dynamic frame to s3 based on partition column but colon(:) symbol is being replaced by %3a
user_163624880
•
1
0
79
aws-glue pyspark amazon-s3
Pivot Spark Dataframe Columns to Rows with Wildcard column Names in PySpark
user_83756240
•
1
1
287
pyspark apache-spark-sql apache-spark python
ERROR Instrumentation: java.lang.ClassNotFoundException: ai.h2o.sparkling.ml.models.H2OGBMMOJOModel
user_173568840
•
1
0
84
sparkling-water h2o pyspark databricks apache-spark
How a failed databricks job can continue where it left?
user_131433790
•
1
2
783
pyspark databricks apache-spark job-scheduling
AWS Gluescript using spark, how does a glue job help spark persist data to the persistent storage layer, like parquet?
user_34543960
•
1
0
46
aws-glue pyspark amazon-web-services
MLflow FileNotFound when calling spark_udf from pycharm with databricks-connect
user_57260570
•
1
1
180
mlflow databricks-connect pyspark apache-spark
Loading JSON multiline file into pyspark dataframe
user_173473460
•
2
2
492
pyspark apache-spark-sql apache-spark json
Hot Questions