pyspark

4047 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
`AnalysisException("Database 'delta' not found" ...` when creating delta table over DeltaTableBuilder API locally
user_99478840
•
2
0
1182
delta-lake pyspark databricks apache-spark python
How to efficiently count distinct values between all date combinations
user_180455550
•
2
1
314
pyspark apache-spark-sql apache-spark dataframe
pyspark query to find the difference in column value for corresponding values in another column
user_178926210
•
2
1
367
pyspark apache-spark-sql apache-spark dataframe python
How to ensure same partitions for same keys while reading two dataframes in pyspark?
user_80896950
•
3
0
185
pyspark apache-spark-sql apache-spark
Pyspark remove field in struct column
user_91787250
•
2
2
1713
pyspark databricks apache-spark-sql apache-spark dataframe
How can I reach a spark cluster in a Docker container with spark-submit and a python script?
user_179911540
•
2
2
1233
spark-submit pyspark apache-spark docker python
Usage of spark._jsparkSession.catalog().tableExists() in pyspark
user_120484870
•
2
1
593
hive-metastore delta-lake pyspark apache-spark
pyspark select first element over window on some condition
user_32299570
•
2
1
486
pyspark apache-spark-sql apache-spark dataframe python
How to integrate spark.ml pipeline fitting and hyperparameter optimisation in AWS Sagemaker?
user_19463000
•
2
1
196
apache-spark-ml amazon-sagemaker pyspark
JavaPackage object is not callable error for pydeequ constraint suggestion
user_105747910
•
2
0
169
pyspark databricks apache-spark
Hot Questions