apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Sample Pyspark DataFrame by date with number of days from last entry between each sample
user_17319700
•
2
1
554
pyspark apache-spark sampling dataframe python
How to transform json column in databricks with scala
user_89587040
•
1
1
43
apache-spark-sql apache-spark scala json
Group into current row previous group values with Pyspark
user_68656330
•
1
1
140
pyspark apache-spark-sql apache-spark python
How to use GCS connector in apache spark deployed in GKE?
user_122044950
•
1
0
70
google-kubernetes-engine google-cloud-storage apache-spark
Spark SQL Window functions - manual repartitioning necessary?
user_74247290
•
1
1
393
pyspark apache-spark partitioning
Conditional aggregation using when()
user_43126730
•
1
1
23
pyspark apache-spark-sql apache-spark python
When performing a left join in spark sql, It is not getting the value properly
user_159504130
•
2
0
168
apache-spark left-join sql
Jupyterhub pyspark3 on AWS EMR YARN Cluster
user_126645880
•
2
1
454
livy amazon-emr jupyter-notebook pyspark apache-spark
Unable to mount Azure ADLS Gen 2 on from Community Edition of Databricks : com.databricks.rpc.UnknownRemoteException: Remote exception occurred
user_155206150
•
2
1
392
azure-data-lake-gen2 databricks-community-edition pyspark databricks apache-spark
Airflow: trigger Spark in different Docker container
user_89719380
•
2
1
2129
spark-submit airflow apache-spark docker
Hot Questions