apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Airflow DataprocSubmitJobOperator - ValueError: Protocol message Job has no "python_file_uris" field
user_68431030
•
1
1
96
airflow-2.x google-cloud-dataproc pyspark apache-spark google-cloud-platform
Is the number of partitions of a parquet file in ADLS same as number of partitions after reading it as dataframe?
user_107955960
•
1
1
65
pyspark databricks apache-spark
closing pydeequ callback server
user_98555880
•
1
1
41
pydeequ amazon-deequ pyspark apache-spark
Submitting dataproc job through Java ProcessBuilder API
user_4473900
•
1
0
31
google-cloud-dataproc apache-spark processbuilder java
datahub s3 metadata ingestion needs Spark installed
user_12914140
•
1
0
68
apache-spark amazon-s3
Spark filter dataframe on a condition based in the value on other rows
user_71500240
•
1
0
30
apache-spark-sql apache-spark
Change java version in master node of dataproc
user_166515300
•
2
1
67
dataproc google-cloud-dataproc apache-spark java
Spark Streaming on Kubernetes - Executor Pods not Restarted/Rescheduled
user_15812660
•
1
0
88
spark-operator spark-streaming apache-spark kubernetes
Spark dataframe distinct write is increasing the output size by almost 10 fold
user_51993210
•
1
1
96
apache-spark-sql apache-spark
How to check if a class is installed on Databricks through a Spark Listener?
user_9502800
•
1
1
159
azure-databricks databricks apache-spark azure java
Hot Questions