apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
gcloud spark submit:Path does not exist: hdfs://cluster-xxxx-m/user/root/--;
user_188940990
•
3
1
130
spark-submit airflow gcloud apache-spark google-cloud-platform
HDFS Date partition directory loop
user_165656740
•
1
0
28
spark-cassandra-connector hdfs apache-spark hadoop cassandra
Replace Special character in nested field names in dataframe dynamically ---Spark Scala
user_34898850
•
1
0
78
apache-spark-sql apache-spark dataframe scala
Is there a way, without Spark UDFs, to blend two distribution DataFrames that have different support?
user_6776670
•
1
2
39
apache-spark-sql apache-spark scala
How to find the number of Inserts and Updates of Merge command?
user_17043480
•
2
1
173
delta-lake apache-spark scala
Submitting a spark job to a kubernetes cluster using bitnami spark docker image
user_4519960
•
1
0
395
bitnami apache-spark kubernetes
what is the difference between a spark-py image created using docker-image-tool.sh and the one in docker hub
user_190416910
•
1
0
113
docker-image pyspark apache-spark kubernetes
Start the numbers in new column from last highest numbers in another column
user_178394750
•
2
1
49
pyspark apache-spark-sql apache-spark dataframe max
Pivot duplicate values into 2 different columns
user_140516220
•
1
1
80
pyspark apache-spark-sql apache-spark pivot duplicates
Start PySpark in Jupyter notebook on EMR 6.5
user_53462880
•
1
0
231
livy amazon-emr jupyter-notebook pyspark apache-spark
Hot Questions