apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
spark scala: Performance degrade with simple UDF over large number of columns
user_9269180
•
1
2
96
apache-spark-standalone apache-spark scala
Dataproc - pyspark job submit - how to access yaml file contained within a zip file passed using --files flag
user_88304430
•
2
1
68
google-cloud-dataproc apache-spark python
How to Spark batch job global commit on ADLS Gen2?
user_143133990
•
1
1
23
apache-spark-sql apache-spark azure-storage azure
PySpark write data to Ceph returns 400 Bad Request
user_48376770
•
1
1
55
ceph pyspark apache-spark amazon-s3
Regex in Spark SQL is resulting in wrong value but working fine on Amazon Athena
user_48423770
•
2
1
79
amazon-athena pyspark apache-spark-sql apache-spark regex
SQL How to get sum of previous quarter when year changes?
user_81179990
•
1
3
75
apache-spark-sql apache-spark sql
How I discard columns with all values NULL in Apache Spark?
user_195998430
•
1
2
31
apache-spark-sql apache-spark java
How to extract doc from avro data and add it to dataframe
user_37358710
•
6
3
198
pyspark avro apache-spark hive python
How to extract a value that i don´t know from every row of a Pyspark dataframe
user_195988250
•
1
2
45
pyspark apache-spark dataframe python
FileNotFound error when running spark-submit
user_89485440
•
1
2
118
bitnami pyspark apache-spark hadoop
Hot Questions