apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to implement String contains with equals ignore case to filter content of a dataframe?
user_71195010
•
2
2
127
apache-spark scala
Unable to overwrite default value of "spark.sql.shuffle.partitions" with Spark Structured Streaming
user_89197490
•
2
1
325
spark-structured-streaming apache-spark scala
"java.lang.IllegalArgumentException: No valid credential configuration discovered" error when authenticating Hadoop-GCS connector
user_157194480
•
4
2
1076
google-cloud-storage pyspark apache-spark google-cloud-platform
Extracting data out of pyspark DataFrame
Admin1
•
2
1
41
pyspark apache-spark dataframe python
Databricks Job API create job with single node cluster
user_74549720
•
2
1
1073
databricks apache-spark jobs cluster-computing api
Creating DataFrame of different variable types
Admin1
•
3
2
190
rdd pyspark apache-spark dataframe python
How does merge-sort join work in Spark and why can it throw OOM?
user_7063540
•
4
2
915
apache-spark
Spark is pushing down a filter even when the column is not in the dataframe
user_25167830
•
3
1
138
apache-spark scala
Glue Spark Scala Script to check if file exist in S3?
user_152341470
•
2
1
1348
aws-glue apache-spark amazon-web-services amazon-s3 scala
Spark on Kubernetes driver pod cleanup
user_43659270
•
3
3
1375
apache-spark kubernetes
Hot Questions