apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
how can i avoid OOMs error in AWS Glue Job in pyspark
user_68384290
•
2
1
705
aws-glue pyspark apache-spark python
Is it possible to override just one column type when using PySpark to read in a CSV?
user_12075960
•
2
1
95
pyspark apache-spark python
Hash function in Spark SQL - Different strings all with the same hash generated
user_96581490
•
3
2
954
apache-spark-sql apache-spark hash
How to merge two parquet files having different schema in spark (java)
user_124903050
•
2
2
2103
apache-spark-sql apache-spark java
Get correct path for sparkdid.cassandra.connection.config.cloud.path in AWS EMR
user_47618920
•
2
1
83
datastax-astra amazon-emr spark-cassandra-connector apache-spark cassandra
Conditionally counting from a column
user_43126730
•
4
1
53
pyspark apache-spark-sql apache-spark
How to read a csv file from s3 bucket using pyspark
user_133714540
•
3
2
2662
pyspark apache-spark amazon-web-services amazon-s3
How I pass parameter in Workflow Template Spark job
user_167433170
•
3
1
735
google-cloud-dataproc apache-spark workflow python
Pyspark PandasUDF assignment
user_102964040
•
3
1
68
pyspark apache-spark
How can I get a job name while the job running in Databricks. It is not notebook based job
user_109241360
•
3
1
1046
pyspark databricks apache-spark python
Hot Questions