apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Amazon EMR pyspark unable to read a JSON file
user_54395460
•
2
2
141
bigdata amazon-emr pyspark apache-spark amazon-s3
Join dataframes and rename resulting columns with same names
user_6265280
•
7
4
124
apache-spark python
Spark JDBC connection to Google Cloud Spanner failure
user_52605090
•
1
2
72
google-cloud-spanner google-cloud-dataproc apache-spark google-cloud-platform jdbc
Can Apache Hudi be used to upsert a row from Apache Spark dataframe into Postgres database?
user_35531150
•
1
1
33
apache-hudi apache-spark
Spark Dataproc StackOverflowError caused by RDD.map()
user_197431890
•
1
0
23
google-cloud-dataproc apache-spark scala java
Why to use SparkSession in the beginning of Notebook
user_79057040
•
1
1
47
pyspark databricks apache-spark-sql apache-spark
How to modify config file of spark job in Airflow UI?
user_186530780
•
1
1
32
airflow apache-spark
How to run inference of a custom pytorch model (madule) on pyspark dataframe?
user_170013080
•
1
0
35
mlops pytorch pyspark apache-spark python
Why SparkSession class of pyspark is in pyspark.sql not pyspark?
user_180380140
•
1
1
33
pyspark apache-spark
What is the most efficient way to select distinct value from a spark dataframe?
user_46975010
•
1
2
145
pyspark apache-spark-sql apache-spark
Hot Questions