apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Can I convert RDD to DataFrame in Glue?
user_184510420
•
3
1
186
aws-glue pyspark apache-spark
Class org.apache.hadoop.fs.s3a.auth.IAMInstanceCredentialsProvider not found when trying to write data on S3 bucket from Spark
user_181641080
•
7
3
5422
spark-streaming pyspark apache-spark hadoop amazon-s3
FileNotFoundError: [Errno 2] No such file or directory: 'C:\\Users\\hp\\AppData\\Local\\Temp\\spark-69fc2b6c-2af6-429c-a51e-e639f3430e37\\py
user_133401360
•
1
1
3713
pyspark pandas apache-spark python
ERROR StandaloneSchedulerBackend: Application has been killed. Reason: All masters are unresponsive! Giving up. - Spark standalone cluster
user_180360400
•
1
0
129
apache-spark-standalone spark-submit apache-spark scala
How to resolve failed Apache Spark 3.2.1 Maven Test: SparkSubmitCommandBuilderSuite.testPySparkLauncher:154
user_94485690
•
1
0
611
pyspark apache-spark maven hadoop java
Vectorized pandas udf in pyspark with dict lookup
user_4962890
•
2
2
452
pyspark pandas databricks apache-spark user-defined-functions
Coalesce() function on databricks
user_184934880
•
2
1
422
databricks-sql azure-databricks databricks apache-spark-sql apache-spark
Parallelize MLflow Project runs with Pandas UDF on Azure Databricks Spark
user_133654180
•
2
0
297
pandas-udf mlflow pyspark azure-databricks apache-spark
Overriding Java security properties on a Dataproc cluster to overcome SSL handshake issue with MS SQL 2019
user_184564480
•
2
0
164
mssql-jdbc dataproc google-cloud-dataproc apache-spark java
Presto on (Py)Spark - setup
user_158422860
•
2
0
237
presto bigdata pyspark apache-spark-sql apache-spark
Hot Questions