apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Multiple agg functions using Over Window (Concat & max )
user_56178670
•
1
1
39
hdfs apache-spark hadoop scala
Is it possible to run kubeflow pipelines or notebooks using AWS EMR as Spark Master/Driver
user_97157520
•
1
0
85
amazon-emr amazon-eks pyspark apache-spark amazon-web-services
When running "local-cluster" model in Apache Spark, how to prevent executor from dissociating prematurely?
user_17324180
•
1
1
85
apache-spark scalatest distributed-computing
Running spark-submit with spark-avro installed locally on a Mac or PC
user_71549140
•
1
0
171
spark-avro spark-submit pyspark apache-spark
Minio in docker cluster is not reachable from spark container
user_29875810
•
1
1
271
minio pyspark apache-spark python-3.x python
Getting `UnknownTimeZoneError: 'IST'` while converting pyspark dataframe to pandas dataframe
user_114367430
•
3
0
84
pyspark pandas apache-spark-sql apache-spark python
pyspark: Get hudi last/latest commit using pyspark
user_92872630
•
1
1
284
apache-hudi pyspark apache-spark dataframe python
How do I convert strings in a 2-D RDD to int using PySpark
user_187974980
•
1
1
48
pyspark apache-spark python
decode vs string.getBytes
user_67772380
•
1
0
62
apache-spark character-encoding scala
Scala explode followed by UDF on a dataframe fails
user_191183160
•
1
1
65
apache-spark explode user-defined-functions scala
Hot Questions