apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to add an EMR Spark Step?
user_10262710
•
2
3
4821
amazon-emr apache-spark amazon-web-services
Calculate new column in spark Dataframe, crossing a tokens list column in df1 with a text column in df2 with pyspark
user_135000100
•
2
1
774
pyspark apache-spark-sql apache-spark
Scala Spark: Flatten Array of Key/Value structs
user_60160640
•
4
4
3116
apache-spark scala
Can we run Dataproc just on GKE or private on-prem k8s as well?
user_124258550
•
3
1
324
google-kubernetes-engine google-cloud-dataproc apache-spark kubernetes google-cloud-platform
How to create an RDD by selecting specific data from an existing RDD where output should of RDD[String]?
user_124027170
•
2
2
95
rdd apache-spark string-formatting scala
Save DataFrame to Table - performance in Pyspark
user_134983660
•
4
1
1325
pyspark apache-spark hive
Apache Spark calculating column value on the basis of distinct value of columns
user_46171990
•
2
2
56
apache-spark scala
Initialize virtual environment from requirements.txt while submitting PySpark job to Google Dataproc
user_79427170
•
4
1
649
google-cloud-dataproc pyspark apache-spark google-cloud-platform
java.lang.NoSuchMethodError: scala.Predef$.refArrayOps in Spark job with Scala
user_47708130
•
3
1
5950
incompatibility apache-spark version intellij-idea scala
How to drop duplicates in Delta Table?
user_115456280
•
4
3
7773
delta-lake apache-spark duplicates
Hot Questions