apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
One Kafka consumer in a group consistently rejects coordinator, but only when Spark and Kafka are both in EC2
user_72599260
•
6
1
961
spark-streaming apache-kafka apache-spark amazon-ec2
Encoders.product[of a scala trait ].schema in spark
user_119345020
•
3
2
1291
apache-spark database-schema scala
How can I pass a Scala UserDefinedFunction where output is a complex type (using StructType and StructField) to be used from Pyspark
user_20811520
•
4
1
356
pyspark apache-spark user-defined-functions interop scala
Converting string "decimal" to DecimalType
user_27515730
•
3
1
766
apache-spark scala
Upgraded the spark version, and during spark jobs encountering java.lang.NoSuchMethodError: scala.Product.$init$(Lscala/Product;)V
user_71209570
•
2
1
341
apache-spark scala
Is reading of a file is lazily evaluated in Apache spark?
user_144157120
•
2
1
252
pyspark apache-spark-sql apache-spark
Is apache spark right choice to index bulk amount of data into solr?
user_48505880
•
2
0
124
apache-spark solr java
Spark window partition function taking forever to complete
user_4098140
•
6
3
2626
apache-spark-sql apache-spark dataframe scala performance
Reading data from s3 subdirectories in PySpark
user_17711550
•
2
2
5544
pyspark-dataframes parquet aws-glue pyspark apache-spark
Difference in caching RDD vs. caching DataFrame in Spark
user_122089100
•
4
0
93
rdd apache-spark-sql apache-spark
Hot Questions