apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Aggregating two columns with Pyspark
user_139919300
•
2
1
38
pyspark apache-spark
spark gcp dataproc dependency error with guava
user_19870070
•
4
0
266
google-cloud-dataproc apache-spark guava google-cloud-platform hadoop
Issue for Integrating Hudi with Kafka using Avro Schema
user_62986320
•
2
2
408
apache-hudi confluent-schema-registry confluent-platform avro apache-spark
Where is Spark structured streaming state of mapGroupsWithState stored?
user_22015660
•
2
2
446
spark-structured-streaming apache-spark
Groupby and aggregate distinct values as a string
user_62478640
•
2
3
975
pyspark apache-spark group-by python string
How to normalize and create similarity matrix in Pyspark?
user_52003290
•
6
1
556
pyspark pandas apache-spark-sql apache-spark python
Reduce frequency of Spark Streaming Info logs
user_56797200
•
2
0
91
spark-streaming hadoop-yarn apache-spark log4j
Spark submit to kubernetes: packages not pulled by executors
user_43606830
•
7
1
1274
spark-submit pyspark apache-spark kubernetes python
Dataframe API vs Spark.sql
user_108451860
•
2
3
1623
catalyst-optimizer apache-spark dataframe
How to find row names where values are maximum in a column in Pyspark
user_52003290
•
2
3
292
pyspark pandas apache-spark sql python
Hot Questions