apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Configuring EMR cluster, which node to choose?
user_26538770
•
3
1
800
amazon-emr apache-spark amazon-web-services
How to configure backpreasure in Spark 3 Structure Stream Kafka/Files source with Trigger.Once option
user_28707040
•
4
1
150
spark-kafka-integration spark-structured-streaming apache-spark
A dataset having a String column with values LOOKING numeric is partitioned and stored. When it is read again data is still "string" but lost zeroes
user_28271810
•
2
2
84
apache-spark-sql apache-spark java
Spark ERROR executor: Exception in task 0.0 in stage 0.0 (tid 0) java.lang.ArithmeticException
user_152007050
•
3
1
1200
spark-cassandra-connector apache-spark cassandra scala java
Forward filling in .NET for Spark
user_154608390
•
3
1
228
.net-spark apache-spark dataframe window-functions c#
Iterate a column values in a Stream dataframe and assign each value to a common list using Scala and Spark
user_32798930
•
1
1
194
apache-spark dataframe list scala stream
Count elements across users in df after grouping by, in Spark Scala
user_43088190
•
1
1
48
apache-spark dataframe aggregate group-by scala
Custom aggregation to a JSON in pyspark
user_44471060
•
1
1
114
pyspark apache-spark-sql apache-spark python
How to check if values of a DateType column are within a range of specified dates?
user_119034030
•
2
1
335
amazon-deequ apache-spark dataframe scala
Spark DataFrame GroupBy collect_list and fill missing valeus with 0
user_27260380
•
1
1
95
pyspark apache-spark
Hot Questions