apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to handle backpressure on databases when using Apache Spark?
user_74896410
•
2
1
458
apache-spark-sql apache-spark
Adding a new column in the first ordinal position in a pyspark dataframe
user_74053580
•
6
4
11867
pyspark apache-spark-sql apache-spark python
How to access metrics of streaming query?
user_73337850
•
4
1
368
spark-structured-streaming apache-spark
Use Window to count lines with if condition in scala
user_76159840
•
2
3
360
apache-spark scala
How to create new Column using withColumn to concentrate two numeric conlumn as String ?
user_52506200
•
2
1
84
apache-spark-sql apache-spark scala
Spark No Encoder found for java.io.Serializable in Map[String, java.io.Serializable]
user_17247700
•
2
1
3295
apache-spark
How to resolve error "AttributeError: 'SparkSession' object has no attribute 'serializer'?
user_106595490
•
4
0
2950
pyspark-sql pyspark apache-spark
Storing Python packages in HDFS for Livy PySpark
user_26475810
•
5
0
188
livy pyspark apache-spark python
Spark job failed to write to Alluxio due to DeadlineExceededException
user_31617500
•
2
1
436
alluxio apache-spark
How to escape special characters in Spark SQL query, "`" does not seem to work
user_13684320
•
2
0
6419
apache-spark-sql apache-spark
Hot Questions