apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
PySpark - to_date format from column
user_63339350
•
8
3
46195
pyspark apache-spark-sql apache-spark
Can I tell spark.read.json that my files are gzipped?
user_9092270
•
15
1
14750
pyspark apache-spark
Spark Dataframe - Get all lists of pairs (Scala)
user_92832000
•
4
1
517
apache-spark-sql apache-spark scala
Spark JDBC: DataFrameReader fails to read Oracle table with datatype as ROWID
user_60641310
•
4
1
977
spark-jdbc apache-spark jdbc scala oracle
Spark Structured Streaming MemoryStream + Row + Encoders issue
user_22927910
•
5
1
1979
spark-structured-streaming apache-spark scala
Unable to perform aggregation on 2 values using groupByKey in spark using scala
user_61203190
•
3
3
92
rdd apache-spark scala
How to get application Id/Job Id of job submitted to Spark cluster using Spark-submit command ?
user_10687220
•
4
3
6863
apache-spark
How to check if key exists in Spark SQL map type
user_7138960
•
6
5
8534
apache-spark-sql apache-spark exists key dictionary
GC Logs Overwritten when JVM Crashes
user_13222430
•
6
1
543
g1gc apache-spark garbage-collection java
which is faster spark.sql or df.filter("").select("") . using scala
Admin1
•
3
3
6432
apache-spark-sql apache-spark scala
Hot Questions