apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Delta table as a stream source. How to calculate consumer lag
user_54839000
•
2
0
162
spark-structured-streaming apache-kafka apache-spark
Spark incorrectly interpret partition name ending with 'd' or 'f' as number when reading partitioned parquets
user_8258600
•
4
1
232
pyspark apache-spark-sql apache-spark
Spark: What exactly does a task contain?
user_100151680
•
2
0
19
apache-spark-sql apache-spark
Update global variables by using map reduce
user_128424050
•
2
1
240
pyspark apache-spark mapreduce python
What practical use is dropDuplicates in pyspark?
user_3538200
•
4
0
415
pyspark apache-spark
Applying map function on dataframe's columns
user_74119580
•
3
2
134
pyspark apache-spark dataframe python
Flatten Nested JSON using PySpark
user_78700020
•
5
0
1573
pyspark apache-spark-sql apache-spark json
pyspark - Error while loading .csv file from url to Spark
user_133658090
•
3
1
1872
py4j pyspark apache-spark python
Hive query from pyspark
user_71017080
•
2
0
85
pyspark apache-spark hive hadoop
Spark Streaming Convert Dataset<Row> to Dataset<CustomObject> in java
user_40899000
•
2
2
2016
spark-structured-streaming spark-cassandra-connector apache-kafka apache-spark cassandra
Hot Questions