apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Limit kafka batch size when using Spark Structured Streaming
user_15869650
•
8
2
6183
spark-streaming spark-structured-streaming apache-kafka apache-spark scala
Spark: Is "count" on Grouped Data a Transformation or an Action?
user_37254910
•
14
3
5767
apache-spark scala
PySpark How to parse and get field names from Dataframe schema's StructType Object
user_51386430
•
4
2
9915
pyspark apache-spark-sql apache-spark struct schema
Split PySpark dataframe column at the dot
user_96297710
•
5
3
3250
pyspark apache-spark python-3.x
Spark dataframe requires json file as one object in one line?
user_58907840
•
3
1
4869
apache-spark record corrupt scala json
Split Spark DataFrame into two DataFrames (70% and 30% ) based on id column by preserving order
user_22178660
•
3
1
3528
apache-spark-2.0 pyspark apache-spark
Apache Spark: Relationship between action and job, Spark UI
user_56005340
•
4
1
273
spark-ui apache-spark dataframe
Merging rows into a single struct column in spark scala has efficiency problems, how do we do it better?
user_31865130
•
7
1
200
apache-spark scala
Spark structured streaming shows results too late when in append mode
user_56323320
•
3
1
190
spark-streaming spark-structured-streaming apache-spark
Cannot broadcast the table that is larger than 8GB : Spark 2.3
user_72203860
•
3
0
1926
apache-spark-sql apache-spark
Hot Questions