apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Spark Stateful Structured Streaming: State getting too big in mapGroupsWithState
user_42180940
•
4
1
758
spark-streaming spark-structured-streaming apache-spark aggregate
PySpark regex join
user_25723410
•
2
1
161
pyspark apache-spark python regex
PySpark to_json loses column name of struct inside array
user_108643260
•
3
2
515
pyspark apache-spark-sql apache-spark dataframe python
Apply java funciton URLDecoder.decode to whole column in Spark 3
user_11950010
•
3
2
1056
apache-spark scala java
PySpark performance DataFrame/Vectors vs Numpy Array
user_88812710
•
2
1
378
pyspark-dataframes pyspark apache-spark-sql apache-spark numpy-ndarray
How to add Extra column with current date in Spark dataframe
user_139070610
•
2
3
15474
pyspark apache-spark-sql apache-spark dataframe
Can Spark be used for real-time interactive application?
user_7475170
•
3
1
142
apache-spark analytics
check if a file is an ORC file
user_89538340
•
3
2
603
orc parquet apache-spark scala
Generate database schema diagram for Databricks
user_26705710
•
2
1
1520
databricks apache-spark database-schema diagram
How to sort only one column within a spark dataframe using pyspark?
user_142205740
•
4
2
690
pyspark apache-spark python
Hot Questions