apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to parse JsonArray in Scala and writing them in a DataFrame?
user_98226290
•
2
1
178
apache-spark-sql apache-spark scala json
Converting CSV to JSON using pyspark with filter and additional columns
user_109511100
•
2
1
101
pyspark-dataframes pyspark apache-spark-sql join json
GROUP BY with overlapping rows in PySpark SQL
user_49187650
•
2
1
235
pyspark apache-spark-sql sql
Applying Bucketizer to Spark dataframe after partitioning based on a column value
user_32846840
•
2
1
712
apache-spark-ml apache-spark-sql apache-spark scala
Spark Unnesting Nested Schema from DynamoDB Json
user_28433310
•
2
2
257
apache-spark-sql apache-spark
parsing XML columns from PySpark Dataframe using UDF
user_146773090
•
5
2
6590
pyspark apache-spark-sql user-defined-functions xml
How to properly read dynamodb json data (dynamodb exported data from s3) in spark where json files may have different size of data
user_35437070
•
2
0
197
pyspark apache-spark-sql
Filter, map problem in DataSets using Spark and Jupyter Notebook
user_93465570
•
2
1
257
apache-spark-dataset jupyter-notebook apache-spark-sql apache-spark
How to get query execution plans from spark history server using rest APIs?
user_142790520
•
2
0
188
apache-spark-sql apache-spark
Scala/Spark Apriori implementation extremely slow
user_87370160
•
4
1
298
apache-spark-sql apache-spark scala
Hot Questions