apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Why does Spark infer a binary instead of an Array[Byte] when creating a DataFrame?
user_55225570
•
4
1
5656
apache-spark-sql apache-spark user-defined-functions binary scala
How to explode get_json_object in Apache Spark
user_2500850
•
5
2
13335
apache-spark-sql apache-spark explode arrays json
How to add multidimensional array to an existing Spark DataFrame
user_41167330
•
3
1
2410
apache-spark-dataset apache-spark-sql apache-spark
Spark read multiple CSV files, one partition for each file
user_37543140
•
4
1
1715
apache-spark-sql apache-spark csv
Spark Warehouse VS Hive Warehouse
user_77390870
•
3
2
3265
hortonworks-data-platform apache-spark-sql apache-spark hive
Pyspark - Split large text file into multiple files
user_105727940
•
3
1
3628
amazon-emr pyspark apache-spark-sql python-3.x
Partitioning a large skewed dataset in S3 with Spark's partitionBy method
user_11251590
•
22
3
7429
apache-spark-sql apache-spark partitioning
Using Spark 2.3.1 with Scala, Reduce Arbitrary List of Date Ranges into distinct non-overlapping ranges of dates
user_32640540
•
5
5
1207
apache-spark-sql apache-spark user-defined-functions scala
Apache Spark 2.3.1 with Hive metastore 3.1.0
user_84423660
•
6
2
5893
hive-metastore hdp apache-spark-sql apache-spark hive
Spark DataFrame RangePartitioner
user_28326550
•
3
1
1791
apache-spark-dataset apache-spark-sql apache-spark
Hot Questions