apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Apache Spark 2.2: broadcast join not working when you already cache the dataframe which you want to broadcast
user_108070100
•
6
1
2134
apache-spark-dataset apache-spark-2.0 apache-spark-sql apache-spark
How to create managed hive table with specified location through Spark SQL?
user_20159480
•
4
3
5290
apache-spark-sql apache-spark hive amazon-s3
how to get first value and last value from dataframe column in pyspark?
user_47466840
•
4
3
22636
pyspark apache-spark-sql apache-spark
How do I upsert into HDFS with spark?
user_106818280
•
8
1
3444
bigdata hdfs apache-spark-sql apache-spark
Spark using recursive case class
user_13567130
•
5
1
660
apache-spark-dataset apache-spark-sql apache-spark scala
How do I explode a dataset with flatmap?
user_77798960
•
2
1
2745
flatmap apache-spark-sql apache-spark scala
Working with Microsecond Time Stamps in PySpark
user_9552370
•
4
2
4023
pyspark apache-spark-sql apache-spark scala python
Optimizing partitioned data writes to S3 in spark sql
user_27592650
•
2
1
910
apache-spark-sql apache-spark amazon-s3 scala
Spark groupBy vs repartition plus mapPartitions
user_27615090
•
3
1
2342
apache-spark-dataset apache-spark-sql apache-spark
How do I update only specific partitions in spark?
user_106818280
•
4
0
1601
apache-spark-sql apache-spark hadoop
Hot Questions