apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Hive Increase in bucket count- how the existing data split occurs to new buckets?
user_141534790
•
2
1
33
hiveql hdfs apache-spark hive hadoop
How to enforce a specific partitioning and sort order automatically with a UDAF in Spark?
user_101094880
•
1
0
26
apache-spark-sql apache-spark partitioning user-defined-functions
Filtering a spark dataset
user_7773770
•
2
1
24
apache-spark-dataset apache-spark scala
Max values for each key RDD
Admin1
•
1
2
52
rdd pyspark apache-spark max key
pyspark : TypeError: element in array element in array element in array field prediction: ArrayType(FloatType,true) can not accept object
user_104970970
•
1
0
46
pyspark pandas apache-spark-sql apache-spark
Save dataframe to a schema/database.table (in HBase) using Phoenix (by Scala)
user_139839940
•
1
0
34
phoenix apache-spark scala schema
In Pyspark how to generate serial number on multiple CSV files maintaining order
user_40473410
•
1
1
47
aws-glue pyspark apache-spark python
How to rename GCS files in Spark running on Dataproc Serverless?
user_195821450
•
2
1
99
google-cloud-dataproc-serverless google-cloud-dataproc apache-spark hadoop
Bucketize the pyspark dataframe rows into window duration of variable length based on values in a column
user_35410780
•
2
1
48
pyspark apache-spark-sql apache-spark sql
Spark Explode between 2 Dates
user_35126780
•
2
1
34
apache-spark-sql apache-spark
Hot Questions