apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to convert sql cursor output to spark dataframe in spark?
user_113200610
•
1
1
649
pyspark apache-spark-sql
Pyspark Window function: Counting number of categorical variables and calculating percentages
user_83829500
•
2
2
288
pyspark apache-spark-sql apache-spark
Spark withWatermark, only store values before and after a gap
user_32227820
•
2
0
125
spark-streaming pyspark apache-spark-sql apache-spark
Are there any drawbacks of using left join of smaller table with larger table vs inner join of two tables and right joining smaller table?
user_158395910
•
1
1
98
pyspark apache-spark-sql apache-spark hive
Spark application syncing with Hive metastore - "There is no primary group for UGI spark" error
user_15812660
•
1
1
337
hive-metastore apache-spark-sql apache-spark kubernetes hive
Apache Spark 2.3.0 - How to merge two array<string> into one array<string>
user_59395990
•
1
1
279
spark-java apache-spark-sql apache-spark
How persist(StorageLevel.MEMORY_AND_DISK) works in Spark 3.1 with Java implementation
user_152605210
•
1
0
79
hadoop-yarn google-cloud-dataproc apache-spark-sql apache-spark hadoop
Spark Dataframe with pivot and different aggregation, based on the column value (measure_type) - Scala
user_37539500
•
1
2
325
apache-spark-sql apache-spark aggregation scala
How to set row batch size for incrementalCollect in Apache Spark Thrift server?
user_169660810
•
3
0
94
spark-thriftserver apache-spark-sql apache-spark thrift
Get days difference between two datetimes in SparkSQL
user_78859030
•
1
1
169
apache-spark-sql datediff date datetime
Hot Questions