apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to calculate moving median in DataFrame?
user_54692180
•
3
3
1350
spark-window-function apache-spark-sql apache-spark median window-functions
How does Spark SQL decide the number of partitions it will use when loading data from a Hive table?
user_1475300
•
17
1
10329
apache-spark-sql
How to interpret probability column in spark logistic regression prediction?
user_12156870
•
5
1
4735
apache-spark-ml logistic-regression apache-spark-sql apache-spark machine-learning
What happens if SparkSession is not closed?
user_8072310
•
22
2
35529
apache-spark-sql apache-spark scala
PySpark: Absolute value of a column. TypeError: a float is required
user_70180700
•
13
1
33220
pyspark apache-spark-sql apache-spark python
How to get length of complex datatype column in hive
user_19708320
•
3
1
13586
apache-spark-sql hive hadoop
Memory allocation issue in writing Spark DataFrame to Hive table
user_44038720
•
4
1
2638
pyspark apache-spark-sql apache-spark hive python
spark cluster performance decreases by adding more nodes
user_38043600
•
3
1
954
apache-zeppelin spark-cassandra-connector apache-spark-sql apache-spark cassandra
How to calculate date difference in pyspark?
user_71597810
•
32
2
84252
pyspark apache-spark-sql apache-spark dataframe python
How does createOrReplaceTempView work in Spark?
user_76187520
•
84
3
209614
apache-spark-sql apache-spark
Hot Questions