apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to fill none values with a concrete timestamp in DataFrame?
user_68608510
•
6
1
4429
pyspark apache-spark-sql apache-spark
PySpark: modify column values when another column value satisfies a condition
user_70180700
•
30
2
69870
pyspark apache-spark-sql apache-spark
Does spark.sql.autoBroadcastJoinThreshold work for joins using Dataset's join operator?
user_68067630
•
24
3
67283
apache-spark-sql apache-spark
Pyspark: Replacing value in a column by searching a dictionary
user_70180700
•
19
6
30878
pyspark apache-spark-sql apache-spark dataframe python
How to split pipe-separated column into multiple rows?
user_71757080
•
15
2
19670
apache-spark-sql apache-spark
Read data from Hadoop HDFS with SparkSQL connector to visualize it in Superset?
user_80073550
•
4
1
1070
hdfs apache-spark-sql apache-spark hive hadoop
Why dataset.count() is faster than rdd.count()?
user_36206330
•
8
1
8504
apache-spark-dataset apache-spark-sql apache-spark scala performance
How to cache partitioned dataset and use in multiple queries?
user_71633320
•
5
2
1609
apache-spark-sql apache-spark java
How to get the number of records written (using DataFrameWriter's save operation)?
Lokkju_173240
•
7
2
4179
apache-spark-sql apache-spark scala
Why Spark SQL translates String "null" to Object null for Float/Double types?
user_36206330
•
3
3
2749
spark-dataframe apache-spark-sql apache-spark scala
Hot Questions