apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Filtering dataframe spark scala for dates greater than current time
user_50659520
•
2
1
1024
apache-spark-sql apache-spark dataframe hadoop scala
dynamic partition pruning not clear
user_13618150
•
3
2
943
apache-spark-sql apache-spark
Scala spark, input dataframe, return columns where all values equal to 1
user_122226940
•
2
3
959
apache-spark-sql apache-spark dataframe filter scala
Spark: how is a window-based processing splitted to executors?
user_19434320
•
4
1
377
bigdata apache-spark-sql apache-spark
Get all record from nth bucket in Hive sql
user_96224350
•
3
3
343
bigdata apache-spark-sql apache-spark bucket hive
Receive streaming data from dataset with custom receiver [Spark Streaming]
user_60684400
•
2
1
149
apache-spark-dataset spark-streaming apache-spark-sql apache-spark java
Is Spark read csv a lazy operation or eager?
user_31167860
•
4
1
1540
pyspark apache-spark-sql apache-spark
Case sensitive column drop operation for pyspark dataframe?
user_82367330
•
2
1
1014
pyspark apache-spark-sql
pyspark: Return columns where all the cells match regex
user_121945840
•
2
1
1018
pyspark-sql pyspark-dataframes pyspark apache-spark-sql apache-spark
DataFrameReader throwing "Unsupported type NULL" while reading avro file
user_118070870
•
2
1
801
spark-avro google-cloud-dataproc apache-spark-sql apache-spark
Hot Questions