apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Spark SQL : Why am I seeing 3 jobs instead of one single job in the Spark UI?
user_18430110
•
5
2
369
spark-ui apache-spark-sql apache-spark
Adaptive Query Execution in Spark 3
user_62572820
•
5
1
1006
apache-spark-sql apache-spark shuffle optimization performance
String to Date migration from Spark 2.0 to 3.0 gives Fail to recognize 'EEE MMM dd HH:mm:ss zzz yyyy' pattern in the DateTimeFormatter
user_138213840
•
10
3
31611
pyspark apache-spark-sql apache-spark
How can we pass a variable to where clause in Spark Dataframe
user_138123460
•
2
3
2592
apache-spark-sql apache-spark scala
Spark SQL Java Unable to convert fromTuple to Row and Dataframe
user_10391490
•
4
2
415
apache-spark-sql apache-spark java
Spark dataframe filter issue
user_15127700
•
2
2
69
apache-spark-sql apache-spark dataframe
Error I'm getting when I write Pyspark code to connect with Snowflake
user_77480880
•
5
4
1559
snowflake-cloud-data-platform pyspark apache-spark-sql
How to write a python function as udf which returns a dictionary type
user_14483960
•
4
2
4801
pyspark-dataframes apache-spark-sql apache-spark user-defined-functions python
spark dataframes : reading json having duplicate column names but different datatypes
user_38817820
•
3
3
1628
apache-spark-sql apache-spark jsonschema jackson json
Pyspark - how to check which of the two records has the latest date and its column value?
user_76441680
•
2
1
36
pyspark apache-spark-sql python-3.x python
Hot Questions