apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
spark creating and reading from table fails because of metastore version mismatch
user_183982540
•
1
0
26
apache-spark-sql apache-spark sql
Extract value from complex array of map type to string
user_88326410
•
2
2
262
pyspark apache-spark-sql apache-spark dictionary arrays
What would be a Pyspark equivalent of the SQL statement NOT IN
user_117626920
•
1
1
50
pyspark apache-spark-sql
Spark Column Pruning: How to prevent empty schema on count()?
user_14740730
•
2
0
47
apache-spark-sql apache-spark scala
trying to use johnsnow pretrained pipeline on spark dataframe but unable to read delta file in the same session
user_186886540
•
1
1
142
delta-lake johnsnowlabs-spark-nlp hdfs pyspark apache-spark-sql
PySpark: Operations with columns given different levels of aggregation and conditions
user_154110760
•
1
1
65
pyspark apache-spark-sql apache-spark
PySpark use percentile_approx to get P95 value is much greater than the max value of same column
user_129136220
•
2
1
374
pyspark apache-spark-sql apache-spark percentile aggregate-functions
Spark: Select specific Index of value of type Any
user_148043390
•
1
1
140
apache-spark-sql apache-spark dataframe scala
How to ignore the columns if it is not present in a dataframe using spark-SQL?
user_184631600
•
2
1
387
apache-spark-sql apache-spark dataframe
How to remove double quotes in csv generated after pyspark conversion
user_186515500
•
1
1
514
pyspark apache-spark-sql export-to-csv
Hot Questions