apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Pyspark create new column based on other column with multiple condition with list or set
user_24450250
•
3
2
3217
pyspark apache-spark-sql python
What problems can arise from a Spark non-deterministic Pandas UDF
user_18154860
•
8
1
3775
pyspark pandas apache-spark-sql apache-spark python
Why does Spark NOT create partitions based on Parquet block size on read? (Instead it appears to partition by Parquet file compressed size)
user_42120300
•
2
1
1681
parquet apache-spark-sql apache-spark hadoop
Job 65 cancelled because SparkContext was shut down
user_111172550
•
6
1
4362
apache-zeppelin pyspark apache-spark-sql apache-spark hadoop
AnalysisException: u'Cannot resolve column name
user_129669510
•
3
1
1194
pyspark apache-spark-sql apache-spark
Pyspark splitting session based on particular start and end events
user_135505210
•
2
1
217
pyspark apache-spark-sql python
Error when trying to specify schema for loading a CSV using pyspark
user_73982590
•
2
1
233
pyspark-dataframes pyspark apache-spark-sql
Convert a multi-label column to multiple columns in pyspark?
user_73982590
•
2
1
383
pyspark-dataframes pyspark apache-spark-sql python
Spark row encoder: empty metadata
user_37371630
•
3
1
250
apache-spark-sql apache-spark
How to use pivot in SQL (not as DataFrame grouping operator)?
user_31900180
•
4
1
553
apache-spark-sql apache-spark scala sql
Hot Questions