apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to create new Column using withColumn to concentrate two numeric conlumn as String ?
user_52506200
•
2
1
84
apache-spark-sql apache-spark scala
How to escape special characters in Spark SQL query, "`" does not seem to work
user_13684320
•
2
0
6419
apache-spark-sql apache-spark
Spark Dataframe grouping and partition by key with a set number of partitions.
user_90880320
•
2
1
2899
pyspark apache-spark-sql
Spark failing because S3 files are updated. How to eliminate this error?
user_19557200
•
2
2
3679
apache-spark-sql apache-spark amazon-s3
spark date format MMM dd, yyyy hh:mm:ss AM to timestamp in df
user_68670480
•
2
4
12229
apache-spark-sql apache-spark
How can I sum multiple columns in a spark dataframe in pyspark?
user_89477390
•
13
3
32996
pyspark apache-spark-sql apache-spark python
spark does not read all orc files from different folder using merge schema
user_36076980
•
3
1
1379
orc apache-spark-sql apache-spark
Spark - Non-time-based windows are not supported on streaming DataFrames/Datasets;
user_24514460
•
9
1
5780
spark-streaming apache-spark-sql apache-spark java
Update column Dataframe column based on list values
user_95613310
•
3
0
51
pyspark apache-spark-sql apache-spark python-3.x
How can I iterate through a column of a spark dataframe and access the values in it one by one?
user_99990350
•
5
2
6273
pyspark apache-spark-sql
Hot Questions