apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to split a number and add hyphen in a pyspark dataframe?
user_151532790
•
2
2
921
pyspark apache-spark-sql apache-spark dataframe split
Filter pyspark dataframe based on list of strings
user_23200990
•
2
3
1719
pyspark apache-spark-sql apache-spark dataframe python
How to find the mean value of a array column and then subtract the mean from each element in a pyspark dataframe?
user_52293380
•
2
1
341
pyspark-dataframes pyspark apache-spark-sql apache-spark python
pyspark dataframes: Why can I select some nested fields but not others?
user_151488260
•
2
2
66
pyspark-dataframes pyspark apache-spark-sql apache-spark python-3.x
Format string to datetime using Spark SQL
user_116558620
•
3
1
2863
sql-date-functions apache-spark-sql apache-spark sql
Spark DeltaLake Upsert (merge) is throwing "org.apache.spark.sql.AnalysisException"
user_41348000
•
2
1
938
delta-lake apache-spark-sql apache-spark scala
How to perform parallel computation on Spark Dataframe by row?
user_4278870
•
2
1
1282
parquet pyspark pyarrow apache-spark-sql python-3.x
How to identify discrete states (oscillations) in Spark Dataframe?
user_61053850
•
3
1
201
pyspark apache-spark-sql apache-spark sequence
Is there a way to know what was the last partition written in S3 table to use for a push down predicate in AWS Glue Job?
user_93156300
•
2
1
647
aws-glue-data-catalog aws-glue-spark aws-glue boto3 apache-spark-sql
Are built-in Spark transformations faster than Spark SQL queries?
user_123347200
•
2
1
1276
aws-glue pyspark apache-spark-sql apache-spark
Hot Questions