apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Best way to automate AWS EMR Creation,termination and pyspark jobs
user_178674130
•
1
1
247
amazon-emr airflow pyspark apache-spark-sql amazon-web-services
Calculate previous year end date from current date
user_39572970
•
1
1
549
pyspark apache-spark-sql
Replace comma only if the followed by integer in pyspark column
user_110581850
•
1
1
81
pyspark apache-spark-sql apache-spark dataframe
Pyspark use sql.transform to nullify all empty strings in a column containing an array of structs
user_74758790
•
3
2
281
pyspark apache-spark-sql apache-spark dataframe python
Any workaround for JSONPATH wildcard not supported in Spark SQL
user_182310420
•
2
1
100
apache-spark-sql apache-spark scala
Profiling the Spark Analyzer: how to access the QueryPlanningTracker for a pyspark query?
user_182171900
•
2
1
248
pyspark apache-spark-sql apache-spark profiling
How to call aes_encrypt (and other Spark SQL functions) in a pyspark DataFrame context
user_98783230
•
2
1
360
pyspark databricks apache-spark-sql apache-spark python
Why is my hdfs capacity not remainng constant?
user_80896950
•
2
1
67
dataproc google-cloud-dataproc apache-spark-sql apache-spark hadoop
How to agg a pyspark dataframe and show the intersection of the lists in a column?
user_181830250
•
1
1
147
pyspark apache-spark-sql apache-spark dataframe
How to transform a column with an array of json to separate columns based on the json keys in Spark?
user_181806240
•
2
1
39
pyspark apache-spark-sql apache-spark dataframe
Hot Questions