apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to repartition spark dataframe into smaller partitions
user_71731190
•
1
1
70
pyspark apache-spark-sql apache-spark
Spark/Scala - Join resultset giving type mismatch error while performing withColumn operation; found : org.apache.spark.sql.Column required: Boolean
user_79130390
•
1
1
65
typeerror apache-spark-sql apache-spark dataframe scala
Not able to perform operations on resulting dataframe after "join" operation in PySpark
user_136012660
•
1
1
22
data-profiling pyspark apache-spark-sql dataframe python
How to aggregate on multiple columns using SQL or spark SQL
user_143332800
•
1
1
41
apache-spark-sql apache-spark multiple-columns aggregate sql
Split column with JSON string to columns each containing one key-value pair from the string
user_146818270
•
2
5
277
azure-eventhub pyspark azure-databricks apache-spark-sql apache-spark
How can I close db connection from spark.read?
user_13328700
•
1
2
177
spark-streaming apache-spark-sql apache-spark
Groupby column and create lists for other columns, preserving order
user_164116180
•
3
1
70
pyspark apache-spark-sql apache-spark dataframe python
Parse JSON column then add new column in the same dataframe with parsed value
user_191681380
•
1
1
95
aws-glue pyspark apache-spark-sql apache-spark json
Apache spark : How deep is the comparison of rows in RDD or DF
user_87106800
•
1
1
27
apache-spark-sql apache-spark intersect
Counting number of changes in categorical column in PySpark Dataframe
user_107654550
•
1
2
46
pyspark apache-spark-sql apache-spark dataframe aggregate
Hot Questions