pyspark-dataframes

95 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How the number of partitions is decided by Spark when a file is read?
user_38474210
•
2
1
4238
pyspark-dataframes pyspark apache-spark-sql apache-spark
Fill in missing date values and populate second column based on previous row
user_29917180
•
2
1
447
pyspark-dataframes pandas python
PySpark sql write dataFrame that has a json column to mysql JDBC
user_35354000
•
3
0
717
pyspark-sql pyspark-dataframes pyspark databricks
Remove sub-string from array elements and duplicate pyspark
user_117097320
•
2
2
1127
pyspark-sql pyspark-dataframes pyspark apache-spark
Calculate rolling sum of an array in PySpark using Window()?
user_122716760
•
2
2
1093
pyspark-dataframes pyspark apache-spark-sql apache-spark
How to execute a stored procedure in Azure Databricks PySpark?
user_110703140
•
6
2
17144
pyspark-sql pyspark-dataframes azure-databricks python
Spark aggregations where output columns are functions and rows are columns
user_128751610
•
3
2
776
pyspark-sql pyspark-dataframes pyspark apache-spark python
How to drop columns and not rows using pandas axis equivalent in pyspark?
user_108290440
•
3
2
845
pyspark-sql pyspark-dataframes pyspark python-3.x python
How to identify columns based on datatype and convert them in pyspark?
user_108290440
•
2
1
772
pyspark-sql pyspark-dataframes pyspark python-3.x python
Merge many dataframes into one in Pyspark [non pandas df]
user_56364160
•
2
1
126
pyspark-dataframes pyspark
Hot Questions