pyspark-sql

87 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
What is the purpose of the alias method in PySpark?
user_85767140
•
3
1
4756
pyspark-sql pyspark python
Filter PySpark DataFrame by checking if string appears in column
user_85767140
•
6
2
15910
pyspark-sql pyspark python
How to set spark.sql.pivotMaxValues in python?
user_86025740
•
5
0
3532
pyspark-sql pyspark apache-spark-sql apache-spark
AttributeError: 'StructField' object has no attribute '_get_object_id': with loading parquet file with custom schema
user_83267500
•
4
1
7781
pyspark-sql pyspark apache-spark-sql apache-spark
Pyspark groupby then sort within group
user_69103540
•
6
2
2209
pyspark-sql pyspark group-by
Limit number of connection to MySQL database using JDBC driver in spark
user_84415410
•
3
2
1854
pyspark-sql pyspark apache-spark jdbc mysql
How to add sparse vectors after group by, using Spark SQL?
user_78675170
•
6
1
1142
pyspark-sql apache-spark-sql apache-spark machine-learning python
How to create a PySpark dataframe from two lists?
user_80279950
•
3
2
3587
pyspark-sql pyspark apache-spark-sql apache-spark
pySpark/Python iterate through dataframe columns, check for a condition and populate another colum
user_83839300
•
4
2
7760
pyspark-sql pyspark apache-spark python
Unresolved reference while trying to import col from pyspark.sql.functions in python 3.5
user_53041180
•
8
4
8545
pyspark-sql spark-structured-streaming pyspark apache-spark python
Hot Questions