pyspark-dataframes

95 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
create new pyspark dataframe columns by splitting values on white space
user_34764630
•
2
2
1772
pyspark-sql pyspark-dataframes pyspark python
Pyspark error passing StructType to Schema
user_110223720
•
3
1
5230
pyspark-sql pyspark-dataframes pyspark
cannot resolve column due to data type mismatch PySpark
user_98555880
•
2
1
14552
pyspark-dataframes pyspark python
How can I resolve the "need struct type but got struct"
user_121251420
•
3
1
5103
pyspark-dataframes pyspark apache-spark scala
Dataframe regexp_extract values from string like array
user_129484980
•
2
2
1595
pyspark-dataframes pyspark apache-spark-sql apache-spark python
Create dataframe with schema provided as JSON file
user_105997400
•
2
2
909
pyspark-dataframes pyspark apache-spark-sql apache-spark
Relationalize json nested array
user_85207790
•
2
1
606
pyspark-dataframes aws-glue pyspark apache-spark-sql apache-spark
Transform column with seconds to human readable duration
user_127558000
•
3
3
1115
pyspark-sql pyspark-dataframes pyspark apache-spark python
pyspark dataframe get second lowest value for each row
user_114844630
•
2
2
1270
pyspark-dataframes pyspark apache-spark-sql apache-spark python
AWS Glue Job creates new column in Redshift if found different datatype for same column in parquet file from S3
user_68501410
•
3
3
1646
aws-glue-data-catalog pyspark-dataframes amazon-redshift aws-glue apache-spark
Hot Questions