pyspark

4047 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to import Scala case objects from jvm?
user_108417480
•
2
0
91
py4j pyspark scala python
How can I resolve the "need struct type but got struct"
user_121251420
•
3
1
5103
pyspark-dataframes pyspark apache-spark scala
Join tables in PySpark on condition: if point is within a polygon
user_100257670
•
7
0
2197
pyspark geo gis geospatial
Dataframe regexp_extract values from string like array
user_129484980
•
2
2
1595
pyspark-dataframes pyspark apache-spark-sql apache-spark python
Spark dropduplicates but choose column with null
user_42714910
•
2
2
880
pyspark apache-spark-sql
Create dataframe with schema provided as JSON file
user_105997400
•
2
2
909
pyspark-dataframes pyspark apache-spark-sql apache-spark
DATABRICKS SparkException: Exception thrown in awaitResult - CAN'T DISPLAY DATAFRAME
user_130132840
•
3
0
1120
pyspark
SparkFiles.get() is not able to fetch file uploaded using --files option of spark-submit
user_89958800
•
3
0
572
pyspark apache-spark-sql apache-spark
Relationalize json nested array
user_85207790
•
2
1
606
pyspark-dataframes aws-glue pyspark apache-spark-sql apache-spark
How can I distribute my task to all worker nodes in gcp? I am using pyspark
user_31936650
•
3
1
245
google-cloud-dataproc pyspark apache-spark google-cloud-platform python
Hot Questions