pyspark

4047 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
corrupt record while reading xml file using pyspark
user_79057040
•
1
1
50
apache-spark-xml pyspark apache-spark dataframe
Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources error
user_135590090
•
1
1
92
spark-submit spark-streaming pyspark apache-spark
Unable to retrieve an item from a tuple/struct type value in pandas dataframe
user_195242650
•
1
2
40
pyspark pandas dataframe python
pyspark round function throws "Invalid argument, not a string or column" error
user_178649560
•
2
1
89
pyspark
Airflow DataprocSubmitJobOperator - ValueError: Protocol message Job has no "python_file_uris" field
user_68431030
•
1
1
96
airflow-2.x google-cloud-dataproc pyspark apache-spark google-cloud-platform
Is the number of partitions of a parquet file in ADLS same as number of partitions after reading it as dataframe?
user_107955960
•
1
1
65
pyspark databricks apache-spark
Creating a schema data health expectation in Palantir Foundry Code Repositories
user_86543630
•
1
1
86
pyspark palantir-foundry
closing pydeequ callback server
user_98555880
•
1
1
41
pydeequ amazon-deequ pyspark apache-spark
Unittest (PyTest) function used in mapPartitions() in PySpark
user_50292950
•
1
0
54
moto amazon-dynamodb pyspark pytest
Understanding pyspark apply on groupby
user_124161640
•
2
2
141
pyspark python
Hot Questions