pyspark

4047 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Understanding --archive in dataproc pyspark
user_80896950
•
2
1
281
dataproc google-cloud-dataproc pyspark apache-spark
Spark submit fails: No such file or directory: '/opt/spark/python/pyspark/./bin/spark-submit'
user_179759140
•
2
0
214
pyspark apache-spark
Pyspark variable has datatype decimal(6,-12). df.dtypes and df.columns gives error ValueError: Could not parse datatype: decimal(6,-12)
user_179752680
•
2
1
233
pyspark apache-spark dataframe python
Issues running PySpark UDF with Databricks Connect
user_63277710
•
2
0
180
databricks-connect pyspark distributed-computing user-defined-functions python
Split Pyspark dataframe into multiple json files based on a particular column data?
user_179638650
•
2
1
263
pyspark apache-spark dataframe python json
PySpark virtual environment archive on S3
user_46019310
•
3
0
312
livy amazon-emr pyspark apache-spark
Pyspark Py4JJavaError while creating the delta-table
user_32605690
•
3
2
501
jupyter-notebook pyspark apache-spark delta python
best way to perform one-hot encoding and explode column with prefix pyspark
user_109702020
•
2
1
277
pyspark pandas apache-spark python
Parsing XML processing instructions in PySpark
user_179121460
•
1
0
45
apache-spark-xml pyspark databricks
I want to create the list from the datasest and use in another function in palantir foundry but not able to find any solution
user_179524700
•
1
1
90
pyspark palantir-foundry transformation sql python
Hot Questions