pyspark

4047 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Include Scala 2.12 in SageMaker Jupyter Notebook
user_186328500
•
1
0
131
amazon-sagemaker pyspark apache-spark scala
trying to use johnsnow pretrained pipeline on spark dataframe but unable to read delta file in the same session
user_186886540
•
1
1
142
delta-lake johnsnowlabs-spark-nlp hdfs pyspark apache-spark-sql
Change the datatype of any fields of Arraytype column in Pyspark
user_126136520
•
4
1
81
pyspark apache-spark arrays
PySpark: Operations with columns given different levels of aggregation and conditions
user_154110760
•
1
1
65
pyspark apache-spark-sql apache-spark
PySpark use percentile_approx to get P95 value is much greater than the max value of same column
user_129136220
•
2
1
374
pyspark apache-spark-sql apache-spark percentile aggregate-functions
Best Pyspark Testing : issue with databricks -connect
user_51082200
•
1
0
100
databricks-connect pyspark databricks apache-spark pytest
Another SparkContext is being constructed Eror
user_186754960
•
2
1
322
pyspark apache-spark python
How to normalize decimal values while iterating over dataframe rows using toLocalIterator
user_35799550
•
1
0
99
fastavro pyspark apache-spark dataframe python
FileNotFoundException when submitting to Kubernetes Spark cluster
user_117909260
•
1
0
152
pyspark apache-spark kubernetes docker python
In a pyspark dataframe, when I rename a column, the previous name can still be used for filtering. Bug or feature?
user_183426480
•
3
1
152
pyspark azure-databricks python
Hot Questions