pyspark

4047 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Calculate relative frequency of bigrams in PySpark
user_108652100
•
2
1
404
pyspark apache-spark python
How to register UDF (python and scala) when using 'spark-sql' submit?
user_18751070
•
2
1
232
pyspark apache-spark-sql apache-spark user-defined-functions
Casting from timestamp[us, tz=Etc/UTC] to timestamp[ns] would result in out of bounds timestamp
user_70749690
•
5
1
4093
pyspark pandas databricks apache-spark-sql apache-spark
How to rank the column values based on a dictionary and retain the highest value?
user_138138710
•
4
3
218
pyspark apache-spark-sql apache-spark dataframe python
Python unittest mock pyspark chain
user_47893480
•
2
1
553
python-unittest.mock pyspark python-unittest mocking python
Convert date to ISO week date in Spark
user_27535010
•
2
3
890
spark3 pyspark apache-spark-sql apache-spark date
Select rows from a table which contains at-least one alphabet in the column
user_86100800
•
2
1
473
pyspark databricks apache-spark-sql apache-spark sql
Run python_wheel_task using Databricks submit api
user_47872690
•
3
1
507
pyspark azure-databricks databricks apache-spark
How to trim zeros after decimal value without changing the datatype using PySpark?
user_169356120
•
4
1
983
pyspark apache-spark-sql apache-spark trim decimal
Databricks Notebook 8.3 (Apache Spark 3.1.1, Scala 2.12) | pyspark | Parquet write exception | Multiple failures in stage materialization
user_166662070
•
2
2
1041
aws-databricks feature-engineering pyspark databricks apache-spark
Hot Questions