pyspark

4047 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Custom sorting in pyspark dataframes
user_1675410
•
5
1
2138
pyspark pandas apache-spark-sql apache-spark python
Cannot save model using PySpark xgboost4j
user_42284350
•
4
1
1106
xgboost pyspark python
Azure Databricks to Azure SQL DW: Long text columns
user_10852910
•
5
1
2530
azure-sql-data-warehouse azure-sqldw azure-synapse pyspark azure-databricks
While trying to use SCALA UDF in PySpark, despite providing the --jars : ERROR : pyspark.sql.utils.AnalysisException: u'Can not load class
user_129005000
•
2
0
669
pyspark apache-spark user-defined-functions scala
how to write.stream in append mode
user_130038640
•
2
1
307
spark-streaming pyspark apache-spark python
azure data bricks: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml
user_115316570
•
2
1
7181
pyspark azure-databricks azure
Transform column with seconds to human readable duration
user_127558000
•
3
3
1115
pyspark-sql pyspark-dataframes pyspark apache-spark python
Replace elements in an array with its corresponding number in pyspark
user_44524990
•
2
4
2940
pyspark apache-spark-sql apache-spark python-3.x
AWS Glue Job error: An error occurred while calling o82.parquet. Not Found
user_16788300
•
3
0
1660
aws-glue-data-catalog parquet aws-glue pyspark amazon-s3
pyspark dataframe get second lowest value for each row
user_114844630
•
2
2
1270
pyspark-dataframes pyspark apache-spark-sql apache-spark python
Hot Questions