pyspark

4047 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Error while instantiating 'org.apache.spark.sql.hive.HiveExternalCatalog'
user_47510330
•
3
1
695
pyspark hive
AWS EMR pyspark notebook fails with `Failed to run command /usr/bin/virtualenv (...)`
user_20616510
•
2
2
1606
amazon-emr jupyter-notebook pyspark apache-spark amazon-web-services
import error for awsglue.context import GlueContext
user_22177840
•
6
0
1343
aws-glue pyspark python
Using a map for tuple in pyspark
user_57745030
•
2
1
343
pyspark python
Issue Streaming Delta Table in Databricks
user_101887930
•
3
0
323
delta-lake spark-structured-streaming pyspark databricks apache-spark
IllegalArgumentException: Column must be of type struct<type:tinyint,size:int,indices:array<int>,values:array<double>> but was actually double.'
user_73904450
•
9
2
15495
apache-spark-ml pyspark apache-spark
How to use Structured Spark Streaming in pySpark to insert row into Mongodb?
user_126689650
•
2
0
510
pyspark-sql spark-structured-streaming pyspark-dataframes pyspark mongodb
Spark job for Union of pyspark-dataframes not ending
user_131616560
•
2
0
103
pyspark-dataframes pyspark apache-spark-sql apache-spark python
How to convert RDD list of lists into one list in pyspark
user_132338390
•
2
1
919
pyspark apache-spark list
Equivalent of pandas apply in pyspark?
user_96297710
•
2
1
3731
pyspark apache-spark
Hot Questions