pyspark

4047 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Is there a way to force spark workers to use a distributed numpy version instead of the one installed on them?
user_49089000
•
3
1
1077
pyspark pyarrow pandas apache-spark
Is there a way to submit spark job on different server running master
user_45279880
•
9
1
14964
airflow pyspark apache-spark
Adding a new column in the first ordinal position in a pyspark dataframe
user_74053580
•
6
4
11867
pyspark apache-spark-sql apache-spark python
py4j.protocol.Py4JJavaError with PySpark
user_71271230
•
2
0
897
pyspark python-3.x
How to resolve error "AttributeError: 'SparkSession' object has no attribute 'serializer'?
user_106595490
•
4
0
2950
pyspark-sql pyspark apache-spark
Storing Python packages in HDFS for Livy PySpark
user_26475810
•
5
0
188
livy pyspark apache-spark python
Bag of words with pySpark reduceByKey
user_106577740
•
4
1
1604
rdd pyspark reduce
Spark Dataframe grouping and partition by key with a set number of partitions.
user_90880320
•
2
1
2899
pyspark apache-spark-sql
Transferring unroll memory to storage memory failed
user_89012920
•
6
1
2681
pyspark apache-spark
Undefined variable in lambda function
user_50137520
•
3
1
1159
pyspark pylint python
Hot Questions