pyspark

4047 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
PySpark: TypeError: StructType can not accept object 0.10000000000000001 in type <type 'numpy.float64'>
user_36569120
•
3
1
11243
pyspark apache-spark-sql apache-spark numpy python
Using a module with udf defined inside freezes pyspark job - explanation?
user_66027290
•
9
1
912
pyspark apache-spark-sql user-defined-functions
How to display a streaming DataFrame (as show fails with AnalysisException)?
user_23611740
•
7
2
16945
spark-structured-streaming pyspark apache-kafka apache-spark
Getting error py4j.protocol.Py4JNetworkError: Answer from Java side is empty in spark streaming
user_37749050
•
6
0
4176
pyspark python-3.x
Implausibly spark dataframe after read ocr files from hdfs
user_35248440
•
7
1
699
hadoop-yarn hdfs pyspark apache-spark hadoop
PySpark: How to fillna values in dataframe for specific columns?
user_41683970
•
66
2
135709
spark-dataframe pyspark apache-spark
Creating Spark dataframe from numpy matrix
user_35853870
•
17
3
19792
apache-spark-mllib pyspark apache-spark-sql apache-spark numpy
Dropping nested column of Dataframe with PySpark
user_57065480
•
9
6
9003
pyspark apache-spark dataframe struct schema
Spark Streaming: "ERROR JobScheduler: Error generating jobs for time" in Python Process
user_23611740
•
4
0
887
spark-streaming pyspark apache-spark python-multiprocessing multiprocessing
PySpark throws ImportError, but Module actually exists and works well
user_82904440
•
3
2
4154
cloudera pyspark-sql fuzzywuzzy pyspark user-defined-functions
Hot Questions