pyspark

4047 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
flattening nested Json in pyspark, where each array type would be a separate data frame
user_138191520
•
2
0
67
nested-json pyspark dataframe arrays json
What is the best way to suppress the spark output in the Jupyter notebook?
user_1682310
•
3
2
540
jupyter-notebook pyspark macos
How does spark read data behind the scenes?
user_107274720
•
2
1
171
pyspark apache-spark amazon-s3
java.lang.NoSuchMethodError: com.google.flatbuffers.FlatBufferBuilder.createString(Ljava/lang/CharSequence;)I
user_19189620
•
2
1
176
spark3 pyspark pandas apache-spark
Spark Session connected to local MongoDB with pyspark
user_169448610
•
4
0
421
pyspark apache-spark mongodb python
Pyspark - counting dates between two dataframes
user_120643560
•
3
2
89
pyspark apache-spark-sql apache-spark python
pyspark match a dic to a big dataframe and calculate each row by using a for- loop
user_50886810
•
1
1
36
pyspark for-loop
PySpark: Using column name in UDF and doing concatenation of column names based on a logic
user_114713650
•
2
2
597
pyspark apache-spark-sql apache-spark dataframe python
Pyspark How to merge and explode 2 data frames
user_55382990
•
2
1
111
pyspark
AWS glue pyspark: java.lang.NoClassDefFoundError: org/jets3t/service/ServiceException
user_44590850
•
1
1
652
aws-glue-spark aws-glue pyspark amazon-s3
Hot Questions