pyspark

4047 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Can I aggregate map data as array at pyspark?
user_151746400
•
3
2
159
pyspark-dataframes pyspark apache-spark-sql apache-spark python
spark version 3.0.1 run enableHiveSupport will rasie pyspark.sql.utils.IllegalArgumentException
user_141868990
•
4
0
407
pyspark apache-spark hive
How to create a Pyspark Dataframe of combinations from list column
user_137770190
•
2
1
1723
pyspark-dataframes pyspark apache-spark-sql apache-spark python
Spark: How to parse JSON string of nested lists to spark data frame?
user_95798210
•
2
2
1382
pyspark apache-spark-sql apache-spark python
Pyspark - generate a dates column having all the days between two given dates and add it to an existing dataframe
user_59043420
•
2
1
1396
pyspark apache-spark-sql apache-spark python
delta lake - Insert into sql in pyspark is failing with java.lang.NoSuchMethodError: org.apache.spark.sql.catalyst.expressions.Alias
user_151705200
•
5
1
3771
delta-lake google-cloud-dataproc pyspark databricks apache-spark
Creating PySpark UDFs from python method with numpy array input, to calculate and return a single float value
user_151689300
•
2
1
839
pyspark-dataframes pyspark apache-spark-sql user-defined-functions numpy
Is crawler required for creating an AWS glue job?
user_105819440
•
3
1
1158
aws-lake-formation aws-glue pyspark boto3 amazon-web-services
Pyspark remove local/hdfs file/folder
user_111513940
•
2
1
666
pyspark
PySpark pyspark.sql.DataFrameReader.jdbc() doesn't accept datetime type upperbound argument as document says
user_11095470
•
2
1
1302
spark-jdbc pyspark apache-spark-sql apache-spark
Hot Questions