apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Label encoding of date and create new attribute based on quarter using pyspark
user_161549130
•
1
1
108
pyspark apache-spark
spark data frame Schema With Data Definitions
user_107337890
•
1
1
299
pyspark azure-databricks databricks apache-spark-sql apache-spark
Error to write dataframe in Cassandra table on Amazon Keyspaces
user_79479870
•
2
2
263
spark-cassandra-connector apache-spark cassandra scala
Pyspark: How to flatten nested arrays by merging values in spark
user_95798210
•
2
2
1255
pyspark apache-spark-sql apache-spark sql python
Spark Structured Streaming - join 2 dataframes based on condition
user_52604310
•
1
0
137
spark-structured-streaming pyspark apache-spark-sql apache-spark
PySpark - Loop in ForEachBatch leads to "SparkContext should only be created and accessed on the driver" Error
user_90362240
•
4
1
973
pyspark apache-spark python-3.x python
Spark unable to perform operations on Ignite RDD: InvalidClassException org.apache.ignite.spark.impl.IgnitePartition; local class incompatible
user_166863610
•
1
2
158
ignite apache-spark scala
Spark create empty delta table on s3
user_60734940
•
3
0
684
delta-lake apache-spark
Delta table update if column exists otherwise add as a new column
user_78122730
•
1
0
605
delta-lake azure-databricks databricks apache-spark scala
how to write a custom decorator in pyspark which will register any python function and execute in pyspark which is being called outside of a class
user_98778820
•
1
0
53
pyspark apache-spark python-decorators scala python
Hot Questions