apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Pyspark's write stringtype argument doesn't deal with null values
user_42156270
•
3
1
360
pyspark apache-spark-sql apache-spark uuid postgresql
Select a column based on another column's value in Spark Dataframe using Scala
user_174325800
•
2
1
846
apache-spark-sql apache-spark dataframe scala
Databricks SSL connection issue connecting to confluent schema registry
user_46422010
•
1
0
618
spark-structured-streaming confluent-schema-registry azure-databricks apache-spark ssl
create median and average column out of array column in pyspark
user_58682930
•
1
1
287
pyspark apache-spark-sql apache-spark dataframe python-3.x
Local Delta Lake instance with advanced features
user_15455720
•
4
1
149
delta-lake apache-spark
Writing Structured Streaming to Partitioned Hive table
user_80896350
•
2
0
164
spark-structured-streaming apache-spark hive
What is the best practice to fit time-series based dataframe to predict multiple columns in PySpark?
user_104527000
•
1
0
219
pyspark apache-spark time-series regression
Spark Structured Streaming: StructField(..., ..., False) always returns `nullable=true` instead of `nullable=false`
user_117128160
•
2
2
251
spark-structured-streaming apache-kafka apache-spark-sql apache-spark scala
How to handle Circular reference in Spark using Java
user_104691940
•
1
0
53
apache-spark-sql apache-spark
How to filter a cassandra table on a list of partition keys (Spark vs Spark-Cassandra-Connector)
user_94670890
•
2
0
103
spark-cassandra-connector apache-spark filter cassandra java
Hot Questions