apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Spark HBase/BigTable - Wide/sparse dataframe persistence
user_145245880
•
2
1
258
google-cloud-bigtable google-cloud-dataproc apache-spark sparse-matrix hbase
Stream from kafka to kafka with Spark Structured Streaming in scala
user_145248760
•
2
0
82
spark-streaming apache-spark scala
calculation between two date in YYYYMM format in Pyspark or python
user_62478640
•
3
2
566
pyspark apache-spark-sql apache-spark python
Tablename with spaces at JDBC connection gives error
user_121768770
•
2
1
492
aws-glue pyspark apache-spark jdbc
How to resolve "SecurityManager: authentication disabled; exception in spark distribution cluster"?
user_90465960
•
5
0
2408
hadoop2 apache-spark java
Best approach to transform Dataset[Row] to RDD[Array[String]] in Spark-Scala?
user_131498060
•
3
3
518
apache-spark-dataset rdd apache-spark-sql apache-spark scala
Running Spark on Kubernetes with Dynamic Allocation
user_26226580
•
4
2
2273
apache-spark kubernetes
Structured streaming continuous trigger fails on Spark 3, but works on Spark 2.4 - a bug?
user_149621350
•
3
0
573
continuous amazon-kinesis spark-structured-streaming apache-spark scala
convert pyspark dataframe into nested json structure
user_79931380
•
2
1
943
pyspark apache-spark-sql apache-spark json
Can we use flatMapGroupsWithState in batch mode?
user_43393170
•
2
1
247
apache-spark
Hot Questions