apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
I don't understand why there isn't any save or append data operation at the last stage
user_120788260
•
2
1
91
spark-structured-streaming spark-cassandra-connector apache-spark-sql apache-spark cassandra
PySpark: Read nested JSON from a String Type Column and create columns
user_31237800
•
4
1
5795
pyspark apache-spark dataframe python json
Use Apache Spark efficiently to push data to elasticsearch
user_11071290
•
4
2
1602
elasticsearch apache-spark-sql apache-spark scala
Creating Spark Session throws exception traceback
user_138365450
•
3
1
1432
jupyter-notebook pyspark apache-spark-sql apache-spark python
Using external parquet tables in a DBT pipeline
user_32362150
•
3
2
2887
dbt parquet apache-spark hive
Hive queries failing with "Unable to fetch table test_table. Invalid method name: 'get_table_req'" with pyspark 3.0.0 & Hive 1.1.0
user_88957320
•
2
2
5019
cloudera pyspark apache-spark hive hadoop
Spark on Kubernetes: Executor pods silently get killed
user_14740730
•
3
2
2178
apache-spark kubernetes
Importing multiple py files in pyspark
user_88326410
•
2
1
1064
hdfs apache-spark python
PySpark: How to process multi columns of a dataframe in parallel by multiprocessing?
user_92767080
•
2
0
222
pyspark apache-spark multiprocessing python
Spark Streaming Dataset Cassandra Connection UnsupportedOperationChecker
user_130908090
•
2
1
193
spark-structured-streaming spark-cassandra-connector apache-spark cassandra
Hot Questions