apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
ETL process to transfer data from one Db to another using Apache Spark
user_5450860
•
2
1
1067
apache-spark amazon-web-services amazon-ec2 hadoop java
Using Spark Structured Streaming with Trigger.Once
user_11251590
•
12
2
10246
spark-structured-streaming apache-spark scala
What is the difference between spark.sql.shuffle.partitions and spark.default.parallelism?
user_81028800
•
108
3
158484
apache-spark-sql apache-spark hadoop performance
Apache Livy: query Spark SQL via REST: possible?
user_27938580
•
3
2
5057
apache-spark
When running with master 'yarn' either HADOOP_CONF_DIR or YARN_CONF_DIR must be set in the environment
user_10723370
•
7
2
25936
apache-spark hadoop
Spark ML and Scala Play model serving
user_49707410
•
2
0
392
apache-spark-mllib apache-spark-ml apache-spark playframework scala
MongoDB Spark Connector py4j.protocol.Py4JJavaError: An error occurred while calling o50.load
user_67064160
•
4
2
2822
apache-spark mongodb python
Writing parquet to NFS
user_56006810
•
2
1
882
parquet pyspark apache-spark nfs
Spark Structured Streaming takes too much time to compute aggregated query
user_12151520
•
2
1
1607
spark-structured-streaming apache-kafka apache-spark
PySpark Distinct List of Each of the Keys from an RDD
user_82344760
•
2
3
12680
rdd pyspark apache-spark python
Hot Questions