apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to get memory used by Spark Executor
user_7413620
•
2
0
426
apache-spark
What is the difference between storing 1000 1GB files and 1 1000GB file in HDFS for further usage with Spark? Which is better, if any and why?
user_89627410
•
2
1
252
hdfs apache-spark
Coalesce in spark scala
user_124916690
•
2
1
1020
apache-spark coalesce null scala
Find min value for every 5 hour interval
user_67772380
•
3
2
209
apache-spark-sql apache-spark scala
Why can't I merge multiple parquet files using "cat file1.parquet file2. parquet > result.parquet"?
user_144071740
•
3
1
406
parquet pyspark apache-spark
Spark Kafka - Cannot fetch record for offset in 120000 milliseconds
user_31343830
•
3
0
999
azure-hdinsight azure-eventhub apache-kafka apache-spark scala
Pyspark's df.writeStream generates no output
user_139876430
•
2
0
552
spark-streaming elasticsearch pyspark apache-spark python
How to determine the best setting for spark running on a single node?
user_144367970
•
5
1
334
spark-shell pyspark apache-spark scala
How to join 2 tables when it has different values in the column
user_114676080
•
2
3
89
apache-spark hive hadoop scala sql
Trying to create a column with the maximum timestamp in PySpark DataFrame
user_67900690
•
4
2
3056
pyspark apache-spark-sql apache-spark
Hot Questions