apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Unable to write data to parquet file
user_107225980
•
2
0
312
parquet apache-spark java
getting the current timestamp of each row of dataframe using Spark / Java
user_130815750
•
3
2
729
apache-spark current-time dataframe java
How to solve self._java_obj = _jvm().ml.combust.mleap.spark.SimpleSparkSerializer() TypeError: 'JavaPackage' object is not callable
user_8082680
•
2
0
153
mleap amazon-emr pyspark apache-spark
Pyspark - how to pass a column to a function after casting?
user_76441680
•
2
2
606
pyspark apache-spark
What is the relationship between maxExecutors, num-executors and initialExecutors when using Spark on YARN?
user_33160090
•
2
0
316
hadoop-yarn apache-spark
Pyspark - Preserve order of collect list and collect set over multiple columns
user_88326410
•
2
4
2340
pyspark apache-spark dataframe group-by python
Filter values while using pyspark collect list
user_88326410
•
2
1
755
pyspark apache-spark dataframe
Spark ExecutorLostFailure- Reason: Remote RPC client disassociated. Likely due to containers exceeding thresholds, or network issues
user_138785860
•
6
1
4521
apache-spark
Prevent Delta table merge to create a lot of small files?
user_115456280
•
2
1
1389
delta-lake pyspark apache-spark
Is it possible to use Hadoop 3.x and Hive 3.x using spark 2.4?
user_31906990
•
2
1
1762
hadoop3 apache-spark hive backwards-compatibility hadoop
Hot Questions