apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to configure Spark / Databricks memory to collect large R data.frame?
user_68066530
•
4
0
1128
sparkr apache-spark r
PySpark not null and not nan values function for all type of columns
user_141653370
•
3
0
1177
pyspark apache-spark dataframe python-3.x
Error while read or write Parquet format data
user_89485340
•
2
3
2128
parquet azure-databricks databricks apache-spark
Spark unable to read DECIMAL columns in Parquet files written by AvroParquetWriter
user_45946990
•
2
1
2201
s3-kafka-connector parquet apache-kafka-connect apache-spark
How to write spark dataframe in a single file in local system without using coalesce
user_35799550
•
2
1
743
spark-avro pyspark apache-spark
NLP analysis for some pyspark dataframe columns by numpy vectorization
user_34480110
•
2
1
282
johnsnowlabs-spark-nlp pyspark apache-spark nlp python
how spark handles out of memory error when cached( MEMORY_ONLY persistence) data does not fit in memory?
user_141586000
•
3
1
2073
rdd apache-spark out-of-memory partitioning caching
Spark Full Rdd joinWithCassandraTable java.lang.IllegalArgumentException: requirement failed: Invalid row size: instead of
user_49016880
•
2
1
266
cassandra-3.0 spark-cassandra-connector apache-spark cassandra
Spark memory fraction vs Young Generation/Old Generation java heap split
user_36533430
•
3
1
667
apache-spark heap-memory scala java
Spark Memory Overhead
user_90840960
•
5
1
12760
memory-overhead hadoop-yarn pyspark apache-spark executor
Hot Questions