apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Creating a new column in pyspark dataframe using another column values from future
user_160935650
•
2
2
334
pyspark apache-spark-sql apache-spark
Why is Spark broadcasting 1.5GB table (see DAG)?
user_158395910
•
2
0
104
pyspark apache-spark
How to keep Dataproc Yarn nm-local-dir size manageable
user_43738980
•
3
1
264
hadoop-yarn hdfs google-cloud-dataproc apache-spark
Error running Spark 3.1.1 as hive's 3.1.2 engine ( java.lang.NoClassDefFoundError: org/apache/spark/unsafe/array/ByteArrayMethods )
user_159924660
•
4
1
1091
hadoop-yarn apache-spark hive hadoop
Exception in thread "main" java.lang.NoClassDefFoundError: scala/Product$class ( Java)
user_139917860
•
3
1
4129
apache-kafka apache-spark scala java
Scala module 2.12.3 requires Jackson Databind version >= 2.12.0 and < 2.13.0 but I have databind 2.12.3
user_160828280
•
4
2
7521
apache-spark version data-binding java
Change the datatype of a column in delta table
user_123358380
•
3
2
4796
delta-lake apache-spark-sql apache-spark
How to check selected features with PySpark's ChiSqSelector?
user_146120640
•
4
1
1001
feature-selection pyspark apache-spark machine-learning python
Why can't I connect to Hive metastore?
user_71580040
•
2
1
416
google-cloud-dataproc gcloud apache-spark hive
Spark (Scala) Turn a list with duplicates into a map of (list_entry, count)
user_129435800
•
2
1
245
apache-spark scala
Hot Questions