apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
[Scala][Spark]: transform a column in dataframe, keeping other columns, using withColumn and map [error: missing parameter type]
user_101341260
•
2
2
220
apache-spark explode scala functional-programming types
Spark record linkage in Java
user_103713940
•
1
2
108
record-linkage apache-spark java
java.lang.String is not valid external type for schema of string
user_69339930
•
2
2
207
apache-spark dataframe scala
Using a pyspark sql function inside lambda causing pickle error
user_116973940
•
1
1
262
pyspark apache-spark-sql apache-spark
How do I load gziped json data into table, using Spark SQL's CREATE TABLE Query
user_2609980
•
3
1
250
apache-superset apache-spark-sql apache-spark
Why can coalesce lead to too few nodes for processing?
user_80896950
•
1
2
272
rdd pyspark apache-spark-sql apache-spark coalesce
How to perform Principle Component Analysis on large feature set?
user_47344870
•
1
0
52
apache-spark-mllib apache-spark machine-learning
Spark, adding new field in array of arrays
user_45261510
•
2
0
113
apache-spark scala
Case when statement to conditionally populate columns in pyspark
user_116973940
•
1
0
65
pyspark apache-spark-sql apache-spark python
Azure Databricks not paralelizing on Spark
user_87644120
•
2
2
396
databricks apache-spark azure python
Hot Questions