apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Spark scala join with duplicate columns when used finial result df.*
user_189841540
•
1
0
21
databricks apache-spark scala
What is the limit for broadcast of RDD
user_82421540
•
1
0
27
rdd apache-spark-sql apache-spark dataframe scala
Spark shell started with assembly jar cannot resolve decline's cats dependency
user_73801580
•
2
1
27
scala-cats apache-spark sbt scala
Cannot save a pyspark word2vec model
user_127755310
•
1
0
35
apache-spark-ml pyspark apache-spark
Convert String to Timestamp in Spark (Hive) and the datetime is invalid
user_93688820
•
1
2
45
apache-spark hive timestamp scala
spark scala: add a new column that has a list as a value; the list should verify a specific condition
user_168241460
•
1
1
37
apache-spark scala
Generate unique session id for each row of dataframe using custom logic
user_18472120
•
1
1
27
pyspark apache-spark-sql apache-spark
Is there an Encoder for Map type in Java Spark?
user_193792210
•
1
1
27
apache-spark-encoders apache-spark dictionary java
PySpark Virtual Environment issue in spark-submit local mode
user_120152820
•
1
0
44
spark-submit pyspark apache-spark virtualenv python-3.x
What would be an efficient way of getting the frequencies of all categorical variables in a spark dataframe?
user_72388350
•
2
3
53
pyspark apache-spark
Hot Questions