apache-spark-2.0

23 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Apache Spark 2.2: broadcast join not working when you already cache the dataframe which you want to broadcast
user_108070100
•
6
1
2134
apache-spark-dataset apache-spark-2.0 apache-spark-sql apache-spark
Spark2 Can't write dataframe to parquet hive table : HiveFileFormat`. It doesn't match the specified format `ParquetFileFormat`
user_108903480
•
10
1
13610
apache-spark-2.0 parquet apache-spark hive
Records are missing after creating the table from spark temp table in Spark2
user_25533820
•
3
1
404
apache-spark-2.0 rdd partitioning dataframe scala
Add new fitted stage to a exitsting PipelineModel without fitting again
user_12692980
•
3
1
1494
apache-spark-ml apache-spark-2.0 apache-spark pipeline
Split Spark DataFrame into two DataFrames (70% and 30% ) based on id column by preserving order
user_22178660
•
3
1
3528
apache-spark-2.0 pyspark apache-spark
How does Spark 2.0 handle column nullability?
user_57765390
•
6
2
6029
apache-spark-2.0 pyspark apache-spark-sql apache-spark
Spark 2.0 Timestamp Difference in Milliseconds using Scala
user_87127250
•
9
3
6767
apache-spark-2.0 apache-spark-sql user-defined-functions timestamp scala
Spark Session read mulitple files instead of using pattern
user_8645980
•
2
3
3409
apache-spark-dataset apache-spark-2.0 apache-spark-sql apache-spark
Pass system property to spark-submit and read file from classpath or custom path
user_15491350
•
10
1
12902
spark-submit apache-spark-2.0 apache-spark scala java
Why is Apache Livy session showing Application id NULL?
user_37137850
•
5
1
2301
livy apache-spark-standalone apache-spark-2.0 apache-spark
Hot Questions