apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Performance comparison with take(10) vs limit(10).collect()
user_115905820
•
5
3
1812
apache-spark-sql apache-spark dataframe scala
Pyspark: Match values in one column against a list in same row in another column
user_86283830
•
3
2
5957
pyspark apache-spark python
Delta Lake Create Table with structure like another
user_25637550
•
3
4
4850
delta-lake spark-structured-streaming databricks apache-spark
Spark (Scala) Parsing issue of a fields having timestamp format as ("dd-MMM-yy hh:mm:ss:SSSSSSSSS aa")
user_28782980
•
3
1
677
apache-spark-sql apache-spark excel datetime scala
How to handle an AnalysisException on Spark SQL?
user_101887930
•
18
3
16414
pyspark databricks apache-spark-sql apache-spark python
write spark dataframe as array of json (pyspark)
user_32119500
•
10
2
6957
pyspark apache-spark python json
Add conf file to classpath in Google Dataproc
user_1172430
•
3
1
961
hocon google-cloud-dataproc apache-spark
What is the difference between "predicate pushdown" and "projection pushdown"?
user_45219500
•
7
2
6199
bigdata parquet apache-spark
Spark on AWS EMR: java.lang.NoSuchMethodError: scala.Product.$init$(Lscala/Product;)V
user_15543860
•
4
1
717
amazon-emr apache-spark scala
Hive table lock info using spark.sql in Spark 2.4.0 throws error
user_82365810
•
3
1
528
apache-spark-sql apache-spark hive
Hot Questions