apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How can Spark process data that is way larger than Spark storage?
user_11706770
•
3
1
149
spark-streaming apache-spark
How to use LIKE operator as a JOIN condition in pyspark as a column
user_121791370
•
5
1
2865
aws-glue pyspark apache-spark-sql apache-spark python
Setting spark.sql.legacy.timeParserPolicy=LEGACY in spark-3. Does it implement fallback to older formatter?
user_153627690
•
2
0
1159
apache-spark-sql apache-spark scala
Do I need to use "mergeSchema" option in spark with parquet if I am passing in a schema explicitly?
user_120172530
•
2
1
3108
parquet apache-spark
How do i handle Nulls in pattern matching in spark scala
user_32407900
•
2
2
102
apache-spark scala
Why writing timestamp before 1900 year on spark-3 does not throw SparkUpgradeException?
user_153627690
•
3
1
3372
parquet apache-spark scala
How do I write HDF5 files from Apache Spark?
user_511670
•
2
1
624
apache-spark hdf5
Spark SQL: Repartition by column Exception "REPARTITION Hint expects a partition number as parameter"
user_21748980
•
2
0
399
apache-spark-sql apache-spark
NullPointerException in Spark Thrift Server using Apache Superset or Redash
user_19064890
•
2
0
227
spark-thriftserver pyhive apache-superset apache-spark
Read multiline json string using Python Spark dataframe
user_81855250
•
2
1
917
pyspark apache-spark python json
Hot Questions