apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
What is the Parquet summary file?
user_97748120
•
3
3
1161
parquet apache-spark-sql apache-spark
Spark - Reading many small parquet files gets status of each file before hand
user_4351820
•
9
1
1743
parquet apache-spark-sql apache-spark amazon-s3 scala
Spark Structured Streaming watermark error
user_7411640
•
4
2
1441
spark-streaming apache-spark-sql apache-spark
Speed up InMemoryFileIndex for Spark SQL job with large number of input files
user_10521580
•
7
1
4807
apache-spark-sql apache-spark
drop column in a table/view using spark sql only
user_104616280
•
4
2
8700
apache-spark-sql apache-spark string-interpolation
How to list S3 objects in parallel in PySpark using flatMap()?
user_27959410
•
3
1
1689
pyspark boto3 apache-spark-sql apache-spark amazon-s3
Mysterious 'pyarrow.lib.ArrowInvalid: Floating point value truncated' ERROR when use toPandas() on a DataFrame in pyspark
user_74274710
•
4
2
6073
apache-arrow pyspark pyarrow apache-spark-sql apache-spark
Pyspark : Interpolation of missing values in pyspark dataframe observed
user_36180850
•
4
3
2672
pyspark apache-spark-sql
Strange behavior when using toDF() function to transfrom RDD to Dataframe in PySpark
user_105837910
•
7
1
2609
rdd pyspark apache-spark-sql apache-spark python
Dynamic where condition genaration in scala
user_14687430
•
3
1
722
apache-spark-sql apache-spark scala sql
Hot Questions