apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
how to store data into snowflake having timestamp TIMESTAMP_NTZ using pyspark dataframe
user_93963730
•
2
1
798
snowflake-schema snowflake-cloud-data-platform pyspark apache-spark
Reading gzipped parquet files from spark
user_5947650
•
3
1
3816
apache-spark
Premature end of Content-Length delimited message body SparkException while reading from S3 using Pyspark
user_29292400
•
2
1
1335
pyspark-dataframes pyspark apache-spark-sql apache-spark amazon-s3
Spark redis connector to write data into specific index of the redis
user_134909370
•
4
2
2832
pyspark apache-spark redis dataframe scala
spark read parquet with partition filters vs complete path
user_43914560
•
3
3
5636
parquet pyspark apache-spark-sql apache-spark
How to bucket tables using AWS Glue and Spark SQL?
user_11735290
•
2
1
621
aws-glue apache-spark
Why a new batch is triggered without getting any new offsets in streaming source?
user_24148550
•
2
1
420
spark-streaming-kafka spark-streaming spark-structured-streaming apache-spark
Where is the state saved for arbitrary state processing using mapGroupsWithState?
user_24148550
•
5
1
111
spark-structured-streaming apache-spark
PySpark filter by value at given SparseVector() index
user_46710490
•
2
1
624
pyspark apache-spark-sql apache-spark python
Spark 3.0.0 error creating SparkSession: pyspark.sql.utils.IllegalArgumentException: <exception str() failed>
user_9958540
•
4
1
2613
pyspark apache-spark hive python
Hot Questions