apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Spark read multiple CSV files, one partition for each file
user_37543140
•
4
1
1715
apache-spark-sql apache-spark csv
Databricks Exception: Total size of serialized results is bigger than spark.driver.maxResultsSize
user_96691420
•
7
3
11464
databricks apache-spark azure python
spark SQL thread blocked and running forever
user_83176370
•
4
0
379
apache-spark
Using Redshift JDBC Jar in spark submit , doesnt let the spark connect to Glue catalog
user_92280300
•
3
0
317
amazon-emr amazon-redshift aws-glue pyspark apache-spark
Pass a dictionary to pyspark udf
user_20198210
•
4
2
8385
pyspark apache-spark user-defined-functions
Spark Warehouse VS Hive Warehouse
user_77390870
•
3
2
3265
hortonworks-data-platform apache-spark-sql apache-spark hive
Creating a row number of each row in PySpark DataFrame using row_number() function with Spark version 2.2
user_83292130
•
17
2
25432
pyspark pandas apache-spark dataframe row-number
Spark Structured Streaming + Kafka Integration: MicroBatchExecution PartitionOffsets Error
user_17644090
•
3
1
3676
spark-streaming apache-kafka apache-spark scala
How to get the TypeTag for a class in Java
user_8660820
•
6
1
1313
apache-spark scala java
Partitioning a large skewed dataset in S3 with Spark's partitionBy method
user_11251590
•
22
3
7429
apache-spark-sql apache-spark partitioning
Hot Questions