apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Facing large data spills for small datasets on spark
user_4665210
•
2
1
430
apache-spark-sql apache-spark scala
Pyspark explode array column into sublist with sliding window
user_66437990
•
1
1
188
pyspark apache-spark-sql apache-spark python
How to use Spacy with Pyspark?
user_77671660
•
2
0
923
pyspark spacy apache-spark nlp python
How to assign a category to each row based on the cumulative sum of values in spark dataframe?
user_61553410
•
3
1
223
bigdata apache-spark cumulative-sum scala
Databricks Spark throws java.io.NotSerializableException: com.amazonaws.services.s3.AmazonS3Client
user_44003600
•
2
0
129
aws-databricks databricks apache-spark amazon-s3
What's the difference between spark.sql() and spark.read.format("jdbc").option("query", "")?
user_117348350
•
2
1
1444
pyspark apache-spark-sql apache-spark python
Apache Spark: It is possible the underlying files have been updated error
user_7063540
•
1
0
449
apache-spark
How to correlate rlike and regex_extract
user_146455030
•
1
2
80
apache-spark-sql apache-spark scala
double percent spark sql in jupyter notebook
user_31020390
•
1
1
383
amazon-emr jupyter-notebook pyspark apache-spark-sql apache-spark
Spark read delta table, getting NoSuchObjectException(message:There is no database named delta) error
user_73378310
•
2
0
319
delta-lake spark-streaming azure-databricks apache-spark
Hot Questions