apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
The path X cannot be loaded, because existing classpath entries conflict - spark-shell
user_100255040
•
2
0
104
apache-spark scala
RN ProcfsMetricsGetter: Exception when trying to compute pagesize, as a result reporting of ProcessTree metrics is stopped
user_142292210
•
3
1
2589
apache-spark
what happens when shuffle partition is greater than 200( spark.sql.shuffle.partitions 200(by default) in dataframe)
user_141586000
•
2
1
1782
data-partitioning apache-spark shuffle aggregate
Can Glue Crawler crawl the deltalake files to create tables in aws glue catalogue?
user_31992850
•
2
2
1318
data-lake aws-glue-data-catalog delta-lake aws-glue apache-spark
Is there any way to read multiple parquet paths from s3 in parallel using spark?
user_113627570
•
3
1
287
parquet apache-spark hadoop amazon-s3
Spark in standalone mode on a single computer : is it worth splitting it in masters and workers through docker containers (or another way)?
user_28271810
•
3
2
339
minikube apache-spark kubernetes docker
create an EMR step function inside jupyter notebook via python code
user_142213310
•
2
1
435
amazon-emr aws-step-functions apache-spark amazon-web-services python
How to select the maximum value from a spark dataframe in a particular time frame
user_98523770
•
2
0
165
apache-spark-sql apache-spark scala sql
Can I use Jupyter lab to interact with databricks spark cluster using Scala?
user_44555240
•
2
3
1260
jupyter databricks-connect jupyter-lab apache-spark scala
How to insert hex data into blob data type column in Cassandra via pyspark
user_78821850
•
2
2
728
spark-cassandra-connector pyspark apache-spark cassandra blob
Hot Questions