apache-spark

apache-spark

436 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Databricks Job fails with exception: UnsupportedOperationException: Not implemented by the CredentialScopeFileSystem FileSystem implementation
Robert Kossendey0
•
1
0
31
aws-databricks delta-lake databricks pyspark apache-spark
Using rangeBetween considering months rather than days in PySpark
Tinkerbell0
•
1
1
30
window-functions pyspark apache-spark apache-spark-sql sql
Spark stuck on stage when using community detection lpa AND g.edges.count() from graphframes library
Arash Mohamadpour0
•
0
0
8
graphframes large-data bigdata apache-spark
Continuously Updating Partitioned Parquet
maxwellray0
•
0
1
26
amazon-s3 parquet apache-spark scala
Is it still necessary to repartition spark dataframe after enabling AQE?
QPeiran0
•
0
0
19
apache-spark-sql-repartition apache-spark apache-spark-sql
Is there any wrong when a dataframe join an another dataframe with a column using monotonically_increasing_id?
Tregear Zhang0
•
0
0
28
apache-spark scala
Need description for the values available in field from table
Rajasekhar Madduri0
•
0
0
21
pyspark apache-spark sql
How to do database and table locks for concurrency spark
Anu0
•
0
0
18
spark-streaming aws-glue pyspark apache-spark apache-spark-sql
If I use Dataproc, how does it process real-time streaming data from Apache Hadoop and Spark to Dataproc?
wolfie0
•
0
1
29
dataproc real-time hadoop google-cloud-platform apache-spark
How is number of containers calculated in a AWS EMR cluster?
userHrSl10
•
0
0
27
amazon-emr apache-spark amazon-web-services
Hot Questions