apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Pyspark - generate a dates column having all the days between two given dates and add it to an existing dataframe
user_59043420
•
2
1
1396
pyspark apache-spark-sql apache-spark python
delta lake - Insert into sql in pyspark is failing with java.lang.NoSuchMethodError: org.apache.spark.sql.catalyst.expressions.Alias
user_151705200
•
5
1
3771
delta-lake google-cloud-dataproc pyspark databricks apache-spark
Spark multi-stage mapWithState Shuffle issue
user_9777990
•
2
0
59
spark-streaming apache-spark-sql apache-spark hadoop stream
How can I supply multiple conditions in spark startsWith() function?
user_142273520
•
3
2
939
apache-spark-sql apache-spark startswith scala
PySpark pyspark.sql.DataFrameReader.jdbc() doesn't accept datetime type upperbound argument as document says
user_11095470
•
2
1
1302
spark-jdbc pyspark apache-spark-sql apache-spark
How many Iterators are there in Spark mapInPandas?
user_102369740
•
2
1
583
pyspark azure-databricks databricks apache-spark
Is there any relation between vCpu on Fargate resource and spark core/threads?
user_452800
•
2
1
199
aws-fargate pyspark apache-spark
Spark 2.3: How to release RDD from memory in iterative algorithm
user_109533680
•
3
0
193
spark-graphx apache-spark scala
Accessing Azure DevOps Git file directly from Azure Databricks
user_50577530
•
2
1
1056
azure-repos azure-databricks apache-spark azure-devops python
How can I allow precision loss over pyspark jdbc from oracle?
user_78228530
•
2
0
353
pyspark apache-spark oracle
Hot Questions