apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to split a list of objects to separate columns in pyspark dataframe
user_90835220
•
1
1
426
pyspark apache-spark-sql apache-spark dataframe python
Spark job submission error on EMR: java.net.URISyntaxException: Expected scheme-specific part at index 3: s3
user_59446500
•
1
0
199
mwaa airflow-2.x amazon-emr apache-spark amazon-web-services
Unable to build Spark application with multiple main classes for Databricks job
user_29827450
•
1
1
85
spark-jobserver azure-databricks databricks apache-spark sbt
Skip first and last line from a pipe delimited file with 26 columns and make it to dataframe using scala
user_73462410
•
2
1
283
azure-databricks apache-spark-sql apache-spark scala
How to load a dataframe in PySpark to Snowflake
user_136323090
•
1
1
1019
snowflake-cloud-data-platform pyspark apache-spark-sql apache-spark python
upsert (merge) delta with spark structured streaming
user_98453660
•
3
1
1118
delta-lake spark-streaming databricks apache-spark
Based on same physical plan, why the spark sql is much faster than dataframe when i using WHERE to filter data from hive partitioned table?
user_166644190
•
3
0
76
dask-dataframe apache-spark-sql apache-spark hive
How to use separate key lists to perform a join between two DataFrames?
user_89197490
•
1
1
49
apache-spark-sql apache-spark dataframe scala
How to get the list of SparkListeners in Spark using Scala
user_79274710
•
1
0
31
apache-spark scala
PySpark - data mismatch error when trying to split a column content
user_82216480
•
1
1
1079
pyspark apache-spark split
Hot Questions