apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Parquet format store bad records separately using pyspark
user_99505630
•
2
0
163
parquet pyspark apache-spark
HADOOP_HOME and hadoop.home.dir are unset Error when trying to use sc.setCheckpointDir('checkpoint') Pyspark
user_124198320
•
2
0
905
pyspark apache-spark-sql apache-spark hadoop java
Partially replace dataframe with rows from another
user_43126730
•
2
2
105
pyspark apache-spark-sql apache-spark python-3.x
Configuring Spark Structured Streaming with authenticated Confluent Schema Registry
user_162599590
•
2
1
581
confluent-cloud confluent-schema-registry apache-kafka apache-spark scala
Ignoring corrupted Orc files when reading via Spark
user_46528750
•
2
1
250
orc apache-spark scala
How to merge duplicate columns in pyspark?
user_156602350
•
2
2
1186
pyspark apache-spark-sql apache-spark
Compare data in a table in Databricks and MS SQL Server
user_153556200
•
1
1
343
aws-databricks databricks apache-spark sql
Change udf function to a spark sql function
user_95484760
•
1
1
54
pyspark apache-spark-sql apache-spark
How to Save Great Expectations results to File From Apache Spark - With Data Docs
user_155206150
•
3
2
1643
great-expectations pyspark azure-databricks databricks apache-spark
How to get Great_Expectations to work with Spark Dataframes in Apache Spark ValueError: Unrecognized spark type: string
user_155206150
•
1
1
957
great-expectations pyspark apache-spark
Hot Questions