apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Getting ClassNotFoundException in MongoPartition in Spark in cluster mode, in local mode, code runs fine. How to resolve?
user_2032620
•
2
0
208
apache-spark sbt mongodb maven scala
Extending DefaultParamsReadable and DefaultParamsWritable not allowing reading of custom model
user_122787390
•
3
1
218
apache-spark-ml databricks apache-spark scala
DataType.fromJson() Error: java.lang.IllegalArgumentException: Failed to convert the JSON string 'int' to a data type
user_59085320
•
3
1
3119
apache-spark scala json
DataType.fromJSON() - java.lang.IllegalArgumentException: Failed to convert the JSON string <> to a data type
user_59085320
•
2
1
478
apache-spark scala
Spark 3.1-java throws internal error while running in GCP - Dataproc cluster
user_152605210
•
3
0
187
google-cloud-dataproc apache-spark-sql apache-spark google-cloud-platform java
Converting PySpark dataframe to a Delta Table
user_86501150
•
3
2
3511
delta-lake aws-glue pyspark apache-spark
How to infer schema of serialized JSON column in Spark SQL?
user_31559440
•
4
2
1712
pyspark apache-spark-sql apache-spark json
read a parquet file using Java, but it works in local machine, and doesn't work in docker container
user_64536820
•
2
2
1430
parquet-mr parquet spring-boot apache-spark java
Pyspark: How to convert a string (created from a dense vector) back to a dense vector?
user_96860370
•
2
1
410
pyspark apache-spark vectorization type-conversion string
How apply a different timezone to a timestamp in PySpark
user_40686780
•
2
2
4548
pyspark apache-spark-sql apache-spark datetime
Hot Questions