apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
java.lang.String is not a valid external type for schema of int error in creating spark dataframe
user_138688500
•
3
2
12347
apache-spark runtime-error scala
Reading from the beginning of a Kafka Topic using Structured Streaming when query started
user_112823230
•
2
1
1384
spark-structured-streaming apache-kafka apache-spark
Scala compiler failed to infer type inside Spark lambda function
user_10323300
•
3
2
740
apache-spark-dataset apache-spark scala lambda
PySpark UDF optimization challenge
user_66655710
•
3
2
966
amazon-emr pyspark apache-spark
Adding value to column if certain condition meets per group in spark
user_43040200
•
2
1
583
pyspark apache-spark window-functions group-by
Common metadata in databricks cluster
user_103204940
•
3
1
816
databricks-connect azure-databricks databricks apache-spark
How should you run a jupyter notebook on Spark EMR Cluster
user_55650000
•
2
2
2477
spark-submit amazon-emr apache-spark amazon-web-services amazon-s3
ST_geomfromtext function using Spark / java
user_130815750
•
2
2
1012
apache-spark dataframe sql java
Chain MinHash and LSH (BucketedRandomProjectionLSH) in Spark for approx distance and false positive/negatives
user_123927570
•
2
0
120
pyspark apache-spark transform
Alter table tablename CONCATENATE error via the Databricks notebook
user_123358380
•
2
2
347
hiveql databricks apache-spark
Hot Questions