apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Multiple Evaluators in CrossValidator - Spark ML
user_165384210
•
1
0
76
apache-spark-mllib apache-spark-ml apache-spark
How to specify the fully qualified class name of parquet while reading a trained spark mllib model to the code - pyspark
user_174473250
•
1
0
124
parquet pyspark apache-spark
Data Locality in Spark on Kubernetes
user_31278140
•
2
1
258
hdfs apache-spark kubernetes hadoop
Combine all dataframe columns into one column as a JSON with JSON types preserved
user_4098140
•
1
2
322
apache-spark-sql apache-spark scala
What are the Spark S3 (or S3A) Committers in simple words and when I should use them?
user_98226290
•
1
1
285
apache-spark amazon-s3
How to provide cluster name in Azure Databricks Notebook Run Now JSON
user_61837770
•
3
1
278
azure-databricks databricks apache-spark azure api
How to resample (Downsample) the time series big data, from 10 Hz (miliseconds) wants to convert to 1 Hz (seconds) using pyspark
user_133398040
•
2
1
506
bigdata pyspark apache-spark time-series python
Scala dataframe get last 6 months latest data
user_32516260
•
1
2
276
apache-spark dataframe scala
Get difference between two version of delta lake table
user_48012890
•
5
2
692
delta-lake apache-spark scala
Pyspark udf for populating a column based on two other columns
user_108749960
•
1
3
811
pyspark apache-spark dataframe python
Hot Questions