apache-spark-ml

85 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Why spark.ml CrossValidator gives "Broadcasting large task binary with size X" with big dataset?
user_155729700
•
6
0
568
apache-spark-ml pyspark apache-spark machine-learning
How can one plot the precision recall curve in Pyspark from the BinaryClassificationEvaluator obtained metrics?
user_95429540
•
2
0
115
apache-spark-ml pyspark machine-learning matplotlib
How do I use the UnaryTransformer in PySpark?
user_25963630
•
1
1
146
apache-spark-ml pyspark apache-spark python
pyspark ML LabeledPoint not working with LinearRegression
user_16862360
•
2
2
270
apache-spark-mllib apache-spark-ml pyspark apache-spark python
Applying Bucketizer to Spark dataframe after partitioning based on a column value
user_32846840
•
2
1
712
apache-spark-ml apache-spark-sql apache-spark scala
Scala spark: How to train a distributed sparse regression model?
user_54720370
•
2
1
218
apache-spark-ml apache-spark linear-regression sparse-matrix scala
'OneHotEncoder' object has no attribute 'transform'
user_129242730
•
3
1
4333
one-hot-encoding apache-spark-ml pyspark machine-learning
Spark v3.0.0 - WARN DAGScheduler: broadcasting large task binary with size xx
user_142081240
•
6
3
7895
apache-spark-mllib apache-spark-ml apache-spark java
How to convert a sklearn pipeline into a pyspark pipeline?
user_142023640
•
6
2
3257
apache-spark-ml scikit-learn pyspark databricks python
Stratified cross-validation in PySpark
user_27181100
•
2
1
1075
apache-spark-ml pyspark
Hot Questions