How to evaluate cost function for scikit learn LogisticRegression?

user_2359802 0
Viewed 9582

After using sklearn.linear_model.LogisticRegression to fit a training data set, I would like to obtain the value of the cost function for the training data set and a cross validation data set.

Is it possible to have sklearn simply give me the value (at the fit minimum) of the function it minimized?

The function is stated in the documentation at http://scikit-learn.org/stable/modules/linear_model.html#logistic-regression (depending on the regularization one has chosen). But I can't find how to get sklearn to give me the value of this function.

I would have thought this is what LogisticRegression.score does, but that simply returns the accuracy (the fraction of data points its prediction classifies correctly).

I have found sklearn.metrics.log_loss, but of course this is not the actual function being minimized.

scikits logistic-regression scikit-learn machine-learning python
3 Answers

I used below code to calculate cost value.

import numpy as np

cost = np.sum((reg.predict(x) - y) ** 2)

where reg is your learned LogisticRegression

user_84265820

I have the following suggestions. You can write the codes for the loss function of logistic regression as a function. After you get your predicted labels of data, you can revoke your defined function to calculate the cost values.

user_77011810
Related