scikit-learn undersampling of unbalanced data for crossvalidation

user_2536294 0
Viewed 3947

How do I generate random folds for cross-validation in scikit-learn?

Imagine we have 20 samples of one class, and 80 of the other, and we need to generate N train and test sets, each train set of the size 30, under the constraint that in each training set, the we have 50% of class one and 50% of class 2.

I found this discussion (https://github.com/scikit-learn/scikit-learn/issues/1362) but I don't understand how to get folds. Ideally I think I need such a function:

cfolds = np.cross_validation.imaginaryfunction(
[list(itertools.repeat(1,20)), list(itertools.repeat(2,80))], 
n_iter=100, test_size=0.70)

What am I missing?

scikit-learn machine-learning python
2 Answers

StratifiedCV is a good choice but you can make it simpler:

  1. Run random sampling on data related to class 1 (you need select 15/20 samples)
  2. The same for class 2 (15/80)
  3. Repeat 100 times or how much you need.

That's all. Quick and workable!

user_85449250
Related