For some reason the code below is useing all available cores even though I have set n_jobs equal to 1. Have I missed something or should I submit an issue at scikit ?
import numpy as np
from sklearn import linear_model
liReg = linear_model.LinearRegression(n_jobs=1)
a = np.random.rand(10000,20)
b = np.random.rand(10000)
for i in range(1000):
liReg.fit(a, b)
liReg.predict(a)
I have two identical servers but one runs scikit v0.18 and one v0.17 - this only happens when using 0.18.
Here is the output of time python example.py:
Using 0.17 - just uses one core:
real 0m8.381s
user 0m6.387s
sys 0m1.677s
Using 0.18 - uses all cores:
real 0m32.308s # I guess longer due to overhead of parallel process management
user 2m53.612s
sys 20m48.285s