I am searching for a hyperparameter tune package for code written directly in Tensorflow (not Keras or Tflearn). Could you make some suggestion?
6 Answers
I'm not sure if this is also the parameters that you want but you mentioned TensorFlow hyperparameters so I guess I can suggest some.
Try to clone this repository for having the needed scripts;
git clone https://github.com/googlecodelabs/tensorflow-for-poets-2
and in the Master folder, invoke your command prompt and run this line;
python -m scripts.retrain -h
to get the list of optional arguments.
Source: https://codelabs.developers.google.com/codelabs/tensorflow-for-poets/#6
I found sci-kit optimize very simple to use for bayesian optimization of hyperameters, and it works with any tensorflow API (estimator, custom estimator, core, keras, etc.)
You could use variational inference (bayesian) as a point cloud over the optimization space; hyperparameter tuning would be much better. Tensorflow probability would be an approach.
Related