I'm looking for a way to save my sklearn Pipeline for data pre-processing so that I can re-load it to make predictions. So far I've only seen options like pickle or joblib , that will serialize arbitrary python objects, but the resulting file is opaque if I wanted to store the pipeline in version control, will serialize any python object and therefore might not be safe to unserialize, and may run into issues with different Python version or library versions It seems like ONNX is a great way to save models in a safe & interoperable way -- Is there any alternative for data pre-processing pipelines?

Is there a format like ONNX for persisting data pre-processing / feature-engineering pipelines without serializing?

I'm looking for a way to save my sklearn Pipeline for data pre-processing so that I can re-load it to make predictions.

So far I've only seen options like pickle or joblib, that will serialize arbitrary python objects, but the resulting file

is opaque if I wanted to store the pipeline in version control,
will serialize any python object and therefore might not be safe to unserialize, and
may run into issues with different Python version or library versions

It seems like ONNX is a great way to save models in a safe & interoperable way -- Is there any alternative for data pre-processing pipelines?