How to use matplotlib module in Apache Beam Google DataFlow runner

Is it possible to get the matplotlib module from within google dataflow (beam)? I have it in my requirements.txt:

matplotlib==2.0.2

But still get the error:

ImportError: No module named matplotlib

Thanks!