Can I destroy a shader module if a pipeline uses it as one of the stages?

Let's say I make a pipeline specifying a module for vertex shader and a module for fragment shader. That pipeline is now created. Do I need to keep the original modules around or are they no longer needed as the pipeline has incorporated their code into its own code?