Removing a PowerShell module using its version number

Is there an easy way to pass version as a parameter to Get-Module?

I have two different versions of Azure PowerShell installed:

C:\WINDOWS\system32> get-module -name azure -listavailable

    Directory: C:\Program Files\WindowsPowerShell\Modules\...

ModuleType Version    Name
---------- -------    ----
Manifest   1.0.4      Azure

    Directory: C:\Program Files (x86)\Microsoft SDKs\Azure\...

ModuleType Version    Name
---------- -------    ----
Manifest   1.0.2      Azure

And I wish to remove one of them using a command like:

Get-Module -name azure -version 1.0.2 | remove-module