grep match exact substring ignoring regex syntax

Is there some way to make grep match an exact string, and not parse it as a regex? Or is there some tool to escape a string properly for grep?

$ version=10.4
$ echo "10.4" | grep $version
10.4
$ echo "1034" | grep $version # shouldn't match
1034