How do I grep for a backtick?

So I'm trying to find backticks (`) in files, so I ran:

grep -irl '\`' ./*

This seems to return every single file possible...

What else can I try?