How is an em calculated?

I have noticed that you can use 1em and it will look different on different sites.

What is an em in proportion to?

• The font used?
• The biggest font size?
• The page width/height?