Wrong output when using array indexing on UTF-8 string

I have encountered a problem when using a UTF-8 string. I want to read a single character from the string, for example:

$string = "üÜöÖäÄ";
echo $string[0];

I am expecting to see ü, but I get � -- why?