Postgis – Opposite of ST_Within

I'm trying to get all points that are NOT inside a few polygons:

SELECT pt.geom 
FROM points pt, polygons po
WHERE ST_Within(pt.geom, po.geom) = false;

But doesn't work – I get all the points instead.