I guess I was careless.
I added a bunch of files to svn with svn add,
then I saw a few files added that I didn't want so I deleted them with rm.
Now I can't commit anymore because the commit is missing files. I tried svn cleanup but it didn't help.
My working option now is to manually delete every .svn directory but that seems wrong.