I'm training an object detector using Yolov3 on my custom dataset. Traditionally in Yolo you have a variety of object classes so you get a good mix of anchors. In my case, I only have one object class and it has pretty similar dimensions. So when I cluster the dimensions using K-means, I get 9 anchors of pretty similar size... which seems counterproductive.
In fact, I tried with some random anchor sizes that are not all similar and got better results than with 9 similar anchors. So I wonder, what's the best strategy for anchors for 1 class object detector?