What is the relationship between instance segmentation and semantic segmentation from the perspective of neural networks?

Viewed 53

I am clear with the tasks of instance segmentation and semantic segmentation. However, from the perspective of the neural networks, what is the relationship between them? Namely, is it feasible to realize instance segmentation by improving or modifying a neural network for semantic segmentation, e.g. DeepLab? If so, what operations are usually used? Many thanks.

1 Answers

Lets assume that you want to know where exist desired class in image then you makes nn that for each pixel predict probability where is that class - this is sematic segmentation. And when you want to know where exist each instance for desired class this is instance segmentation.picture for example

Related