SipMask — New SOTA in Instance Segmentation

Mikhail Raevskiy — Mon, 09 Nov 2020 19:36:17 +0000

SipMask is a one-stage neural network for instance segmentation of objects in an image. The model bypasses the previous one-stage state-of-the-art approaches on the COCO test-dev dataset. Compared to TensorMask, SipMask gives a 1% AP gain. Moreover, the model produces predictions 4 times faster. The model bypasses YOLACT by 3% in AP.

Instance Segmentation with SipMask. Source: https://arxiv.org/pdf/2007.14772v1.pdf

More about the model

A feature of the neural network architecture is the new spatial preservation (SP) module. The SP module is a feature pooling mechanism in a one-stage segmentation model. The idea of the module is to store spatial information about an object.

The overall architecture of our SipMask comprising fully convolutional mask specialized classification and regression branches. Source: https://arxiv.org/pdf/2007.14772v1.pdf

The model is based on the FCOS architecture. However, the two standard branches of classification and regression have been replaced with mask-specific classification and regression in order to adapt the model for instance segmentation. The classification unit predicts the rates of the classes and assigns spatial coefficients for the regions of the boundaries of objects. These coefficients are then used by the SP to predict the individual masks.

Comparison of competing architectures. Source: https://arxiv.org/pdf/2007.14772v1.pdf

Testing the model

The researchers validated the model on the COCO test dataset. Compared to state-of-the-art one-step approaches for instance segmentation, SipMask produces more accurate predictions.

Benchmarking results. Source: https://arxiv.org/pdf/2007.14772v1.pdf

The source code of the project is available in the repository on GitHub.

If you found this article helpful, click the💚 or 👏 button below or share the article on Facebook so your friends can benefit from it too.

https://slidetosubscribe.com/raevskymichail/

Forem: Deep Learning Digest

SipMask — New SOTA in Instance Segmentation

More about the model

Testing the model

Read More