Key features of STN - rugbyprof/5443-Data-Mining GitHub Wiki

What are the three key features of STN that solves the issues of Convolutional Networks?

The Spatial Transformer mechanism addresses the issues by providing Convolutional Neural Networks with explicit spatial transformation capabilities. It possesses 3 defining properties that make it very appealing.

Modular:

STNs can be inserted anywhere into existing architectures with relatively small tweaking.

Differentiable:

STNs can be trained with backprop allowing for end-to-end training of the models they are injected in.

Dynamic:

STNs perform active spatial transformation on a feature map for each input sample as compared to the pooling layer which acted identically for all input samples.

---