A Vision Transformer makes an image look like a sentence — 16 16 patches become tokens and every patch attends to every other
The transformer was built for sequences of words. The Vision Transformer's one radical move is to make an image look like a sentence — and then run the exact same encoder from language on it, with no
→ View original source