Inductive Bias와 Self-Attention
Vision Transformer
Pyramid Vision Transformer
DeiT
Tokens-to-Token ViT
BEiT
SepViT
Compact Convolutional Transformers
Compact Vision Transformers
Swin Transformer
Vision Transformer with Deformable Attention
Mobile Vision Transformer
BEiT 논문과 코드를 리뷰합니다.
BEiT Code
Q&A