autoregressive/models/README.md

Download the vit weight first 

ViT-small: https://huggingface.co/WinKawaks/vit-small-patch16-224 \
Dinov2-small: https://huggingface.co/facebook/dinov2-small

Put them here