Computer vision transformer models (CLIP, ViT, DeiT) released by Hugging Face

Computer vision transformer models (CLIP, ViT, DeiT) released by Hugging Face

Transformers meets VISION

v4.6.0 is the first CV dedicated release!

Hugging Face Twitter post https://twitter.com/huggingface/status/1392503426978881536

Google Colab

Quick demo: Vision Transformer (ViT) by Google Brain

https://colab.research.google.com/github/NielsRogge/Transformers-Tutorials/blob/master/VisionTransformer/Quick_demo_of_HuggingFace_version_of_Vision_Transformer_inference.ipynb

Fine-tune the Vision Transformer on CIFAR-10

https://colab.research.google.com/github/NielsRogge/Transformers-Tutorials/blob/master/VisionTransformer/Fine_tuning_the_Vision_Transformer_on_CIFAR_10_with_the_%F0%9F%A4%97_Trainer.ipynb

Includes computer vision transformers from

OpenAI

CLIP - image-text similarity or zero-shot image classification

Documentation https://huggingface.co/transformers/model_doc/clip.html

Model https://huggingface.co/openai/clip-vit-base-patch32

Google AI

ViT - Vision Transformer

Documentation https://huggingface.co/transformers/model_doc/vit.html

Model https://huggingface.co/google/vit-base-patch16-224

Facebook AI

DeiT - Data-efficient vision transformer (improvement over ViT)

State-of-the-art image classification

Documentation https://huggingface.co/transformers/model_doc/deit.html

Model https://huggingface.co/facebook/deit-base-distilled-patch16-224

Please like and share this post if you enjoyed it using the buttons at the bottom!

Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact

Web site with my other posts by category https://morrislee1234.wixsite.com/website

#ComputerVision #Transformers #AINewsClips #AI #ML #ArtificialIntelligence #MachineLearning