mailitics

Tag: transformer

  • Vision Transformer on a Budget

    Vision Transformer on a Budget Introduction The vanilla ViT is problematic. If you take a look at the original ViT paper [1], you’ll notice that although this deep learning model proved to work extremely well, it requires hundreds of millions of labeled training images to achieve this.  Well, that’s a lot.  This requirement of an enormous…

  • Behind the Magic: How Tensors Drive Transformers

    Behind the Magic: How Tensors Drive Transformers Introduction Transformers have changed the way artificial intelligence works, especially in understanding language and learning from data. At the core of these models are tensors (a generalized type of mathematical matrices that help process information) . As data moves through the different parts of a Transformer, these tensors…

  • Image Captioning, Transformer Mode On

    Image Captioning, Transformer Mode On Introduction In my previous article, I discussed one of the earliest Deep Learning approaches for image captioning. If you’re interested in reading it, you can find the link to that article at the end of this one. Today, I would like to talk about Image Captioning again, but this time…