author: @himanshustwts

CLIP Paper: Click Here

SigLIP Paper: Click Here

Hi! Hope you’re doing good :)

In this blog, I will dive deep into SigLIP (Lucas Beyer et al). I’ll try to bring an intuition about it’s significance, how SigLIP differs from CLIP Model (will discuss CLIP in detail as well).

My focus will be articulating this blog in points so you can have a better understanding about the flow and it’s implications.

Focus of the Paper

• Language Image Pre training
• Contrastive Learning with Softmax Normalization
• Not require a global view of the pairwise similarities for normalization.
• Batch size efficiency

Understanding Contrastive Pre-training

Contrastive pre-training in CLIP (Contrastive Language-Image Pre-training) is a technique used to align visual and textual representations by training the model to bring matching pairs of images and text (captions or descriptions) closer together in a shared embedding space, while pushing apart non-matching pairs.

CLIP : An Idea