CLIP: Connecting text and images

OpenAI Blog ·

OpenAI released CLIP, a vision-language model that learns visual concepts from natural language supervision and enables zero-shot classification across visual benchmarks.

Categories: Model Releases, Research

Excerpt

We’re introducing a neural network called CLIP which efficiently learns visual concepts from natural language supervision. CLIP can be applied to any visual classification benchmark by simply providing the names of the visual categories to be recognized, similar to the “zero-shot” capabilities of GPT-2 and GPT-3.