What is Segment Anything?

Segment Anything is a new AI model from Meta AI that can "cut out" any object, in any image, with a single click. It is a promptable segmentation system with zero-shot generalization to unfamiliar objects and images, without the need for additional training.

How does Segment Anything work?

Segment Anything uses a variety of input prompts, including specifying what to segment in an image, allowing for a wide range of segmentation tasks without the need for additional training. It can also take input prompts from other systems, such as an object detector, and can generate multiple valid masks for ambiguous prompts.

Features of Segment Anything

• Promptable design enables flexible integration with other systems
• Extensible outputs can be used as inputs to other AI systems
• Zero-shot generalization to unfamiliar objects and images without requiring additional training
• Can take input prompts from other systems, such as an object detector
• Can generate multiple valid masks for ambiguous prompts

Price

The model is open-sourced and available on GitHub, and the dataset is available for download.

Training the model

The model was trained on a dataset of 11 million images and 1.1 billion segmentation masks, using a model-in-the-loop "data engine" that interactively annotated images and updated the model.