AllanVester commited on
Commit
9f3d5bb
verified
1 Parent(s): c0ba6b6

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +55 -0
README.md ADDED
@@ -0,0 +1,55 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ language:
4
+ - en
5
+ pipeline_tag: mask-generation
6
+ base_model: facebook/sam3.1
7
+ library_name: coreml
8
+ tags:
9
+ - coreml
10
+ - sam3
11
+ - sam3.1
12
+ - segmentation
13
+ - detection
14
+ - tracking
15
+ - object-multiplex
16
+ - fp32
17
+ - float32
18
+ ---
19
+
20
+ # SAM 3.1 Core ML
21
+
22
+ [SAM 3](https://github.com/facebookresearch/sam3) (Segment Anything with Concepts) is a unified foundation model from Meta for promptable segmentation in images and videos. It detects, segments, and tracks objects using text or visual prompts such as points, boxes, and masks. Compared to its predecessor [SAM 2](https://github.com/facebookresearch/sam2), SAM 3 introduces the ability to exhaustively segment all instances of an open-vocabulary concept specified by a short text phrase or exemplars. Unlike prior work, SAM 3 can handle a vastly larger set of open-vocabulary prompts. It achieves 75-80% of human performance on our new SA-CO benchmark which contains 270K unique concepts, over 50 times more than existing benchmarks. SAM 3.1 builds on this with Object Multiplex, a shared-memory approach for joint multi-object tracking that delivers ~7x faster inference at 128 objects on a single H100 GPU without sacrificing accuracy, along with improved VOS performance on 6 out of 7 benchmarks.
23
+
24
+ This is the Core ML version of [SAM 3.1](https://huggingface.co/facebook/sam3.1) 路 [Code](https://github.com/facebookresearch/sam3).
25
+
26
+ ## Download
27
+
28
+ Install `huggingface-cli`
29
+
30
+ ```bash
31
+ brew install huggingface-cli
32
+ ```
33
+
34
+ ```bash
35
+ huggingface-cli download --local-dir models AllanVester/SAM3.1-CoreML
36
+ ```
37
+
38
+ ## Citation
39
+
40
+ If you use SAM 3 in your research, please use the following BibTeX entry:
41
+ ```
42
+ @misc{carion2025sam3segmentconcepts,
43
+ title={SAM 3: Segment Anything with Concepts},
44
+ author={Nicolas Carion and Laura Gustafson and Yuan-Ting Hu and Shoubhik Debnath and Ronghang Hu and Didac Suris and Chaitanya Ryali and Kalyan Vasudev Alwala and Haitham Khedr and Andrew Huang and Jie Lei and Tengyu Ma and Baishan Guo and Arpit Kalla and Markus Marks and Joseph Greer and Meng Wang and Peize Sun and Roman R盲dle and Triantafyllos Afouras and Effrosyni Mavroudi and Katherine Xu and Tsung-Han Wu and Yu Zhou and Liliane Momeni and Rishi Hazra and Shuangrui Ding and Sagar Vaze and Francois Porcher and Feng Li and Siyuan Li and Aishwarya Kamath and Ho Kei Cheng and Piotr Doll谩r and Nikhila Ravi and Kate Saenko and Pengchuan Zhang and Christoph Feichtenhofer},
45
+ year={2025},
46
+ eprint={2511.16719},
47
+ archivePrefix={arXiv},
48
+ primaryClass={cs.CV},
49
+ url={https://arxiv.org/abs/2511.16719},
50
+ }
51
+ ```
52
+
53
+ ## License
54
+
55
+ The original SAM 3.1 model weights are released by Meta under the [SAM License](https://huggingface.co/facebook/sam3.1/blob/main/LICENSE), a custom permissive license for commercial and research use.