aneforge/clip-vit-base-patch32

CLIP ViT-B/32 (ANEForge)

An unmodified duplicate of openai/clip-vit-base-patch32, tagged for use with ANEForge so the weights load and run directly on the Apple Neural Engine (no CoreML). Weights are byte-identical to the source; see the original repo for the model details. See the original repo for license terms.

Use with ANEForge

# pip install "aneforge[models]"
import aneforge as af

clip = af.load_clip("aneforge/clip-vit-base-patch32")
print(clip.classify(image, ["a photo of a cat", "a photo of a dog"]))   # image: a PIL.Image; zero-shot (label, prob)

ANEForge compiles the model's graph into a single ANE program and streams the weights from this repo via huggingface_hub. See the docs and the paper.