OpenVINO
Multi-modal models support
Adding `OVModelForVisionCausalLM` by eaidova in https://github.com/huggingface/optimum-intel/pull/883
OpenCLIP models support
Adding OpenCLIP models support by sbalandi in https://github.com/huggingface/optimum-intel/pull/857
python
from optimum.intel import OVModelCLIPVisual, OVModelCLIPText
visual_model = OVModelCLIPVisual.from_pretrained(model_name_or_path)
text_model = OVModelCLIPText.from_pretrained(model_name_or_path)
image = processor(image).unsqueeze(0)
text = tokenizer(["a diagram", "a dog", "a cat"])
image_features = visual_model(image).image_features
text_features = text_model(text).text_features
Diffusion pipeline
Adding `OVDiffusionPipeline` to simplify diffusers model loading by IlyasMoutawwakil in https://github.com/huggingface/optimum-intel/pull/889
diff
model_id = "stabilityai/stable-diffusion-xl-base-1.0"
- pipeline = OVStableDiffusionXLPipeline.from_pretrained(model_id)
+ pipeline = OVDiffusionPipeline.from_pretrained(model_id)
image = pipeline("sailing ship in storm by Leonardo da Vinci").images[0]
NNCF GPTQ support
GPTQ support by nikita-savelyevv in https://github.com/huggingface/optimum-intel/pull/912