Added quantization to KOSMOS-2 notebook (#2190)

openvinotoolkit · Jul 11, 2024 · 117df38 · 117df38
1 parent c20240f
commit 117df38
Show file tree

Hide file tree

Showing 2 changed files with 602 additions and 62 deletions.
diff --git a/notebooks/kosmos2-multimodal-large-language-model/README.md b/notebooks/kosmos2-multimodal-large-language-model/README.md
@@ -26,6 +26,8 @@ can provide a more convenient and efficient human-AI interaction for vision-lang
 - Infer the original model
 - Convert the model to OpenVINO IR
 - Inference
+- Optimize pipeline with [NNCF](https://github.com/openvinotoolkit/nncf/)
+- Compare results of original and optimized pipelines
 - Interactive inference
 
 ## Installation instructions

diff --git a/...oks/kosmos2-multimodal-large-language-model/kosmos2-multimodal-large-language-model.ipynb b/...oks/kosmos2-multimodal-large-language-model/kosmos2-multimodal-large-language-model.ipynb