Skip to content

Commit

Permalink
Merge branch 'latest' into yt/add-gpu-to-statuses
Browse files Browse the repository at this point in the history
  • Loading branch information
yatarkan committed May 28, 2024
2 parents 12439bd + 19792e1 commit 5e0604a
Show file tree
Hide file tree
Showing 5 changed files with 867 additions and 98 deletions.
2 changes: 1 addition & 1 deletion .ci/patch_notebooks.py
Original file line number Diff line number Diff line change
Expand Up @@ -93,7 +93,7 @@ def has_additional_deps(str_part):
break
# keep indention
updated_line = " " + updated_line
updated_lines.append(updated_line + "# " + line)
updated_lines.append(updated_line + "\n# " + line)
else:
updated_lines.append(line)
else:
Expand Down
4 changes: 3 additions & 1 deletion notebooks/stable-video-diffusion/README.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
# Image to Video Generation with Stable Video Diffusion

[Stable Video Diffusion (SVD)](https://stability.ai/stable-video) Image-to-Video is a diffusion model that takes in a still image as a conditioning frame, and generates a video from it. In this tutorial we consider how to convert and run Stable Video Diffusion using OpenVINO.
We will use [stable-video-diffusion-img2video-xt](https://huggingface.co/stabilityai/stable-video-diffusion-img2vid-xt) model as example. Additionally, to speedup video generation process we apply [AnimateLCM](https://arxiv.org/abs/2402.00769) LoRA weights.
We will use [stable-video-diffusion-img2video-xt](https://huggingface.co/stabilityai/stable-video-diffusion-img2vid-xt) model as example. Additionally, to speedup video generation process we apply [AnimateLCM](https://arxiv.org/abs/2402.00769) LoRA weights and run optimization with [NNCF](https://github.com/openvinotoolkit/nncf/).

![result](https://github.com/openvinotoolkit/openvino_notebooks/assets/29454499/ae8a77b2-b5c9-45c5-a103-6e46c686739f)

Expand All @@ -17,6 +17,8 @@ Notebook contains the following steps:
- Convert U-Net
- Convert VAE Encoder and Decoder
- Create Stable Video Diffusion Pipeline with OpenVINO
- Optimize pipeline with [NNCF](https://github.com/openvinotoolkit/nncf/)
- Compare results of original and optimized pipelines
- Interactive Demo

## Installation Instructions
Expand Down
Loading

0 comments on commit 5e0604a

Please sign in to comment.