Simplified_Disco_Diffusion.ipynb

{
  "nbformat": 4,
  "nbformat_minor": 0,
  "metadata": {
    "colab": {
      "name": "Simplified Disco Diffusion",
      "provenance": [],
      "authorship_tag": "ABX9TyO2lNqHW4GY6CO/cCupSqH+",
      "include_colab_link": true
    },
    "kernelspec": {
      "name": "python3",
      "display_name": "Python 3"
    },
    "language_info": {
      "name": "python"
    },
    "accelerator": "GPU"
  },
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "view-in-github",
        "colab_type": "text"
      },
      "source": [
        "<a href=\"https://colab.research.google.com/github/entmike/disco-diffusion-1/blob/main/Simplified_Disco_Diffusion.ipynb\" target=\"_parent\"><img src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/></a>"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "# 🖼️ Simplified Disco Diffusion (Parameter Edition)\n",
        "\n",
        "[![Discord](https://badgen.net/badge/icon/discord?icon=discord&label)](https://discord.gg/Pmy3wFKbna) [![Maintenance](https://img.shields.io/badge/Maintained%3F-yes-green.svg)](https://github.com/entmike/disco-diffusion-1) ![Terminal](https://badgen.net/badge/icon/terminal?icon=terminal&label) [![Issues](https://img.shields.io/github/issues/entmike/disco-diffusion-1)](https://github.com/entmike/disco-diffusion-1/issues) ![Stars](https://img.shields.io/github/stars/entmike/disco-diffusion-1) ![Commits](https://img.shields.io/github/commit-activity/w/entmike/disco-diffusion-1)"
      ],
      "metadata": {
        "id": "6na9kgMPXwhg"
      }
    },
    {
      "cell_type": "markdown",
      "source": [
        "#⚠️ Notice ⚠️\n",
        " July 15, 2022 - Pytorch3D magically stopped working (again) on Colab.  Animations will not work in this notebook fork until Facebook/Google fix the version that can be installed in Colab."
      ],
      "metadata": {
        "id": "U-KXLRBw_a1J"
      }
    },
    {
      "cell_type": "markdown",
      "source": [
        "# 💡 About\n",
        "\n",
        "**Run is Optional.**\n",
        "\n",
        "Run this Cell for credits, help, change log, etc."
      ],
      "metadata": {
        "id": "QUWR3e_1dclc"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "import requests\n",
        "from IPython.display import Markdown as md\n",
        "md(requests.get('https://raw.githubusercontent.com/entmike/disco-diffusion-1/main/NOTEBOOK-README.md').text)"
      ],
      "metadata": {
        "id": "to8PjDixXhMw",
        "outputId": "5f972fef-29a4-4bc4-9d69-4fbc900d805d",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 0
        }
      },
      "execution_count": 5,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "<IPython.core.display.Markdown object>"
            ],
            "text/markdown": "## 🙏 Credits/Contributions\n- Inspired from [alembics Notebook](https://colab.research.google.com/github/alembics/disco-diffusion/blob/main/Disco_Diffusion.ipynb) and others.\n\n- Contributions welcomed at [https://github.com/entmike/disco-diffusion-1](https://github.com/entmike/disco-diffusion-1)\n\n- Questions?  Feedback?  Please hunt me down on Discord (`entmike#1926`), or open an Issue in GitHub!\n\n## Links\n- [Zippy's DD Cheatsheet](https://docs.google.com/document/d/1l8s7uS2dGqjztYSjPpzlmXLjl5PM3IGkRWI3IiCuK7g)\n\n- [EZ Charts](https://docs.google.com/document/d/1ORymHm0Te18qKiHnhcdgGp-WSt8ZkLZvow3raiu2DVU)\n\n\n## Changes/Enhancements\n- **July 12, 2022**\n 13 new CLIP models and many more diffusion models have been updated in the entmike/disco-diffusion-1 GitHub fork and entmike/disco-diffusion-1 docker image.  If you use RunPod, entmike/disco-diffusion-1:runpod has the models pre-baked into them as well.\n\n  CLIP\n  -  ViTB32_laion2b_e16\n  -  ViTB32_laion400m_e31\n  -  ViTB32_laion400m_e32\n  -  ViTB32quickgelu_laion400m_e31\n  -  ViTB32quickgelu_laion400m_e32\n  -  ViTB16_laion400m_e31\n  -  ViTB16_laion400m_e32\n  -  RN50_yffcc15m\n  -  RN50_cc12m\n  -  RN50_quickgelu_yfcc15m\n  -  RN50_quickgelu_cc12m\n  -  RN101_yfcc15m\n  -  RN101_quickgelu_yfcc15m\n\n  Diffusion\n  Pixel Art  (Credit https://github.com/KaliYuga-ai/Pixel-Art-Diffusion/blob/e037fd58e2aef58f28d7511ea6dcb184e898e39f/Pixel_Art_Diffusion_v1_0.ipynb)\n  - pixel_art_diffusion_hard_256\n  - pixel_art_diffusion_soft_256\n  - pixelartdiffusion_expanded\n  - pixelartdiffusion4k\n  - PADexpanded\n  - watercolordiffusion\n  - watercolordiffusion_2\n  - PulpSciFiDiffusion\n  - lsun_uncond_100M_1200K_bs128\n  Comic Faces  (Credit: https://huggingface.co/spaces/Gradio-Blocks/clip-guided-faces/blob/main/app.py)\n  - 256x256_openai_comics_faces_by_alex_spirin_084000\n  Ukiyoe  (Credit: https://huggingface.co/thegenerativegeneration/ukiyoe-diffusion-256/tree/main)\n  - ukiyoe_diffusion_256_022000.pt\n  Liminal Spaces (Back Rooms, according to my kids) (Credit: https://colab.research.google.com/drive/11Bs4wCs9R84DVAwDb3MkvDAd8V_Mw1e6?usp=sharing)\n  - liminal_diffusion \n- **July 9, 2022**\n  - Catch up some DD 5.3 features from alembics\n  - Horizontal and Vertical symmetry functionality by nshepperd. Symmetry transformation_steps by huemin (https://twitter.com/huemin_art). Symmetry integration into Disco Diffusion by Dmitrii Tochilkin (https://twitter.com/cut_pow)\n- **May 28, 2022**\n  - Turbo Mode after frame 10 fixed.  (https://github.com/entmike/disco-diffusion-1/issues/8)\n- **May 20, 2022**\n  - Voronoi Diagram introduced as an alternative to perlin noise and init_image as a starting point.  To use, set `init_generator` to `voronoi` (Default is `perlin` to honor default noise behavior)  `voronoi_points` controls how many regions the voronoi procedure creates.  You can also optionally control the palette by specifying a different file in `voronoi_palette`.  Refer to the 2 example yaml files in the new `palettes` folder.  There are currently two modes (`generated` and `static`.)  For static, you specify all your values in the yaml file as in the example in `static.yaml`.  For randomly generated color ranges, refer to `default.yaml` to see how you can control what random color hue ranges will be picked.\n  - Other minor bug fixes and code cleanup.\n- **May 16, 2022**\n  - `prompt_salad` feature implemented.  Make Mad Libs out of a `prompt_salad_template`!\n- **May 14, 2022**\n  - Make this README shared across notebooks (`NOTEBOOK-README.md`)\n- **May 13, 2022**\n  - Implement (very) experimental vertical symmetry.  (Credit: **`aztec_man#3032`** on Discord)\n  - Add GPU detection warning for T4 and V100 GPUs.  (I cannot implement the `!pip install torch==1.10.2 torchvision==0.11.3 -q` patch because it breaks `pytorch3d`, sorry guys, I'll keep trying to find another solution.\n- **May 11, 2022**\n  - Discord link fixed\n- **May 10, 2022**\n  - Fix, then break, then fix again, pytorch3d and 3d animations\n- **May 6, 2022**\n  - Twilio SMS alerts (optional, disabled by default)\n- **May 5, 2022**\n  - sqlite3 DB support to store your params and images for future query/display/searching.\n- **May 4, 2022**\n  - Add fallback URLs to model downloads\n  - Add `init_images` and `images_out` parameters to control directory locations\n  - Add `save_metadata` (Default = `False`) parameter to optionally embed DD params into your .PNGs\n  - Add `multiplier` support.\n- **May 3, 2022**\n  - Add Symmetry Parameters\n  - Modifier Support for Art Studies!\n- **May 2, 2022**\n  - Add initial support for YAML load/export\n  - Add initial logging support\n\n- **April 2022**\n  - All functions moved to `dd.py` that are not needed in the Notebook to reduce clutter and hopefully improve readibility.\n\n  - All other Git repos that used to get cloned and dumped in your Google Drive are now referenced as pip packages.\n\n## Command-Line Support\n\n  After running the **Set Up Environment** cell, from your Google Colab Terminal you can run your Disco Diffusion workload from a terminal or make a `bash` script to do multiple different batches.  Example:\n\n  ```bash\n  cd /content/gdrive/MyDrive/disco-diffusion-1\n  python disco.py --steps=50 --batch_name=\"CommandLineBatch\" --RN50=False \\\n  --text_prompts='{\"0\":[\"A beautiful painting of a dolphin\",\"ocean theme\"]}'\n  ```\n## YAML Support from Terminal\n\n  Use a YAML file to save/change your settings.  (See `examples/configs/lighthouse.yml` for an example structure.)\n   ```bash\n   cd /content/gdrive/MyDrive/disco-diffusion-1\n   python disco.py --config_file=examples/configs/lighthouse.yml\n   ```"
          },
          "metadata": {},
          "execution_count": 5
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "# Set Up Environment\n",
        "\n",
        "**Run is Required.**\n",
        "\n",
        "Expand to set parameters related to location, Git Repo, and Branch to pull Discord Diffusion from."
      ],
      "metadata": {
        "id": "_3sbBihUgaF_"
      }
    },
    {
      "cell_type": "code",
      "execution_count": 6,
      "metadata": {
        "id": "EFWmomp7NLPP",
        "cellView": "form",
        "outputId": "8e50db57-9ba3-4e45-ed1a-e2f9460e7b29",
        "colab": {
          "base_uri": "https://localhost:8080/"
        }
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Current directory: /content/gdrive/MyDrive/disco-diffusion-1\n",
            "📁 Google Drive already mounted.\n",
            "✅ Disco Diffusion root path will be \"/content/gdrive/MyDrive/disco-diffusion-1\"\n",
            "Google Colab detected.\n",
            "📄 Pulling updates from GitHub...\n",
            "\n",
            "M\tdocker/build-dev.sh\n",
            "M\tdocker/build-main.sh\n",
            "M\tdocker/build-runpod.sh\n",
            "M\tdocker/jupyter.sh\n",
            "M\tdocker/start.sh\n",
            "M\tdocker/yaml.sh\n",
            "M\texamples/docker/disco-file.sh\n",
            "M\texamples/docker/disco.sh\n",
            "M\texamples/docker/interactive.sh\n",
            "M\texamples/docker/unittest.sh\n",
            "M\texamples/linux/configfile.sh\n",
            "M\texamples/linux/simple.sh\n",
            "Your branch is up to date with 'origin/main'.\n",
            "\n",
            "Updating 5b292a6..eb0b2e6\n",
            "Fast-forward\n",
            " dd.py | 8 ++++++--\n",
            " 1 file changed, 6 insertions(+), 2 deletions(-)\n",
            "\n",
            "🔍 You have a Tesla P100-PCIE-16GB GPU.\n",
            "📦 Upgrading pyyaml...\n",
            "📦 Installing pip requirements...\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "2022-07-15 22:36:42.368 | WARNING  | dd:<module>:65 - Pytorch 3D not present.  Animations will not work.\n"
          ]
        }
      ],
      "source": [
        "#@title Set Up Environment\n",
        "import os, sys\n",
        "import subprocess, torch\n",
        "\n",
        "#@markdown Leave these as defaults unless you know what you are doing.\n",
        "\n",
        "use_google_drive = True #@param {type:\"boolean\"}\n",
        "save_models = True #@param {type:\"boolean\"}\n",
        "check_for_updates = True #@param {type:\"boolean\"}\n",
        "content_root = '/content'\n",
        "repo = \"https://github.com/entmike/disco-diffusion-1\" #@param {type:\"string\"}\n",
        "branch = \"main\" #@param {type:\"string\"}\n",
        "cwd = os.path.abspath('.')\n",
        "is_local=True\n",
        "\n",
        "if is_local: content_root=cwd\n",
        "print (f'Current directory: {cwd}')\n",
        "\n",
        "if use_google_drive == True:\n",
        "  import os\n",
        "  from google.colab import drive\n",
        "  if os.path.isdir('/content/gdrive') == False:\n",
        "    print(f'📁 Mounting Google Drive.  Please accept any confirmation screens.')\n",
        "    drive.mount('/content/gdrive/')\n",
        "  else:\n",
        "    print(f'📁 Google Drive already mounted.')\n",
        "  content_root = '/content/gdrive/MyDrive'\n",
        "\n",
        "dd_root = f'{content_root}/disco-diffusion-1'\n",
        "\n",
        "print(f'✅ Disco Diffusion root path will be \"{dd_root}\"')\n",
        "\n",
        "is_colab = False\n",
        "try:\n",
        "    from google.colab import drive\n",
        "    print(\"Google Colab detected.\")\n",
        "    is_colab=True\n",
        "except:\n",
        "    print(\"Google Colab not detected.\")\n",
        "    is_colab=False\n",
        "\n",
        "root_path = dd_root\n",
        "\n",
        "# Clone Repo\n",
        "if os.path.isdir(f'{dd_root}') == False:\n",
        "  print(f\"Cloning repo '{repo}' into '{dd_root}'...\")\n",
        "  os.chdir(f'{content_root}')\n",
        "  subprocess.run(f'git clone {repo}'.split(' '), stdout=subprocess.PIPE).stdout.decode(\"utf-8\")\n",
        "\n",
        "os.chdir(f'{dd_root}')\n",
        "if check_for_updates == True:\n",
        "  # Pull any updates\n",
        "  print(f'📄 Pulling updates from GitHub...')\n",
        "  for cmd in ['git clean -df', f'git checkout {branch}', f'git pull origin {branch}']:\n",
        "    gitresults = subprocess.run(f'{cmd}'.split(' '), stdout=subprocess.PIPE).stdout.decode(\"utf-8\")\n",
        "    print(f'{gitresults}')\n",
        "else:\n",
        "  print(\"⚠️ Skipping checking for Git updates\")\n",
        "\n",
        "# Downgrade for T4/V100\n",
        "device_name = torch.cuda.get_device_name(0)\n",
        "print(f\"🔍 You have a {device_name} GPU.\")\n",
        "\n",
        "#Upgrade pyyaml if in Colab\n",
        "if is_colab:\n",
        "    print(f'📦 Upgrading pyyaml...')\n",
        "    subprocess.run(f'pip install --upgrade pyyaml --quiet'.split(' '), stdout=subprocess.PIPE).stdout.decode(\"utf-8\")\n",
        "    \n",
        "    if \"V100\" in device_name or \"T4\" in device_name:\n",
        "      print(f\"⚠️ {torch.cuda.get_device_name(0)} detected.  Do not use ViTL14 or ViTL14@336 models...\")\n",
        "      # This causes problems with pytorch3d sigh... -Mike (5/13/22)\n",
        "      # print(\"📦 Downgrading pytorch...\")\n",
        "      # downgrade_torch = subprocess.run('pip install torch==1.10.2 torchvision==0.11.3 -q'.split(' '), stdout=subprocess.PIPE).stdout.decode('utf-8')\n",
        "      # import torch\n",
        "    \n",
        "    print(f'📦 Installing pip requirements...')\n",
        "    piplog = subprocess.run(f'pip install -r colab-requirements.txt'.split(' '), stdout=subprocess.PIPE).stdout.decode(\"utf-8\")\n",
        "    # print(piplog)\n",
        "    need_pytorch3d=False\n",
        "    try:\n",
        "      import pytorch3d\n",
        "    except ModuleNotFoundError:\n",
        "        need_pytorch3d=True\n",
        "    \n",
        "    # if need_pytorch3d:\n",
        "    #     print(f'📦 Installing pytorch3d package...')\n",
        "    #     if torch.__version__.startswith(\"1.11.\") and sys.platform.startswith(\"linux\"):\n",
        "    #         # We try to install PyTorch3D via a released wheel.\n",
        "    #         pyt_version_str=torch.__version__.split(\"+\")[0].replace(\".\", \"\")\n",
        "    #         version_str=\"\".join([\n",
        "    #             f\"py3{sys.version_info.minor}_cu\",\n",
        "    #             torch.version.cuda.replace(\".\",\"\"),\n",
        "    #             f\"_pyt{pyt_version_str}\"\n",
        "    #         ])\n",
        "    #         subprocess.run(f'pip install fvcore iopath'.split(' '), stdout=subprocess.PIPE).stdout.decode(\"utf-8\")\n",
        "    #         subprocess.run(f'pip install --no-index --no-cache-dir pytorch3d -f https://dl.fbaipublicfiles.com/pytorch3d/packaging/wheels/{version_str}/download.html'.split(' '), stdout=subprocess.PIPE).stdout.decode(\"utf-8\")\n",
        "        # else:\n",
        "        #     # We try to install PyTorch3D from source.\n",
        "        #     !curl -LO https://github.com/NVIDIA/cub/archive/1.10.0.tar.gz\n",
        "        #     !tar xzf 1.10.0.tar.gz\n",
        "        #     os.environ[\"CUB_HOME\"] = os.getcwd() + \"/cub-1.10.0\"\n",
        "        #     !pip install 'git+https://github.com/facebookresearch/pytorch3d.git@stable'\n",
        "\n",
        "# Set base project directory to current working directory\n",
        "PROJECT_DIR = dd_root\n",
        "\n",
        "# Import DD helper modules\n",
        "sys.path.append(PROJECT_DIR)\n",
        "import dd, dd_args\n",
        "\n",
        "# Unsure about these:\n",
        "os.environ[\"KMP_DUPLICATE_LIB_OK\"] = \"TRUE\"\n",
        "# import warnings\n",
        "# warnings.filterwarnings(\"ignore\", category=UserWarning)\n",
        "\n",
        "# print(dd.is_in_notebook())"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "# Parameters\n",
        "\n",
        "**Press Run to Apply Parameter changes.**\n",
        "\n",
        "Expand to see parameters."
      ],
      "metadata": {
        "id": "o42p2jAvhHvp"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "from pydotted import pydot\n",
        "args = pydot({})\n",
        "\n",
        "#@markdown ##💡Batch/Config Parameters\n",
        "#@markdown Specifies the folder name and filenames created in `images_out` to store your images.\n",
        "args.batch_name = \"TimeToDisco\" #@param {type:\"string\"}\n",
        "#@markdown If your batch run gets interrupted (either because you stopped it, or because of a disconnection) you can resume your batch run where you left off using this setting.  However, you MUST not change the settings in the batch, or it cannot reliably be resumed.  Other parameters (`run_to_resume`, `resume_from_frame`, `retain_overwritten_frames`) control how you want the batch to be resumed.  If you have interrupted a run and tweaked settings, you should NOT use `resume_run`, as this would be considered a new run with the new settings.\n",
        "args.resume_run = False #@param {type:\"boolean\"}\n",
        "args.run_to_resume = \"latest\" #@param {type:\"string\"}\n",
        "args.retain_overwritten_frames = False #@param {type:\"boolean\"}\n",
        "#@markdown ## 🔍Preview Settings\n",
        "args.intermediate_saves = 0 #@param {type:\"number\"}\n",
        "args.intermediates_in_subfolder = True #@param {type:\"boolean\"}\n",
        "args.console_preview = False #@param {type:\"boolean\"}\n",
        "args.console_preview_width = 80 #@param {type:\"number\"}\n",
        "args.display_rate = 50 #@param {type:\"number\"}\n",
        "#@markdown Indicates the configuration file to load parameters from.  \n",
        "#@markdown Note that any parameters specified in this notebook will override the configuration in the YAML file.\n",
        "#@markdown If you'd prefer using mostly a configuration file approach, consider [this notebook](https://colab.research.google.com/github/entmike/disco-diffusion-1/blob/main/Simplified_Disco_Diffusion_YAML.ipynb) instead.\n",
        "args.config_file = None #@param {type: \"raw\"}\n",
        "#@markdown Accepts any hard-coded integer as a random seed.  A value of `'random_seed'` will randomly generate a seed at runtime.\n",
        "args.set_seed = 'random_seed' #@param type=\"raw\"\n",
        "#@markdown How many batches to run.  (Ignored with animation modes)\n",
        "args.n_batches = 150 #@param {type:\"number\"}\n",
        "#@markdown Resolution of output image.  Must be a multiple of 64.\n",
        "args.width_height = [1280,768] #@param {type:\"raw\"}\n",
        "#@markdown How many iterations per image are taken\n",
        "args.steps = 250 #@param [25,50,100,150,250,500,1000]{type: 'raw', allow-input: true}\n",
        "#@markdown ## 📝 Prompts Settings\n",
        "args.text_prompts = {\"0\": [\"A beautiful painting of a singular lighthouse, shining its light across a tumultuous sea of blood by greg rutkowski and thomas kinkade, Trending on artstation.\",\"yellow color scheme\"],\"100\": [\"This set of prompts start at frame 100\",\"This prompt has weight five:5\"]} #@param type=\"raw\"\n",
        "#@markdown When enabled, overrides `text_prompts` and uses `prompt_salad_template` to generate text prompt mixes\n",
        "args.prompt_salad = False #@param {type:\"boolean\"}\n",
        "#@markdown Your text prompt mixing template.  Each `{placeholder}` represents an \"ingredient\" in your salad that will draw from a text file in `prompt_salad/`  You can even add a sub-folder such as `{scifi/artists}` which will resolve to filename `{prompt_salad/scifi/artists.txt}` for any personal customizations!\n",
        "args.prompt_salad_template = \"{colors} {things} in the {custom/customword} shape of {shapes}, art by {artists}\" #@param\n",
        "#@markdown How many prompt salads to generate\n",
        "args.prompt_salad_amount = 5 #@param {type:\"number\"}\n",
        "args.fuzzy_prompt = False #@param {type:\"boolean\"}\n",
        "#@markdown ## 🖼️ Init Image Settings\n",
        "#@markdown (Optional) Starting image you wish to use\n",
        "args.init_image = None #@param {type:\"raw\"}\n",
        "args.init_scale = 1000 #@param {type:\"number\"}\n",
        "#@markdown Make sure you set skip_steps to ~50% of your steps if you want to use an init image.\n",
        "args.skip_steps =  0#@param {type:\"number\"}\n",
        "#@markdown ## 💥 Perlin/Voronoi Settings\n",
        "#@markdown Select between Perlin noise or Voronoi diagram as a starting point\n",
        "#@markdown Make sure you set skip_steps to ~25-50% of your steps if you want to use the voronoi diagram.\n",
        "args.init_generator = \"perlin\" # @param [\"perlin\",\"voronoi\"]\n",
        "args.perlin_init = False #@param {type:\"boolean\"}\n",
        "args.perlin_mode = \"mixed\" #@param [\"mixed\", \"color\", \"gray\"]\n",
        "args.voronoi_points = 20 #@param [20,50,100,150,250,500,1000]{type: 'raw', allow-input: true}\n",
        "args.voronoi_palette = 'default.yaml' #@param{type:'string'}\n",
        "#@markdown ## 🧪 (Experimental) Target Image Settings\n",
        "#@markdown Warning: work in progress!\n",
        "args.target_image = None #@param {type:\"raw\"}\n",
        "args.target_scale = 20000 #@param {type:\"number\"}\n",
        "#@markdown ---\n",
        "#@markdown ## 🧠 Models\n",
        "#@markdown These various CLIP models are available for you to use during image generation. Models have different styles or \"flavors\", so look around.\n",
        "#@markdown\n",
        "#@markdown `use_secondary_model` is to use a secondary purpose-made diffusion model to clean up interim diffusion images for CLIP evaluation. If this option is turned off, DD will use the regular (large) diffusion model. Using the secondary model is faster - one user reported a 50% improvement in render speed. However, the secondary model is much smaller, and may reduce image quality and detail. It is suggested that you experiment with this.\n",
        "#@markdown You can mix in multiple models as well for different results. However, keep in mind that some models are extremely memory-hungry, and turning on additional models will take additional memory and may cause a crash.\n",
        "#@markdown\n",
        "#@markdown Default Values and the rough order of speed/mem usage is (smallest/fastest to largest/slowest):\n",
        "args.RN50 = True #@param {type:\"boolean\"}\n",
        "args.RN101 = False #@param {type:\"boolean\"}\n",
        "args.RN50x64 = False #@param {type:\"boolean\"}\n",
        "args.RN50x16 = False #@param {type:\"boolean\"}\n",
        "args.RN50x4 = False #@param {type:\"boolean\"}\n",
        "args.ViTB16 = True #@param {type:\"boolean\"}\n",
        "args.ViTB32 = True #@param {type:\"boolean\"}\n",
        "args.ViTL14 = False #@param {type:\"boolean\"}\n",
        "args.ViTL14_336 = False #@param {type:\"boolean\"}\n",
        "#@markdown Open CLIP Models\n",
        "args.ViTB32_laion2b_e16 = False #@param {type:\"boolean\"}\n",
        "args.ViTB32_laion400m_e31 = False #@param {type:\"boolean\"}\n",
        "args.ViTB32_laion400m_e32 = False #@param {type:\"boolean\"}\n",
        "args.ViTB32quickgelu_laion400m_e31 = False #@param {type:\"boolean\"}\n",
        "args.ViTB32quickgelu_laion400m_e32 = False #@param {type:\"boolean\"}\n",
        "args.ViTB16_laion400m_e31 = False #@param {type:\"boolean\"}\n",
        "args.ViTB16_laion400m_e32 = False #@param {type:\"boolean\"}\n",
        "args.RN50_yffcc15m = False #@param {type:\"boolean\"}\n",
        "args.RN50_cc12m = False #@param {type:\"boolean\"}\n",
        "args.RN50_quickgelu_yfcc15m = False #@param {type:\"boolean\"}\n",
        "args.RN50_quickgelu_cc12m = False #@param {type:\"boolean\"}\n",
        "args.RN101_yfcc15m = False #@param {type:\"boolean\"}\n",
        "args.RN101_quickgelu_yfcc15m = False #@param {type:\"boolean\"}\n",
        "args.use_secondary_model = True #@param {type:\"boolean\"}\n",
        "args.diffusion_model = \"512x512_diffusion_uncond_finetune_008100\" #@param [\"512x512_diffusion_uncond_finetune_008100\",\"256x256_diffusion_uncond\",\"pixel_art_diffusion_soft_256\",\"pixel_art_diffusion_hard_256\",\"256x256_openai_comics_faces_by_alex_spirin_084000\",\"ukiyoe_diffusion_256_022000\",\"pixelartdiffusion_expanded\",\"pixelartdiffusion4k\",\"PADexpanded\",\"watercolordiffusion\",\"watercolordiffusion_2\",\"PulpSciFiDiffusion\",\"liminal_diffusion\",\"lsun_uncond_100M_1200K_bs128\"]\n",
        "args.diffusion_sampling_mode = \"ddim\" #@param [\"ddim\", \"plms\"]\n",
        "args.randomize_class = True #@param {type:\"boolean\"}\n",
        "#@markdown ## ✂️ CLIP settings\n",
        "args.cutn_batches = 4 #@param {type:\"number\"}\n",
        "args.clip_guidance_scale = 5000 #@param {type:\"number\"}\n",
        "args.cut_overview = \"[12]*400+[4]*600\" #@param \n",
        "args.cut_innercut = \"[4]*400+[12]*600\" #@param \n",
        "args.cut_icgray_p = \"[0.2]*400+[0]*600\" #@param \n",
        "args.cut_ic_pow = 1 #@param {type:\"number\"}\n",
        "args.eta = 0.8 #@param {type:\"number\"}\n",
        "args.clamp_grad = True #@param {type:\"boolean\"}\n",
        "args.clamp_max = 0.05 #@param {type:\"number\"}\n",
        "args.clip_denoised = False #@param {type:\"boolean\"}\n",
        "args.rand_mag = 0.05 #@param {type:\"number\"}\n",
        "args.tv_scale = 0 #@param {type:\"number\"}\n",
        "args.range_scale = 150 #@param {type:\"number\"}\n",
        "args.sat_scale = 0 #@param {type:\"number\"}\n",
        "args.skip_augs = False #@param {type:\"boolean\"}\n",
        "#@markdown ## 🎞️ Animation Settings\n",
        "args.animation_mode = \"None\" #@param [\"None\", \"2D\", \"3D\", \"Video Input\"]\n",
        "args.video_init_path = \"training.mp4\" #@param {type:\"string\"}\n",
        "args.extract_nth_frame = 10 #@param {type:\"number\"}\n",
        "args.video_init_seed_continuity = True #@param {type:\"boolean\"}\n",
        "args.key_frames = True #@param {type:\"boolean\"}\n",
        "args.max_frames = 10000 #@param {type:\"number\"}\n",
        "args.interp_spline = \"Linear\" #@param [\"Linear\", \"Quadratic\", \"Cubic\"]\n",
        "args.frames_skip_steps = \"60%\" #@param {type:\"string\"}\n",
        "args.vr_mode = False #@param {type:\"boolean\"}\n",
        "args.angle = '0:(0)' #@param {type:\"string\"}\n",
        "args.zoom = '0:(1),10:(1.05)' #@param {type:\"string\"}\n",
        "args.translation_x = \"0: (0)\" #@param {type:\"string\"}\n",
        "args.translation_y = \"0: (0)\" #@param {type:\"string\"}\n",
        "args.translation_z = \"0: (10.0)\" #@param {type:\"string\"}\n",
        "args.rotation_3d_x = \"0: (0)\" #@param {type:\"string\"}\n",
        "args.rotation_3d_y = \"0: (0)\" #@param {type:\"string\"}\n",
        "args.rotation_3d_z = \"0: (0)\" #@param {type:\"string\"} \n",
        "args.midas_depth_model = \"dpt_large\" #@param {type:\"string\"}\n",
        "args.midas_weight = 0.3 #@param {type:\"number\"}\n",
        "args.near_plane = 0 #@param {type:\"number\"}\n",
        "args.far_plane = 0 #@param {type:\"number\"}\n",
        "args.fov = 0 #@param {type:\"number\"}\n",
        "args.padding_mode = \"border\" #@param {type:\"string\"}\n",
        "args.sampling_mode = \"bicubic\" #@param {type:\"string\"}\n",
        "args.turbo_mode = False #@param {type:\"boolean\"}\n",
        "args.turbo_steps = 3 #@param {type:\"number\"}\n",
        "args.turbo_preroll = 10#@param {type:\"number\"}\n",
        "args.frames_scale = 1500 #@param {type:\"number\"}\n",
        "args.frames_skip_steps = \"60%\" #@param {type:\"string\"}\n",
        "#@markdown ### 🔽 Symmetry Settings\n",
        "args.use_horizontal_symmetry = False #@param {type:\"boolean\"}\n",
        "args.use_vertical_symmetry = False #@param {type:\"boolean\"}\n",
        "args.transformation_percent = [0.09] #@param type=\"raw\"\n",
        "#@markdown ### 📱 Twilio SMS Settings (Optional)\n",
        "#@markdown Tired of babysitting your jobs?  Get a text message to your phone!  See [Twilio](https://www.twilio.com/) site for more info.\n",
        "args.twilio_account_sid = \"\" #@param {\"type\":\"string\"}\n",
        "args.twilio_auth_token = \"\" #@param {\"type\":\"string\"}\n",
        "args.twilio_from = \"\" #@param {\"type\":\"string\"}\n",
        "args.twilio_to = \"\" #@param {\"type\":\"string\"}\n",
        "#@markdown ### ⚙️ Batching and DB Settings\n",
        "args.modifiers = { } #@param type=\"raw\"\n",
        "args.multipliers = { } #@param type=\"raw\"\n",
        "args.save_metadata = False #@param {type:\"boolean\"}\n",
        "args.db = \"/content/gdrive/MyDrive/disco-diffusion-1/disco.db\" #@param {\"type\":\"string\"}\n",
        "#@markdown ### ⚙️ Appendix\n",
        "#@markdown Lesser used options\n",
        "#@markdown\n",
        "#@markdown **`init_images`** specifies the base `init_images` folder to look for any (optional) init images.\n",
        "args.init_images = \"init_images\" #@param {type:\"string\"}\n",
        "#@markdown **`init_images`** specifies the base `images_out` folder to look for your batch output\n",
        "args.images_out = \"images_out\" #@param {type:\"string\"}\n",
        "#@markdown **`model_path`** specifies the folder where your models are downloaded to and used\n",
        "args.model_path = \"models\" #@param {type:\"string\"}\n",
        "#prompt_salad_path Specifies base prompt_salad paths.\n",
        "args.prompt_salad_path = \"prompt_salad\"\n",
        "args.cuda_device = \"cuda:0\"\n",
        "#@markdown **`gen_config`** specifies the name of the generated YAML configuration file that will be saved in `configs` folder.  `AUTO` means the file will be `[batch_name]_gen.yaml` will be used.\n",
        "args.gen_config = \"AUTO\" #@param {type:\"string\"}\n",
        "#@markdown **`gen_config_only`** indicates the configuration only will be generated, and no batch will run.\n",
        "args.gen_config_only = False #@param {type:\"boolean\"}\n",
        "args.use_checkpoint = True #@param {type:\"boolean\"}\n",
        "args.cutout_debug = False #@param {type:\"boolean\"}\n",
        "args.google_drive = False\n",
        "#@markdown image_prompts are supported but are not good.\n",
        "args.image_prompts = { } #@param type=\"raw\""
      ],
      "metadata": {
        "id": "-Rm5thh5NaVd",
        "cellView": "form"
      },
      "execution_count": 7,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "source": [
        "# Start Job\n",
        "\n",
        "**Press Run to Start Job!**"
      ],
      "metadata": {
        "id": "lm_Jz957iBim"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "# Load defaults\n",
        "dd_args.arg_configuration_loader()  # Workaround to do param saving to yaml for now.\n",
        "pargs = args  # Dont run through arg_configuration_loader as it expects CLI.\n",
        "\n",
        "# Setup folders\n",
        "folders = dd.setupFolders(is_colab=dd.detectColab(), PROJECT_DIR=PROJECT_DIR, pargs=pargs)\n",
        "\n",
        "# Load Models\n",
        "dd.loadModels(folders)\n",
        "# Comment this line out if you don't need the OpenCLIP or extra diffusion models...\n",
        "dd.loadModels2(folders)\n",
        "\n",
        "# Report System Details\n",
        "dd.systemDetails(pargs)\n",
        "\n",
        "# Get CUDA Device\n",
        "device = dd.getDevice(pargs)\n",
        "\n",
        "dd.start_run(pargs=pargs, folders=folders, device=device, is_colab=dd.detectColab())"
      ],
      "metadata": {
        "id": "Mnu3_2LvThIZ",
        "outputId": "c8fe23ca-17ba-475a-ccb1-822d37636340",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 1000
        }
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "2022-07-15 22:37:11.127 | DEBUG    | dd_args:arg_configuration_loader:269 - No arguments directly passed.\n",
            "2022-07-15 22:37:11.134 | INFO     | dd_args:arg_configuration_loader:313 - Overriding config file parameter 'f' value to '/root/.local/share/jupyter/runtime/kernel-166914a4-7cc0-48c2-969f-4f89104f4e8c.json' found in CLI.\n",
            "2022-07-15 22:37:11.443 | INFO     | dd_args:arg_configuration_loader:344 - Configuration saved in configs/TimeToDisco_gen.yaml\n",
            "2022-07-15 22:37:11.456 | INFO     | downloadModels:loadModels:146 - Downloading...\n",
            "2022-07-15 22:37:11.467 | SUCCESS  | downloadModels:loadModels:178 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/dpt_large-midas-2f21e586.pt\n",
            "2022-07-15 22:37:11.469 | SUCCESS  | downloadModels:loadModels:178 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/512x512_diffusion_uncond_finetune_008100.pt\n",
            "2022-07-15 22:37:11.472 | SUCCESS  | downloadModels:loadModels:178 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/256x256_diffusion_uncond.pt\n",
            "2022-07-15 22:37:11.474 | SUCCESS  | downloadModels:loadModels:178 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/secondary_model_imagenet_2.pth\n",
            "2022-07-15 22:37:11.477 | SUCCESS  | downloadModels:loadModels:178 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/AdaBins_nyu.pt\n",
            "2022-07-15 22:37:11.479 | SUCCESS  | downloadModels:loadModels:178 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/RN50.pt\n",
            "2022-07-15 22:37:11.482 | SUCCESS  | downloadModels:loadModels:178 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/RN101.pt\n",
            "2022-07-15 22:37:11.485 | SUCCESS  | downloadModels:loadModels:178 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/RN50x4.pt\n",
            "2022-07-15 22:37:11.488 | SUCCESS  | downloadModels:loadModels:178 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/RN50x16.pt\n",
            "2022-07-15 22:37:11.491 | SUCCESS  | downloadModels:loadModels:178 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/RN50x64.pt\n",
            "2022-07-15 22:37:11.494 | SUCCESS  | downloadModels:loadModels:178 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/ViT-B-32.pt\n",
            "2022-07-15 22:37:11.497 | SUCCESS  | downloadModels:loadModels:178 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/ViT-B-16.pt\n",
            "2022-07-15 22:37:11.502 | SUCCESS  | downloadModels:loadModels:178 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/ViT-L-14.pt\n",
            "2022-07-15 22:37:11.505 | SUCCESS  | downloadModels:loadModels:178 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/ViT-L-14-336px.pt\n",
            "2022-07-15 22:37:11.507 | SUCCESS  | downloadModels:loadModels:178 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/vgg16-397923af.pth\n",
            "2022-07-15 22:37:11.510 | SUCCESS  | downloadModels:loadModels:178 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/256x256_openai_comics_faces_by_alex_spirin_084000.pt\n",
            "2022-07-15 22:37:11.517 | SUCCESS  | downloadModels:loadModels:178 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/pixel_art_diffusion_hard_256.pt\n",
            "2022-07-15 22:37:11.519 | SUCCESS  | downloadModels:loadModels:178 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/pixel_art_diffusion_soft_256.pt\n",
            "2022-07-15 22:37:11.522 | SUCCESS  | downloadModels:loadModels:178 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/lsun_uncond_100M_1200K_bs128.pt\n",
            "2022-07-15 22:37:11.528 | SUCCESS  | downloadModels:loadModels:178 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/vit_b_16_plus_240-laion400m_e31-8fb26589.pt\n",
            "2022-07-15 22:37:11.550 | INFO     | downloadModels2:loadModels2:123 - Downloading...\n",
            "2022-07-15 22:37:11.555 | SUCCESS  | downloadModels2:loadModels2:155 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/ukiyoe_diffusion_256_022000.pt\n",
            "2022-07-15 22:37:11.558 | SUCCESS  | downloadModels2:loadModels2:155 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/PADexpanded.pt\n",
            "2022-07-15 22:37:11.561 | SUCCESS  | downloadModels2:loadModels2:155 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/pixelartdiffusion4k.pt\n",
            "2022-07-15 22:37:11.563 | SUCCESS  | downloadModels2:loadModels2:155 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/watercolordiffusion.pt\n",
            "2022-07-15 22:37:11.566 | SUCCESS  | downloadModels2:loadModels2:155 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/watercolordiffusion_2.pt\n",
            "2022-07-15 22:37:11.569 | SUCCESS  | downloadModels2:loadModels2:155 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/PulpSciFiDiffusion.pt\n",
            "2022-07-15 22:37:11.571 | SUCCESS  | downloadModels2:loadModels2:155 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/liminal_diffusion.pt\n",
            "2022-07-15 22:37:11.574 | SUCCESS  | downloadModels2:loadModels2:155 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/rn50-quickgelu-yfcc15m-455df137.pt\n",
            "2022-07-15 22:37:11.576 | SUCCESS  | downloadModels2:loadModels2:155 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/rn50-quickgelu-cc12m-f000538c.pt\n",
            "2022-07-15 22:37:11.579 | SUCCESS  | downloadModels2:loadModels2:155 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/rn101-quickgelu-yfcc15m-3e04b30e.pt\n",
            "2022-07-15 22:37:11.582 | SUCCESS  | downloadModels2:loadModels2:155 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/vit_b_32-laion2b_e16-af8dbd0c.pth\n",
            "2022-07-15 22:37:11.585 | SUCCESS  | downloadModels2:loadModels2:155 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/vit_b_32-quickgelu-laion400m_e31-d867053b.pt\n",
            "2022-07-15 22:37:11.587 | SUCCESS  | downloadModels2:loadModels2:155 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/vit_b_32-quickgelu-laion400m_e32-46683a32.pt\n",
            "2022-07-15 22:37:11.590 | SUCCESS  | downloadModels2:loadModels2:155 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/vit_b_16-laion400m_e31-00efa78f.pt\n",
            "2022-07-15 22:37:11.592 | INFO     | downloadModels2:loadModels2:135 - 🌍 (First time setup): Downloading model from wget https://github.com/mlfoundations/open_clip/releases/download/v0.2-weights/vit_b_16-laion400m_e32-55e67d44.pt to /content/gdrive/MyDrive/disco-diffusion-1/models/vit_b_16-laion400m_e32-55e67d44.pt\n",
            "2022-07-15 22:37:11.599 | ERROR    | downloadModels2:loadModels2:150 - Download failed.  Fallback URLs will be attempted until exhausted.\n",
            "2022-07-15 22:37:11.601 | ERROR    | downloadModels2:loadModels2:152 - 🛑 Could NOT download /content/gdrive/MyDrive/disco-diffusion-1/models/vit_b_16-laion400m_e32-55e67d44.pt from any sources! 🛑\n",
            "2022-07-15 22:37:11.603 | SUCCESS  | downloadModels2:loadModels2:155 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/vit_b_16_plus_240-laion400m_e31-8fb26589.pt\n",
            "2022-07-15 22:37:11.605 | SUCCESS  | downloadModels2:loadModels2:155 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/vit_b_16_plus_240-laion400m_e32-699c4b84.pt\n",
            "2022-07-15 22:37:11.608 | SUCCESS  | downloadModels2:loadModels2:155 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/vit_l_14-laion400m_e31-69988bb6.pt\n",
            "2022-07-15 22:37:11.610 | SUCCESS  | downloadModels2:loadModels2:155 - ✅ Model already downloaded: /content/gdrive/MyDrive/disco-diffusion-1/models/vit_l_14-laion400m_e32-3d133497.pt\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Making sure required models are downloaded\n",
            "Making sure required models are downloaded\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "2022-07-15 22:37:11.724 | INFO     | dd:systemDetails:2578 - Fri Jul 15 22:37:11 2022       \n",
            "+-----------------------------------------------------------------------------+\n",
            "| NVIDIA-SMI 460.32.03    Driver Version: 460.32.03    CUDA Version: 11.2     |\n",
            "|-------------------------------+----------------------+----------------------+\n",
            "| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |\n",
            "| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |\n",
            "|                               |                      |               MIG M. |\n",
            "|===============================+======================+======================|\n",
            "|   0  Tesla P100-PCIE...  Off  | 00000000:00:04.0 Off |                    0 |\n",
            "| N/A   37C    P0    28W / 250W |      2MiB / 16280MiB |      0%      Default |\n",
            "|                               |                      |                  N/A |\n",
            "+-------------------------------+----------------------+----------------------+\n",
            "                                                                               \n",
            "+-----------------------------------------------------------------------------+\n",
            "| Processes:                                                                  |\n",
            "|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |\n",
            "|        ID   ID                                                   Usage      |\n",
            "|=============================================================================|\n",
            "|  No running processes found                                                 |\n",
            "+-----------------------------------------------------------------------------+\n",
            "\n",
            "2022-07-15 22:37:11.727 | INFO     | dd:getDevice:2590 - ✅ Using device: cuda:0\n",
            "2022-07-15 22:37:11.730 | INFO     | dd:start_run:2288 - 💼 1 jobs found.\n",
            "2022-07-15 22:37:11.988 | INFO     | dd:start_run:2300 - ⚒️ Session 176b75cf-9e41-40a7-a926-aaed30b7738b started...\n",
            "2022-07-15 22:37:11.991 | INFO     | dd:start_run:2303 - 💼 Processing job 1 of 1...\n",
            "2022-07-15 22:37:11.994 | INFO     | dd:start_run:2306 - 🌲 Setting TORCH_HOME environment variable to models...\n",
            "2022-07-15 22:37:12.000 | INFO     | dd:processBatch:2411 - 🌱 Randomly using seed: 3101453846\n",
            "2022-07-15 22:37:12.004 | INFO     | dd:free_mem:76 - Clearing CUDA cache on cuda:0...\n",
            "2022-07-15 22:37:12.008 | INFO     | dd:do_run:1191 - 💻 Starting Run: TimeToDisco(3) at frame 0\n",
            "2022-07-15 22:37:12.009 | INFO     | dd:clipLoad:1177 - 🤖 Loading model 'ViT-B/32'...\n"
          ]
        }
      ]
    }
  ]
}