basics-sessions/BasicsV_Pytorch_and_Tensorflow.ipynb

{
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "6SPnWRPay8ky"
      },
      "source": [
        "\n",
        "# Basics V - PyTorch and Tensorflow\n",
        "\n",
        "PyTorch and Tensorflow are the most well-known libraries for implementing, training, and running inference for deep models. In this tutorial, we will learn the basic principles of these frameworks and glance at an example of a classification task for biomedical image data.\n",
        "\n",
        "&nbsp;\n",
        "\n",
        "<center>\n",
        "<img src=\"https://drive.google.com/uc?export=view&id=1MptZuXd56MpYRanv3wGMRBddITe6jXz_\" width=\"200\" hspace=\"30\" vspace=\"11\">\n",
        "<img src=\"https://drive.google.com/uc?export=view&id=1x6KzXrHB6CT0fMV1Tm-41FR4c7lI_Omk\" width=\"200\" hspace=\"30\">\n",
        "\n",
        "</center>\n",
        "\n",
        "\n",
        "\n",
        "\n",
        "\n",
        "&nbsp;\n",
        "\n",
        "Some differences between the two platforms may sway you into learning one or the other if you have not a preferred one already. PyTorch often feels more flexible, pythonic, and lighter than TensorFlow. Someone used to the python programming language may find it easier to learn. In contrast, Tensorflow has better visualization features with tensorboard and facilitates moving models from development to production. Over the years, these differences have been attenuated, with TensorFlow's eager execution, PyTorch's support of tensorboard, among other factors.\n",
        "\n",
        "&nbsp;\n",
        "\n",
        "**There are many materials which you can use to learn any of this frameworks.**\n",
        "\n",
        "We recommend you follow [this one](https://pytorch.org/tutorials/beginner/deep_learning_60min_blitz.html) for PyTorch.\n",
        "\n",
        "You might also want to check [this one](https://www.tensorflow.org/tutorials/keras/classification) out if you want to learn Tensorflow.\n",
        "\n",
        "\n",
        "\n",
        "### Outline\n",
        "\n",
        "\n",
        "1.   The Must-haves of a deep learning framework\n",
        "2.   Melanoma diagnosis with MobileNet in PyTorch"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "yTgXGnGhHjuK"
      },
      "source": [
        "## 1. Must-haves of a deep learning framework\n",
        "\n",
        "In a way, Tensorflow and PyTorch are similar to numpy or other frameworks which you may be familiar with. We can use these libraries to do operations with vectors, such as pointwise operations, matrix multiplications, and others.\n",
        "\n",
        "Run the code below for each of the three frameworks and check the result is the same for all frameworks."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "WjUQOMx8K4e6",
        "outputId": "7adef9f1-1eea-4d9d-eb13-3e67d4a27c6e"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Using torch:\n",
            " tensor([[ 2.,  4.,  6.],\n",
            "        [ 4.,  8., 12.],\n",
            "        [ 6., 12., 18.]])\n"
          ]
        }
      ],
      "source": [
        "import numpy as np\n",
        "import torch\n",
        "import tensorflow as tf\n",
        "\n",
        "framework = \"torch\"\n",
        "\n",
        "if framework == \"tensorflow\":\n",
        "  a = np.array([1,2,3], dtype=np.float32).reshape([3, 1])\n",
        "  b = a * 2\n",
        "  result = np.dot(a, b.T)\n",
        "\n",
        "elif framework == \"torch\":\n",
        "  a = torch.tensor([1,2,3], dtype=torch.float32).view([3, 1])\n",
        "  b = a * 2\n",
        "  result = torch.matmul(a, b.T)\n",
        "\n",
        "elif framework == \"tensorflow\":\n",
        "  a = tf.reshape(tf.constant([1,2,3], dtype=tf.float32), [3, 1])\n",
        "  b = a * 2\n",
        "  result = tf.matmul(a, tf.transpose(b))\n",
        "\n",
        "print(f\"Using {framework}:\\n\", result)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "5soc4CTaK5uK"
      },
      "source": [
        "However, when it comes to deep learning frameworks, there are a few critical must-have functionalities. Typically, neural networks are composed of **many simple functions/layers** put together in an architecture. These are optimized using **gradient descent**, where gradients are calculated using **backpropagation**. Also, models are run for many iterations, increasing execution performance's importance. Typically this is addressed by the use of GPUs, which provide critical speedups for machine learning models.\n",
        "\n",
        "&nbsp;\n",
        "\n",
        "<center>\n",
        "<img src=\"https://drive.google.com/uc?export=view&id=1Hh-HJwXQdAm2mESorc5V8dFi7I_Hb7b2\" width=\"350\" hspace=\"30\">\n",
        "</center>\n",
        "\n",
        "&nbsp;\n",
        "\n",
        "These frameworks' two main advantages over NumPy are automatic differentiation and GPU acceleration. Additionally, the fact that common operations and models are already implemented is an important feature we will cover later."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "khuBZAbHTXTY"
      },
      "source": [
        "### Automatic Differentiation\n",
        "\n",
        "Contrary to NumPy, every operation in PyTorch and TensorFlow has a gradient function that can be easily accessed. Further, when composing several operations, the frameworks keep track of the computational graph so that we can compute the gradient for all the parameters used in the process. This feature is called automatic differentiation and relies on the backpropagation technique.\n",
        "\n",
        "The syntax used to compute the gradient is different for Pytorch and TensorFlow:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "6zY2Bth0TaHK",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "64ac2646-1425-44b5-f4a6-0f3aa3288333"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "PyTorch\n",
            "\tInitially: None\n",
            "\tAfter backward:\n",
            " tensor([[[[0.0244, 0.0289, 0.0114],\n",
            "          [0.0247, 0.0282, 0.0122],\n",
            "          [0.0240, 0.0333, 0.0096]]]])\n",
            "TensorFlow\n",
            "\tAfter backward:\n",
            " tf.Tensor(\n",
            "[[0.02437484 0.02889138 0.01139389]\n",
            " [0.02473907 0.02821025 0.01217808]\n",
            " [0.02396985 0.03328163 0.00958177]], shape=(3, 3), dtype=float32)\n"
          ]
        }
      ],
      "source": [
        "import numpy as np\n",
        "img_base = np.random.randn(1, 1, 20, 20).astype(np.float32)\n",
        "w_base = np.random.randn(1, 1, 3, 3).astype(np.float32)\n",
        "\n",
        "# PyTorch\n",
        "import torch\n",
        "img = torch.tensor(img_base)\n",
        "w = torch.tensor(w_base, requires_grad=True)  # we create a tensor that requires gradient\n",
        "out = torch.nn.functional.conv2d(img, w)                      # operation 1\n",
        "out = torch.mean(out)                                         # operation 2\n",
        "\n",
        "print(\"PyTorch\")\n",
        "print(\"\\tInitially:\", w.grad)\n",
        "out.backward()\n",
        "print(\"\\tAfter backward:\\n\", w.grad)\n",
        "\n",
        "# TensorFlow\n",
        "import tensorflow as tf\n",
        "img = tf.constant(img_base.transpose([0, 2, 3, 1]))\n",
        "w = tf.Variable(w_base.transpose([2, 3, 0, 1]))\n",
        "\n",
        "with tf.GradientTape() as tape:\n",
        "  out = tf.nn.conv2d(img, w, 1, \"VALID\")                       # operation 1\n",
        "  out = tf.math.reduce_mean(out)                               # operation 2\n",
        "\n",
        "grad = tape.gradient(out, w)\n",
        "print(\"TensorFlow\")\n",
        "print(\"\\tAfter backward:\\n\", grad[:,:,0,0])"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "4SfFnzJu55xC"
      },
      "source": [
        "By now, you have probably noticed some differences between the implementation of the two platforms. In PyTorch, we do not need a context to let the platform know that we are interested in computing the gradients later. It is assumed that we will do it, so the computational graph is saved by default. Note that the **tape.gradient** method can be used with multiple variables (e.g., **tape.gradient(loss, list_of_trainable_variables)**).\n",
        "\n",
        "&nbsp;\n",
        "\n",
        "Notice also the difference in the default format of the filter and the input image:\n",
        "\n",
        "| Syntax      | Input      | Filters |\n",
        "| ----------- | -----------|---------|\n",
        "| PyTorch     | [N,C,H,W]      |[C1,C2,H,W,]     |\n",
        "| TensorFlow  | [N,H,W,C]       |[H,W,C1,C2]     |\n",
        "\n",
        "&nbsp;\n",
        "\n",
        "\n",
        "By default, the gradients in PyTorch are accumulated, i.e., summed to **.grad** field, rather than set. This means that if you do not zero out the **.grad** field, the result of the backward operation will not be the correct gradient. Tipically we use a method that zeros out all tracked variables as seen in a later part of this tutorial. But for illustration, let's check the code below. Feel free to uncomment the two lines that set the gradient to zero."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "-4lKdERg_NvZ",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "314968d4-5383-40de-c2b1-686487b4c2e5"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "\tAfter backward 1:\n",
            " tensor([[[[-0.0097,  0.0028, -0.0164],\n",
            "          [-0.0099,  0.0030, -0.0271],\n",
            "          [ 0.0090,  0.0173, -0.0001]]]])\n",
            "\tAfter backward 2:\n",
            " tensor([[[[-0.0194,  0.0055, -0.0329],\n",
            "          [-0.0198,  0.0060, -0.0541],\n",
            "          [ 0.0179,  0.0345, -0.0002]]]])\n",
            "\tAfter backward 3:\n",
            " tensor([[[[-0.0291,  0.0083, -0.0493],\n",
            "          [-0.0297,  0.0090, -0.0812],\n",
            "          [ 0.0269,  0.0518, -0.0003]]]])\n"
          ]
        }
      ],
      "source": [
        "import numpy as np\n",
        "img_base = np.random.randn(1, 1, 20, 20).astype(np.float32)\n",
        "w_base = np.random.randn(1, 1, 3, 3).astype(np.float32)\n",
        "\n",
        "# PyTorch\n",
        "import torch\n",
        "img = torch.tensor(img_base)\n",
        "w = torch.tensor(w_base, requires_grad=True)  # we create a tensor that requires gradient\n",
        "\n",
        "for i in range(3):\n",
        "  out = torch.nn.functional.conv2d(img, w)                      # operation 1\n",
        "  out = torch.mean(out)                                         # operation 2\n",
        "  #if w.grad is not None:\n",
        "  #  w.grad.data.zero_()\n",
        "  out.backward()\n",
        "  print(f\"\\tAfter backward {i+1}:\\n\", w.grad)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "xbuSGQaY_M96"
      },
      "source": [
        "Finally, it is important to note that in some cases you do not care about the gradient, you just need to run the model. In those cases, for performance you can disable the gradient, as shown in the next example. Feel free to try to obtain the gradients and check the errors returned."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "K41aZ5U39kd7"
      },
      "outputs": [],
      "source": [
        "import numpy as np\n",
        "img_base = np.random.randn(1, 1, 20, 20).astype(np.float32)\n",
        "w_base = np.random.randn(1, 1, 3, 3).astype(np.float32)\n",
        "\n",
        "# PyTorch\n",
        "import torch\n",
        "img = torch.tensor(img_base)\n",
        "w = torch.tensor(w_base, requires_grad=True)  # we create a tensor that requires gradient\n",
        "with torch.no_grad():\n",
        "  out = torch.nn.functional.conv2d(img, w)                      # operation 1\n",
        "  out = torch.mean(out)                                         # operation 2\n",
        "\n",
        "#out.backward()\n",
        "\n",
        "\n",
        "# TensorFlow\n",
        "import tensorflow as tf\n",
        "img = tf.constant(img_base.transpose([0, 2, 3, 1]))\n",
        "w = tf.Variable(w_base.transpose([2, 3, 0, 1]))\n",
        "out = tf.nn.conv2d(img, w, 1, \"VALID\")                          # operation 1\n",
        "out = tf.math.reduce_mean(out)                                  # operation 2\n",
        "\n",
        "# Notice that if we use tape, we are reusing the variable of the previous example.\n",
        "# Therefore, we renamed it in this example to new_tape\n",
        "\n",
        "#grad = new_tape.gradient(out, w)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "Bco6Ft2CTaOq"
      },
      "source": [
        "### GPU Acceleration\n",
        "\n",
        "Deep learning models are optimized iteratively over the training data. The forward and backward passes can run millions of times for a model trained from scratch. Computationally and environmentally, this is a heavy burden [carbon footprint](https://mlco2.github.io/impact/).\n",
        "\n",
        "&nbsp;\n",
        "\n",
        "<center>\n",
        "<img src=\"https://drive.google.com/uc?export=view&id=1pB1hZiSjmHn9eMsETi4HvrUVLNrXTG5J\" width=\"400\" hspace=\"30\">\n",
        "\n",
        "Performance comparison between different processors, according to [here](https://developer.nvidia.com/blog/inference-next-step-gpu-accelerated-deep-learning/).\n",
        "</center>\n",
        "\n",
        "&nbsp;\n",
        "\n",
        "Hardware has become one of the most critical factors in developing deep learning models. Both PyTorch and TensorFlow provide excellent support for the use of GPUs. In the following example, we will repeat the operations above but this time using GPU execution. For this part of the tutorial, please ensure that in the upper menu, you select **Runtime** and then **Change runtime time**. When collab prompts you, please select GPU.\n",
        "\n",
        "&nbsp;\n",
        "\n",
        "GPU acceleration is internally supported using CUDA on both frameworks. Although not covered here, you can also use this programming interface to implement your own operations. Notice however that this requires a much more lower-level knowledge than what is required to learn PyTorch and TensorFlow."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "WqpkpY5tTeTP",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "78dc18b2-7b69-45f0-e8b6-f4e5634a1b05"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "PyTorch after computation: cuda:0\n",
            "PyTorch moving to cpu: cpu\n",
            "Tensorflow device used: /job:localhost/replica:0/task:0/device:GPU:0\n"
          ]
        }
      ],
      "source": [
        "import numpy as np\n",
        "img_base = np.random.randn(1, 1, 20, 20).astype(np.float32)\n",
        "w_base = np.random.randn(1, 1, 3, 3).astype(np.float32)\n",
        "\n",
        "device = \"cuda:0\"\n",
        "# PyTorch\n",
        "import torch\n",
        "img = torch.tensor(img_base)\n",
        "w = torch.tensor(w_base, requires_grad=True)\n",
        "img = img.to(device)\n",
        "w = w.to(device)\n",
        "\n",
        "out = torch.nn.functional.conv2d(img, w)                      # operation 1\n",
        "out = torch.mean(out)                                         # operation 2\n",
        "print(\"PyTorch after computation:\", out.device)\n",
        "print(\"PyTorch moving to cpu:\", out.detach().cpu().device)\n",
        "\n",
        "# TensorFlow\n",
        "import tensorflow as tf\n",
        "img = tf.constant(img_base.transpose([0, 2, 3, 1]))\n",
        "w = tf.Variable(w_base.transpose([2, 3, 0, 1]))\n",
        "\n",
        "\n",
        "with tf.GradientTape() as tape:\n",
        "  #with tf.device('/CPU:0'):\n",
        "    out = tf.nn.conv2d(img, w, 1, \"VALID\")                       # operation 1\n",
        "    out = tf.math.reduce_mean(out)                               # operation 2\n",
        "\n",
        "print(\"Tensorflow device used:\", out.device)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "cloWRKbCNiy6"
      },
      "source": [
        "As you can see, TensorFlow already uses the GPU by default. If we want, we can explicitly set the device. In PyTorch, operations are performed in the device where all the tensors are. In the example above, we set the input image and filter to the cuda:0 device. Then, any operation using these two inputs runs on cuda:0. PyTorch will raise an error if one input is on the GPU and another on the CPU. Let us test the speed-ups we can obtain by using this strategy."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "56wmRn2FOpLp",
        "outputId": "2f4eccb4-67f5-4c2b-9b73-174b2ac09efe"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "PyTorch on CPU (time in s):  0.193±0.045\n",
            "PyTorch on GPU (time in s):  0.097±0.102\n",
            "TensorFlow on CPU (time in s):  0.127±0.099\n",
            "TensorFlow on GPU (time in s):  0.095±0.102\n"
          ]
        }
      ],
      "source": [
        "from time import time\n",
        "import numpy as np\n",
        "import torch\n",
        "import tensorflow as tf\n",
        "\n",
        "\n",
        "n1 = 2048\n",
        "n2 = 2048\n",
        "n3 = 2048\n",
        "iterations = 100\n",
        "t = time()\n",
        "time_list = []\n",
        "\n",
        "def count_time(func):\n",
        "  for i in range(iterations):\n",
        "    func()\n",
        "    if i!=0:\n",
        "      time_list.append(time()-t)\n",
        "    t = time()\n",
        "  return \"{:.3f}\".format(np.mean(time_list)) + u\"\\u00B1\" +  \"{:.3f}\".format(np.std(time_list))\n",
        "\n",
        "torch_cpu = lambda : torch.matmul(torch.rand(n1, n2, device=\"cpu\"), torch.rand(n2, n3, device=\"cpu\"))\n",
        "torch_gpu = lambda : torch.matmul(torch.rand(n1, n2, device=\"cuda:0\"), torch.rand(n2, n3, device=\"cuda:0\")) \n",
        "tf_code = lambda : tf.linalg.matmul(tf.random.uniform((n1, n2)), tf.random.uniform((n2, n3)))\n",
        "\n",
        "print(f\"PyTorch on CPU (time in s): \", count_time(torch_cpu))\n",
        "print(f\"PyTorch on GPU (time in s): \", count_time(torch_gpu))\n",
        "\n",
        "with tf.device('/CPU:0'):\n",
        "  print(f\"TensorFlow on CPU (time in s): \", count_time(tf_code))\n",
        "\n",
        "with tf.device('/GPU:0'):\n",
        "  print(f\"TensorFlow on GPU (time in s): \", count_time(tf_code))"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "cmKQso75ToIE"
      },
      "source": [
        "It is important to mention that depending on the hardware you have, this speedup may be more or less significative. In a platform like colab we have little control over this. Feel free to run this example on other machines and evaluate the impact of using a GPU. You can also add other functions, such as the very common convolution operation."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "tQ0er23yTdy1"
      },
      "source": [
        "### Common Operations and Architectures\n",
        "\n",
        "On top of these low-level features, both PyTorch and Tensorflow already provide widely tested implementations of standard functions, layers, and models. We will quickly go over some of them.\n",
        "\n",
        "&nbsp;\n",
        "\n",
        "#### <center> Packages </center>\n",
        "\n",
        "| Functionality     | PyTorch    | TensorFlow |\n",
        "| ----------- | -----------|------------|\n",
        "| Layers | torch.nn |tf.keras.layers|\n",
        "| Datasets | torchvision.datasets (separate)|tf.keras.datasets|\n",
        "| Optimizers | torch.optim |tf.keras.optimizers|\n",
        "| Metrics | torchmetrics (separate) |tf.keras.metrics|\n",
        "| Losses | torch.nn |tf.keras.losses|\n",
        "\n",
        "\n",
        "#### <center> Models </center>\n",
        "##### Image Classification\n",
        "\n",
        "\n",
        "| Model      | PyTorch      | TensorFlow |\n",
        "| ----------- | -----------|---------|\n",
        "| VGG16     | torchvision.models.vgg16(pretrained=True)      | tf.keras.applications.VGG16(weights=\"imagenet\")    |\n",
        "| ResNet-50  | torchvision.models.resnet50(pretrained=True)       |tf.keras.applications.ResNet50(weights=\"imagenet\")     |\n",
        "| DenseNet-169  | torchvision.models.densenet169(pretrained=True)       |tf.keras.applications.DenseNet169(weights=\"imagenet\")    |\n",
        "| ConvNeXt-base  | torchvision.models.convnext_base(pretrained=True)        |tf.keras.applications.convnext.ConvNeXtBase(weights=\"imagenet\")     |\n",
        "\n",
        "&nbsp;\n",
        "\n",
        "Additionally, PyTorch and TensorFlow provide hubs where models can be uploaded and downloaded. These repositories have a lot of different architectures, trained with different configurations. You can quickly glance over the following examples to load a detection model in each framework."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "tTQ9z4xN604C",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "e84d85e7-68f2-4408-fee2-cb19d3167e11"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "<tensorflow.python.saved_model.load.Loader._recreate_base_user_object.<locals>._UserObject object at 0x7f0fef8361d0>\n",
            "Looking in indexes: https://pypi.org/simple, https://us-python.pkg.dev/colab-wheels/public/simple/\n",
            "Collecting yacs\n",
            "  Downloading yacs-0.1.8-py3-none-any.whl (14 kB)\n",
            "Requirement already satisfied: PyYAML in /usr/local/lib/python3.7/dist-packages (from yacs) (3.13)\n",
            "Installing collected packages: yacs\n",
            "Successfully installed yacs-0.1.8\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "Downloading: \"https://github.com/hustvl/yolop/archive/main.zip\" to /root/.cache/torch/hub/main.zip\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "MCnet(\n",
            "  (model): Sequential(\n",
            "    (0): Focus(\n",
            "      (conv): Conv(\n",
            "        (conv): Conv2d(12, 32, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n",
            "        (bn): BatchNorm2d(32, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "        (act): Hardswish()\n",
            "      )\n",
            "    )\n",
            "    (1): Conv(\n",
            "      (conv): Conv2d(32, 64, kernel_size=(3, 3), stride=(2, 2), padding=(1, 1), bias=False)\n",
            "      (bn): BatchNorm2d(64, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "      (act): Hardswish()\n",
            "    )\n",
            "    (2): BottleneckCSP(\n",
            "      (cv1): Conv(\n",
            "        (conv): Conv2d(64, 32, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "        (bn): BatchNorm2d(32, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "        (act): Hardswish()\n",
            "      )\n",
            "      (cv2): Conv2d(64, 32, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "      (cv3): Conv2d(32, 32, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "      (cv4): Conv(\n",
            "        (conv): Conv2d(64, 64, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "        (bn): BatchNorm2d(64, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "        (act): Hardswish()\n",
            "      )\n",
            "      (bn): BatchNorm2d(64, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "      (act): LeakyReLU(negative_slope=0.1, inplace=True)\n",
            "      (m): Sequential(\n",
            "        (0): Bottleneck(\n",
            "          (cv1): Conv(\n",
            "            (conv): Conv2d(32, 32, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(32, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "          (cv2): Conv(\n",
            "            (conv): Conv2d(32, 32, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(32, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "        )\n",
            "      )\n",
            "    )\n",
            "    (3): Conv(\n",
            "      (conv): Conv2d(64, 128, kernel_size=(3, 3), stride=(2, 2), padding=(1, 1), bias=False)\n",
            "      (bn): BatchNorm2d(128, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "      (act): Hardswish()\n",
            "    )\n",
            "    (4): BottleneckCSP(\n",
            "      (cv1): Conv(\n",
            "        (conv): Conv2d(128, 64, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "        (bn): BatchNorm2d(64, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "        (act): Hardswish()\n",
            "      )\n",
            "      (cv2): Conv2d(128, 64, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "      (cv3): Conv2d(64, 64, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "      (cv4): Conv(\n",
            "        (conv): Conv2d(128, 128, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "        (bn): BatchNorm2d(128, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "        (act): Hardswish()\n",
            "      )\n",
            "      (bn): BatchNorm2d(128, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "      (act): LeakyReLU(negative_slope=0.1, inplace=True)\n",
            "      (m): Sequential(\n",
            "        (0): Bottleneck(\n",
            "          (cv1): Conv(\n",
            "            (conv): Conv2d(64, 64, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(64, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "          (cv2): Conv(\n",
            "            (conv): Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(64, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "        )\n",
            "        (1): Bottleneck(\n",
            "          (cv1): Conv(\n",
            "            (conv): Conv2d(64, 64, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(64, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "          (cv2): Conv(\n",
            "            (conv): Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(64, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "        )\n",
            "        (2): Bottleneck(\n",
            "          (cv1): Conv(\n",
            "            (conv): Conv2d(64, 64, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(64, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "          (cv2): Conv(\n",
            "            (conv): Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(64, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "        )\n",
            "      )\n",
            "    )\n",
            "    (5): Conv(\n",
            "      (conv): Conv2d(128, 256, kernel_size=(3, 3), stride=(2, 2), padding=(1, 1), bias=False)\n",
            "      (bn): BatchNorm2d(256, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "      (act): Hardswish()\n",
            "    )\n",
            "    (6): BottleneckCSP(\n",
            "      (cv1): Conv(\n",
            "        (conv): Conv2d(256, 128, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "        (bn): BatchNorm2d(128, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "        (act): Hardswish()\n",
            "      )\n",
            "      (cv2): Conv2d(256, 128, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "      (cv3): Conv2d(128, 128, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "      (cv4): Conv(\n",
            "        (conv): Conv2d(256, 256, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "        (bn): BatchNorm2d(256, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "        (act): Hardswish()\n",
            "      )\n",
            "      (bn): BatchNorm2d(256, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "      (act): LeakyReLU(negative_slope=0.1, inplace=True)\n",
            "      (m): Sequential(\n",
            "        (0): Bottleneck(\n",
            "          (cv1): Conv(\n",
            "            (conv): Conv2d(128, 128, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(128, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "          (cv2): Conv(\n",
            "            (conv): Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(128, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "        )\n",
            "        (1): Bottleneck(\n",
            "          (cv1): Conv(\n",
            "            (conv): Conv2d(128, 128, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(128, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "          (cv2): Conv(\n",
            "            (conv): Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(128, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "        )\n",
            "        (2): Bottleneck(\n",
            "          (cv1): Conv(\n",
            "            (conv): Conv2d(128, 128, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(128, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "          (cv2): Conv(\n",
            "            (conv): Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(128, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "        )\n",
            "      )\n",
            "    )\n",
            "    (7): Conv(\n",
            "      (conv): Conv2d(256, 512, kernel_size=(3, 3), stride=(2, 2), padding=(1, 1), bias=False)\n",
            "      (bn): BatchNorm2d(512, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "      (act): Hardswish()\n",
            "    )\n",
            "    (8): SPP(\n",
            "      (cv1): Conv(\n",
            "        (conv): Conv2d(512, 256, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "        (bn): BatchNorm2d(256, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "        (act): Hardswish()\n",
            "      )\n",
            "      (cv2): Conv(\n",
            "        (conv): Conv2d(1024, 512, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "        (bn): BatchNorm2d(512, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "        (act): Hardswish()\n",
            "      )\n",
            "      (m): ModuleList(\n",
            "        (0): MaxPool2d(kernel_size=5, stride=1, padding=2, dilation=1, ceil_mode=False)\n",
            "        (1): MaxPool2d(kernel_size=9, stride=1, padding=4, dilation=1, ceil_mode=False)\n",
            "        (2): MaxPool2d(kernel_size=13, stride=1, padding=6, dilation=1, ceil_mode=False)\n",
            "      )\n",
            "    )\n",
            "    (9): BottleneckCSP(\n",
            "      (cv1): Conv(\n",
            "        (conv): Conv2d(512, 256, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "        (bn): BatchNorm2d(256, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "        (act): Hardswish()\n",
            "      )\n",
            "      (cv2): Conv2d(512, 256, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "      (cv3): Conv2d(256, 256, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "      (cv4): Conv(\n",
            "        (conv): Conv2d(512, 512, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "        (bn): BatchNorm2d(512, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "        (act): Hardswish()\n",
            "      )\n",
            "      (bn): BatchNorm2d(512, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "      (act): LeakyReLU(negative_slope=0.1, inplace=True)\n",
            "      (m): Sequential(\n",
            "        (0): Bottleneck(\n",
            "          (cv1): Conv(\n",
            "            (conv): Conv2d(256, 256, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(256, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "          (cv2): Conv(\n",
            "            (conv): Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(256, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "        )\n",
            "      )\n",
            "    )\n",
            "    (10): Conv(\n",
            "      (conv): Conv2d(512, 256, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "      (bn): BatchNorm2d(256, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "      (act): Hardswish()\n",
            "    )\n",
            "    (11): Upsample(scale_factor=2.0, mode=nearest)\n",
            "    (12): Concat()\n",
            "    (13): BottleneckCSP(\n",
            "      (cv1): Conv(\n",
            "        (conv): Conv2d(512, 128, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "        (bn): BatchNorm2d(128, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "        (act): Hardswish()\n",
            "      )\n",
            "      (cv2): Conv2d(512, 128, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "      (cv3): Conv2d(128, 128, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "      (cv4): Conv(\n",
            "        (conv): Conv2d(256, 256, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "        (bn): BatchNorm2d(256, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "        (act): Hardswish()\n",
            "      )\n",
            "      (bn): BatchNorm2d(256, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "      (act): LeakyReLU(negative_slope=0.1, inplace=True)\n",
            "      (m): Sequential(\n",
            "        (0): Bottleneck(\n",
            "          (cv1): Conv(\n",
            "            (conv): Conv2d(128, 128, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(128, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "          (cv2): Conv(\n",
            "            (conv): Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(128, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "        )\n",
            "      )\n",
            "    )\n",
            "    (14): Conv(\n",
            "      (conv): Conv2d(256, 128, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "      (bn): BatchNorm2d(128, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "      (act): Hardswish()\n",
            "    )\n",
            "    (15): Upsample(scale_factor=2.0, mode=nearest)\n",
            "    (16): Concat()\n",
            "    (17): BottleneckCSP(\n",
            "      (cv1): Conv(\n",
            "        (conv): Conv2d(256, 64, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "        (bn): BatchNorm2d(64, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "        (act): Hardswish()\n",
            "      )\n",
            "      (cv2): Conv2d(256, 64, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "      (cv3): Conv2d(64, 64, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "      (cv4): Conv(\n",
            "        (conv): Conv2d(128, 128, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "        (bn): BatchNorm2d(128, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "        (act): Hardswish()\n",
            "      )\n",
            "      (bn): BatchNorm2d(128, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "      (act): LeakyReLU(negative_slope=0.1, inplace=True)\n",
            "      (m): Sequential(\n",
            "        (0): Bottleneck(\n",
            "          (cv1): Conv(\n",
            "            (conv): Conv2d(64, 64, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(64, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "          (cv2): Conv(\n",
            "            (conv): Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(64, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "        )\n",
            "      )\n",
            "    )\n",
            "    (18): Conv(\n",
            "      (conv): Conv2d(128, 128, kernel_size=(3, 3), stride=(2, 2), padding=(1, 1), bias=False)\n",
            "      (bn): BatchNorm2d(128, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "      (act): Hardswish()\n",
            "    )\n",
            "    (19): Concat()\n",
            "    (20): BottleneckCSP(\n",
            "      (cv1): Conv(\n",
            "        (conv): Conv2d(256, 128, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "        (bn): BatchNorm2d(128, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "        (act): Hardswish()\n",
            "      )\n",
            "      (cv2): Conv2d(256, 128, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "      (cv3): Conv2d(128, 128, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "      (cv4): Conv(\n",
            "        (conv): Conv2d(256, 256, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "        (bn): BatchNorm2d(256, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "        (act): Hardswish()\n",
            "      )\n",
            "      (bn): BatchNorm2d(256, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "      (act): LeakyReLU(negative_slope=0.1, inplace=True)\n",
            "      (m): Sequential(\n",
            "        (0): Bottleneck(\n",
            "          (cv1): Conv(\n",
            "            (conv): Conv2d(128, 128, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(128, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "          (cv2): Conv(\n",
            "            (conv): Conv2d(128, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(128, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "        )\n",
            "      )\n",
            "    )\n",
            "    (21): Conv(\n",
            "      (conv): Conv2d(256, 256, kernel_size=(3, 3), stride=(2, 2), padding=(1, 1), bias=False)\n",
            "      (bn): BatchNorm2d(256, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "      (act): Hardswish()\n",
            "    )\n",
            "    (22): Concat()\n",
            "    (23): BottleneckCSP(\n",
            "      (cv1): Conv(\n",
            "        (conv): Conv2d(512, 256, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "        (bn): BatchNorm2d(256, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "        (act): Hardswish()\n",
            "      )\n",
            "      (cv2): Conv2d(512, 256, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "      (cv3): Conv2d(256, 256, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "      (cv4): Conv(\n",
            "        (conv): Conv2d(512, 512, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "        (bn): BatchNorm2d(512, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "        (act): Hardswish()\n",
            "      )\n",
            "      (bn): BatchNorm2d(512, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "      (act): LeakyReLU(negative_slope=0.1, inplace=True)\n",
            "      (m): Sequential(\n",
            "        (0): Bottleneck(\n",
            "          (cv1): Conv(\n",
            "            (conv): Conv2d(256, 256, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(256, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "          (cv2): Conv(\n",
            "            (conv): Conv2d(256, 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(256, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "        )\n",
            "      )\n",
            "    )\n",
            "    (24): Detect(\n",
            "      (m): ModuleList(\n",
            "        (0): Conv2d(128, 18, kernel_size=(1, 1), stride=(1, 1))\n",
            "        (1): Conv2d(256, 18, kernel_size=(1, 1), stride=(1, 1))\n",
            "        (2): Conv2d(512, 18, kernel_size=(1, 1), stride=(1, 1))\n",
            "      )\n",
            "    )\n",
            "    (25): Conv(\n",
            "      (conv): Conv2d(256, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n",
            "      (bn): BatchNorm2d(128, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "      (act): Hardswish()\n",
            "    )\n",
            "    (26): Upsample(scale_factor=2.0, mode=nearest)\n",
            "    (27): BottleneckCSP(\n",
            "      (cv1): Conv(\n",
            "        (conv): Conv2d(128, 32, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "        (bn): BatchNorm2d(32, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "        (act): Hardswish()\n",
            "      )\n",
            "      (cv2): Conv2d(128, 32, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "      (cv3): Conv2d(32, 32, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "      (cv4): Conv(\n",
            "        (conv): Conv2d(64, 64, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "        (bn): BatchNorm2d(64, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "        (act): Hardswish()\n",
            "      )\n",
            "      (bn): BatchNorm2d(64, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "      (act): LeakyReLU(negative_slope=0.1, inplace=True)\n",
            "      (m): Sequential(\n",
            "        (0): Bottleneck(\n",
            "          (cv1): Conv(\n",
            "            (conv): Conv2d(32, 32, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(32, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "          (cv2): Conv(\n",
            "            (conv): Conv2d(32, 32, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(32, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "        )\n",
            "      )\n",
            "    )\n",
            "    (28): Conv(\n",
            "      (conv): Conv2d(64, 32, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n",
            "      (bn): BatchNorm2d(32, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "      (act): Hardswish()\n",
            "    )\n",
            "    (29): Upsample(scale_factor=2.0, mode=nearest)\n",
            "    (30): Conv(\n",
            "      (conv): Conv2d(32, 16, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n",
            "      (bn): BatchNorm2d(16, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "      (act): Hardswish()\n",
            "    )\n",
            "    (31): BottleneckCSP(\n",
            "      (cv1): Conv(\n",
            "        (conv): Conv2d(16, 4, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "        (bn): BatchNorm2d(4, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "        (act): Hardswish()\n",
            "      )\n",
            "      (cv2): Conv2d(16, 4, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "      (cv3): Conv2d(4, 4, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "      (cv4): Conv(\n",
            "        (conv): Conv2d(8, 8, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "        (bn): BatchNorm2d(8, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "        (act): Hardswish()\n",
            "      )\n",
            "      (bn): BatchNorm2d(8, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "      (act): LeakyReLU(negative_slope=0.1, inplace=True)\n",
            "      (m): Sequential(\n",
            "        (0): Bottleneck(\n",
            "          (cv1): Conv(\n",
            "            (conv): Conv2d(4, 4, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(4, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "          (cv2): Conv(\n",
            "            (conv): Conv2d(4, 4, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(4, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "        )\n",
            "      )\n",
            "    )\n",
            "    (32): Upsample(scale_factor=2.0, mode=nearest)\n",
            "    (33): Conv(\n",
            "      (conv): Conv2d(8, 2, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n",
            "      (bn): BatchNorm2d(2, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "      (act): Hardswish()\n",
            "    )\n",
            "    (34): Conv(\n",
            "      (conv): Conv2d(256, 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n",
            "      (bn): BatchNorm2d(128, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "      (act): Hardswish()\n",
            "    )\n",
            "    (35): Upsample(scale_factor=2.0, mode=nearest)\n",
            "    (36): BottleneckCSP(\n",
            "      (cv1): Conv(\n",
            "        (conv): Conv2d(128, 32, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "        (bn): BatchNorm2d(32, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "        (act): Hardswish()\n",
            "      )\n",
            "      (cv2): Conv2d(128, 32, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "      (cv3): Conv2d(32, 32, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "      (cv4): Conv(\n",
            "        (conv): Conv2d(64, 64, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "        (bn): BatchNorm2d(64, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "        (act): Hardswish()\n",
            "      )\n",
            "      (bn): BatchNorm2d(64, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "      (act): LeakyReLU(negative_slope=0.1, inplace=True)\n",
            "      (m): Sequential(\n",
            "        (0): Bottleneck(\n",
            "          (cv1): Conv(\n",
            "            (conv): Conv2d(32, 32, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(32, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "          (cv2): Conv(\n",
            "            (conv): Conv2d(32, 32, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(32, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "        )\n",
            "      )\n",
            "    )\n",
            "    (37): Conv(\n",
            "      (conv): Conv2d(64, 32, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n",
            "      (bn): BatchNorm2d(32, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "      (act): Hardswish()\n",
            "    )\n",
            "    (38): Upsample(scale_factor=2.0, mode=nearest)\n",
            "    (39): Conv(\n",
            "      (conv): Conv2d(32, 16, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n",
            "      (bn): BatchNorm2d(16, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "      (act): Hardswish()\n",
            "    )\n",
            "    (40): BottleneckCSP(\n",
            "      (cv1): Conv(\n",
            "        (conv): Conv2d(16, 4, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "        (bn): BatchNorm2d(4, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "        (act): Hardswish()\n",
            "      )\n",
            "      (cv2): Conv2d(16, 4, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "      (cv3): Conv2d(4, 4, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "      (cv4): Conv(\n",
            "        (conv): Conv2d(8, 8, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "        (bn): BatchNorm2d(8, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "        (act): Hardswish()\n",
            "      )\n",
            "      (bn): BatchNorm2d(8, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "      (act): LeakyReLU(negative_slope=0.1, inplace=True)\n",
            "      (m): Sequential(\n",
            "        (0): Bottleneck(\n",
            "          (cv1): Conv(\n",
            "            (conv): Conv2d(4, 4, kernel_size=(1, 1), stride=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(4, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "          (cv2): Conv(\n",
            "            (conv): Conv2d(4, 4, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n",
            "            (bn): BatchNorm2d(4, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "            (act): Hardswish()\n",
            "          )\n",
            "        )\n",
            "      )\n",
            "    )\n",
            "    (41): Upsample(scale_factor=2.0, mode=nearest)\n",
            "    (42): Conv(\n",
            "      (conv): Conv2d(8, 2, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False)\n",
            "      (bn): BatchNorm2d(2, eps=0.001, momentum=0.03, affine=True, track_running_stats=True)\n",
            "      (act): Hardswish()\n",
            "    )\n",
            "  )\n",
            ")\n"
          ]
        }
      ],
      "source": [
        "import os\n",
        "import torch\n",
        "import tensorflow_hub as hub\n",
        "\n",
        "os.environ['TFHUB_CACHE_DIR'] = 'tmp'\n",
        "module_handle = \"https://tfhub.dev/tensorflow/faster_rcnn/resnet152_v1_640x640/1\"\n",
        "fasterrcnn = hub.load(module_handle)\n",
        "print(fasterrcnn)\n",
        "\n",
        "!pip install yacs\n",
        "yolo_model = torch.hub.load('hustvl/yolop', 'yolop', pretrained=True)\n",
        "print(yolo_model)\n"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "zqk6P0X_61hZ"
      },
      "source": [
        "Make sure you go to https://pytorch.org/hub/ and https://tfhub.dev/ and check the available models.\n",
        "\n",
        "&nbsp;\n",
        "\n",
        "&nbsp;\n",
        "\n",
        "\n",
        "In these frameworks you will also find tools to train your models in a very simple way. Let's look the problem that is often considered the \"hello-world\" of deep learning, digit recognition.\n",
        "\n",
        "&nbsp;\n",
        "\n",
        "<center>\n",
        "<img src=\"https://drive.google.com/uc?export=view&id=1r4q0BX7H5PyU6hJ82-6h8bDBlrfkPi2q\" width=\"300\" hspace=\"30\">\n",
        "\n",
        "  [MNIST](http://yann.lecun.com/exdb/mnist/) datasest.\n",
        "</center>\n",
        "\n",
        "&nbsp;\n",
        "\n",
        "The following code is part of an official tutorial to PyTorch Lightning, you can read more on it [here](https://pytorch-lightning.readthedocs.io/en/latest/notebooks/lightning_examples/mnist-hello-world.html)."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "EblnI45lHrsj",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 1000,
          "referenced_widgets": [
            "cf37c5f805404514952c303b4d40cd37",
            "9e8dc63d07444e61abd6d1b08183f358",
            "8a3307861bb44136b2fb7ed6bbe7bd21",
            "fd3de0b826da481b88a77a858cab499a",
            "9db9728e4bee4f34af37e2f73f7e76f2",
            "557f7fe8a0c84988aae627295ab13cff",
            "c2b204f20d404cb4936569fec68caf0a",
            "dd7f10ec88e04214b03db21504102b77",
            "0b3886f17eee46b59379a84c01797039",
            "8f615d79f33f41e2b6976c3337cbacca",
            "fdef0e5867a74cef83997c2046952844",
            "0c52caf16d494d459dbf57d70b90e5ea",
            "0ab1353ad7d34026890fc640db16c537",
            "e86400a71e2548218cdf0a289667fd7e",
            "082db835aa2d4cc9a5ed790854189de2",
            "5c65791b8b30459881f279013e21f388",
            "40bc49ebe8684d468b65e5918f767bc7",
            "6a1bba7da28f436086d421f0d64ba6bb",
            "45e346e3ca0e4cfb8cd7b9cbed5d539a",
            "89bd1e3dc61b46b1b440e5e9d112a22f",
            "f0e1e7022aa04216b3e9aea432a85059",
            "dca30ed2910847e9bb82bf6690da20a0",
            "cdfcdb3742fa4dc7af7f58429a7225d9",
            "e1ce6cb052d04af78413a187dc25688b",
            "306e9a7b30634d64a4e06b20c336cb63",
            "83f5bf81a32d4d609b75cbf1206fe377",
            "71af350cd6774dae9e9df5642014fe14",
            "dba4e9a223064c7ea91cf3295a95c9e4",
            "77ad3b4cc7444a51b4574b3fad576374",
            "9ea26fa9145041f4a26671e22756d6a5",
            "e4db0c7cdeeb4e7891867cfbb62d7cf6",
            "294fad46371541a2b7cad27c099c4983",
            "8f51b8e9277a4abd97fb6a58819055e3",
            "c7c13c6087f84343ba87bfe722c271d1",
            "729244d8bc304209bc587f1ce7632ae6",
            "64437bec6ccc420383da3cb256ca19fb",
            "c4cbeab2e1644734abab55f88b8ce152",
            "292c74494dc34ad8afc91304a9ece1c8",
            "49968bac05aa48c1bec903f8790092bc",
            "48bd96ed58a54bdaa6a7f05c48bd3aeb",
            "f2510536d92e406fbb8617df45ab7e1f",
            "4516c650a4d34c3c9fa98a05ea082664",
            "dbbc5c9156474c1b81aa7638bed07b53",
            "f6f11cd407c54b34a2a036ce49dc8632",
            "78ced02266674b19806de4d4330d2507",
            "77042b094ac14413b69d3e74928b7d39",
            "5916e99c1af747728a1ae9f9831313e1",
            "72b16ac528004c56a774a806b03aa8bb",
            "56a86df8bf2f4543948e19cd526034e4",
            "e69318745c4645bbb259ab3426968ef3",
            "78a935005afa40328286fc7ba3e63cb9",
            "357a783d39f74b6887fa04067c3ef492",
            "80a510a0b39447a48174cbe4222dff62",
            "3865e4c35e1e4b56b2d6d87dd86dde93",
            "c7d8c3fee960458e92a1e510a5366dd4",
            "91df830d1d8e419aac3a5ecdea81984d",
            "6c5994e11459475d9d50d3ad2cfa1b8d",
            "346682a13c004c6784173b2034ed2ce1",
            "2f48e527702d4d218cbdffa1f4aeee5c",
            "7c1421aa3e984d6a9b4cd6b56232ae74",
            "3bf9edcf699940638530da3a90f75662",
            "f9c12e7dacc843ec8d5965285c5b56ee",
            "120a42f704c5474a9d731ed53a05c89f",
            "730b4311faf24bc989f470e96de83f9d",
            "b6b2f425659e4414bf64e5d55107b0e1",
            "f40294149934428f9ae0b16d99eb6939",
            "d63f2ed3881b47e6befc526261e7ebaa",
            "17bfc631ae714e64b5eca6809d280adc",
            "595ad7b1e7534ef38597ea2af72294ed",
            "ad7572bf7ad5427988d2fdc65b87cf03",
            "62cae968a1ae4d14b90506080f8ffcca",
            "f8ee4b451f154d57a344e0a6ffa0a348",
            "46f403ffddd6499682b141ebe97e0e8c",
            "5f5290f52e604a2cb00ffa5a9c9c9c62",
            "645eb426e46946879700b6192deba98f",
            "2ab2979d49cc4f6cb35eede0e847cffd",
            "dfa9c9ace36f4d5f877b874dd0775436",
            "0f60330dd0f54ce2bb7471b76a8b420d",
            "14ea327c2a79465c8448a10b755b0edf",
            "1eaf5b9d76bd47c0b12d411cb31dd987",
            "2a4e3f38408349b9b793fb67fedd4da1",
            "dbf0c3bd5be44d0f838c1c9725f563b5",
            "6c4f54a975f04070840c1fd00f39c4e3",
            "4c7b22ed0e7643a8a04c09d394068b75",
            "fe9a5a1fd38e459b80886897c07ee2f8",
            "122705b02bcd4ba599b043426d6f535f",
            "bbdf0faaf24847949a9de1480910c45e",
            "f4d127b9820f419d86e93f64af73c445",
            "b6b322a14b3c47229710710127ab0690",
            "35a2cb64b8f345399cd4ba366da94df7",
            "d88822e965444eeca0634fc00923a113",
            "0bf4f90afcf34941971d8aab457c0640",
            "e5969ed807e94bfa8c4858d8e2ff9929",
            "28f0f1746a33436dabff5c0d6e73575e",
            "d28d942ca7434333b343a124daa92967",
            "604223bcb2194cac9b00bc28f6fe5e02",
            "098fe9c7fd5a4d35a83c780b4c5a4d23",
            "61e009396e76472cb64e2c53d4e31ae8",
            "56123558f5914de591da957ad23541f5",
            "0cb55226644747518f661b5b733a2fc5",
            "53cdd5aa8bae43059892a6dc66ca7c1d",
            "65e80ae05dd84790844b6bf885556266",
            "5ce4b2d670aa49e79f3540f2f0b717e8",
            "06cc712b3696452985dc8c9604a2af16",
            "bf04a031ecf34a3e9b280874be622874",
            "b1d00a72ffa5455bb71a5bd18b9a1ffc",
            "2d6cd2c551d141b39fcfff3d0ba3311a",
            "8f4dcdaa213941e0b15c46b67fe6fb67",
            "ae459f3c849e40b3ba52a2159723908a",
            "ef80cee01e524241a0546fc53924fed4",
            "b4ea0b1cfb70479fbb9dc5ee1bbb8aa1",
            "20e5c6431b2442638fadf21fd9a96252",
            "6be82eb294844d60a8c5850322321116",
            "4b08b84119004714a26305cef95a7f3c",
            "431ff2bfdaba4194b7f325975de8e65c",
            "6a22fb5e23f6435bacf0f6bbc795f381",
            "cc3e3a3c894d43bea66462f55cbf69a5",
            "ef382106ce254deb923da70ecd43426d",
            "ec88dc8a28cb4f31bbea3f9c62cd8907",
            "a9b4cbf3eb3341d4a3a100a8d74efafc",
            "78507c291f22441296426fc24923c473",
            "40092e852a064af58f04e9ad1364ae40",
            "6eac7b99f23e4d93961df5592836935d",
            "cb80518256a044c59a284fc94a00580d",
            "5ad65590bcdf40c3bec676b856647f80",
            "2258ddc4ca494ee1801dd0d12c6d8baa",
            "843c6f63746247d7979975550757412c",
            "b509a932de1d40beba492d1cc0097a94",
            "7de4cfda7df0490b91ffc63bb490c592",
            "5674dd34b1904c9196d5985b9b1f29fe",
            "6f483551399444d2b88ec091f413ce84",
            "28c46049c4004791aed166ea7e557e17",
            "87e813c6e26f414b84e0ef554ba803c4",
            "0f45cd1d306b495f95e407899640e85e",
            "e60571fe22a3473aaf9c045ac87c5e64",
            "e4b8bb3b58974aeb84e768efc6e6f6eb",
            "efc0f7e2c10b41af81bb22d300b6f27f",
            "7df0bc5362654fc0809a3aa07037edf7",
            "a72b03c3d58d4df096950b6f601d5f50",
            "f3654298a3354def81ff01ec1279b5ff",
            "764e33e7d8b74ac2ade75f4282575931",
            "622413ed3f894b35ba3f41bf7af973d9",
            "e42b8c0c9874425681068c58cc695ee5",
            "10c567cd699f4ae8ae272cef24368e44",
            "5ec3f70250fc4cb58d09419bcaa18d8b",
            "5b81761d8f7c4bc5b52ceb79b9f608ed",
            "24c3a7b7e37f439087740810fb61f0e3",
            "ae03f64264e14d909d44aa97262bdf95",
            "b0b44e75fb2b4404a820ff80b5d03971",
            "ef7454e8d8c945049488ca223625f5a5",
            "478e356f8dcc40698197d7b476d7c074",
            "6585263f478545bfa36b6cbfe2952eef",
            "77da66ccbd0841cd99a4bc1f657f4b4c",
            "54819de1935b4d3890c3524415cac3f4",
            "53f5b93c62c247adb088388bafb3261a",
            "5e43aeae88af4581bfd8ca77caa8815b",
            "4693e6ce4c2c400daede56d6af1730d3",
            "fd33975baac94e8db770d917da989d5b",
            "b36220d8f82f44599563c29415984e6e",
            "411d60cb74cd42a4b4bf312cd75501bf",
            "6a0189381c7b4f56a356353a02ddda0c",
            "3da56e7a0be24a3491f7264505c726d3",
            "38b6228468ce44d99e618723ee9a4cb6",
            "b37c167ea3954763a9f9a98f9f3abb85",
            "b079911da1684c14894b063a16a3d9dd",
            "398895ba51c0405881ef47e47cf72c78",
            "e7869707b4af4f15ab6ffc2f64cd5aae",
            "051dfef46e704bcd9bcb5f2cb2537901",
            "6738513d0ac445719474450a45f45122",
            "c1c57778f7984dd1953d0a8e3268604c",
            "98e208eef1534d19a89a5a3b407683b8",
            "ddc610e1b8b4491dba22fc886d85cbfe",
            "e187c1d7010e410ead93e4159764f172",
            "015343c49063470f89eddbc9dfd67f3b",
            "86bf9f0b4ebe48d59948b28be3fda173",
            "44aec7f4acfd4152ae7150d4d57eb5b5",
            "e909a23056fc490cbbf5243b4b54525f",
            "76e56eb263f047e8a96021830e1f2ebb",
            "45ada10700cc4a43919ce8cad006f671",
            "3ab11111c8c34990a4feb2558c6e515e",
            "2c3a547ce2464527aa6f87ca0728e987",
            "8c340499abb14da2b914900f76b721d0",
            "0b45339c497c4650bae76031029f0e98",
            "a17cc832b0a642eeadedbc4a5cab71cc",
            "7b765aaae9054a87acb7ca70c9bd6cae",
            "05d6efa91299484aae6041cdd5d696bf",
            "7ecbcc19ee43481fbe81ae0c4723cf02",
            "916bc3c1fff2403a9ee22c5e0151e61d",
            "db04027c450c4d7caa40df01e783f0f2",
            "f01957e5e33542b2b81cb0b8d72302dc",
            "9dc0533746af4d75aed15444c151b984",
            "0f88a74dcaf748d19e652775cacdaeee",
            "fd91ece6b256477bb355608be2742357",
            "6bc9088cda254fc9948afa0a6af3e574",
            "088e4f506e154a20afc4799ca084d834",
            "12c80c499e814112b2cb57da1c9f4b10",
            "05eaaddc234c4cdcb39a2d5b385c8d1d",
            "480be2d70bd045dea3585dbfb71ae612",
            "c9ba6762d89947769f6bea8a8d061f67",
            "1f536c2caf5946039c3b53a053aa2b84",
            "1389cd56c6914111abbd4e78a3a6401b",
            "1b4ca023870f44d89e3f83809d9142ee",
            "b2f9f84e066848298dcc265da7de1116",
            "d4e4ebb4aba14e7eaa9579bccde42f30",
            "b801ea2af483454ca9ceb618c233a727",
            "db9b7eeba4e7442289c17f7f46864d92",
            "d91225e0d54f437db344f1e45769a4b4",
            "50492ae5ea9b42fd88bbf151668c517d",
            "7cdbe747683e444a974295c782799acd",
            "4648572a3fa54cec8c94b5ca30456a1c",
            "1032e57fb34644bfb80bb15afa3ab7cf",
            "d60dd5e1c97d4dbd918f24da60426822",
            "eaa548ad0b9e43ec922cf5fb13184811",
            "03e9144572024952a3e7252ba66da5bb",
            "f4d2e319b3e44567936528a561950f5f",
            "12f6cd915ade4b858373fa9381efa56c",
            "c00c3f264e3f40ddbab072f413a4920a",
            "ad2e8f38951c4783bf2300209dc28905",
            "de28c2a50ed6490ab5bcb3f3d845ca11",
            "41343f9ea6b242ceb307fd1ae31c958b",
            "e195f4e87d5b4ad7add18e00b2a857ed",
            "233940ed1d48458fb3570fa4cbabf04f",
            "0f9c0c11adc247d2a673e6dc06658ab2",
            "fb7bd2693b8f49cf88d106c2e68dd9a3",
            "45fc25e7ee98424a94513bf3de61bb4d",
            "f19fa3710d214700b3cb68dbe6804a35",
            "8bc84b21a29f4dc2b2ebfa81a708c31f",
            "6bcf15e34d414c9b89592883ab6f49bb",
            "73dcf42d7e864cf69c25a25efb11f2a4",
            "1203cdc392834d7f83a5d1874bbcfc4f",
            "96525ea07cc141c3bcccb6d5407452e3",
            "e61ec939c5fb41419a3e96c02f40cf49",
            "fa8aa26656994a318cd3916167f1479a",
            "cb4743af140c41c2a85b99ab17295a8b",
            "f82a56a3081046e3aec1eb4e8a415a9a",
            "ec7e9eea1eb0471588e0ba3412d6d161",
            "70ccaae0e0d94515b13565b608fdd669",
            "e353a996dc464345bf983859d15bdcd8",
            "3ff2d8fa24054dcfb3258109f4c02422",
            "89759658685d47d8bbd0f30a6e55ccd4",
            "460a76c71ef443b29cb7d7553aa06476",
            "0ba09c04302b4c8885eb2b4494faa328",
            "7f5623aeebe14ee5823531d4847b5aaa",
            "5e12b15bdeaa4f4ba02dd3d105623762",
            "01f21108a0204acb9a873d9658172708",
            "a106561805024f03afc341747617378d",
            "13eee2791df54a1396a1632bf3b4f11f",
            "46c0a68d41684ee9a660c86400ffca82",
            "5a494357410b4a38a16dff5510939a04",
            "3f04ccbe609f45188917549033486392",
            "8a28a00c480e4157a9edff253680c3a4",
            "976a71d9db20405cb7f5b6b5fcecbf9e",
            "a166f6330a264f9fb16cbd207952b95b",
            "1d90bb2ac59e48f58e0d52ca4387fcdc",
            "c6b0d2d9838942df8d10b72e75dac4fa",
            "5700cd229f6e45a3a68b2ba774bcc2e3",
            "5d1d0b9d45e244f2a8c548fa290819b0",
            "3f9b7cffeb3c418893fabe4ac003937b",
            "4a00332773e54af6a1995721a9dbf03d",
            "bbf3ef2529754249883a074f0868eefe",
            "33c76f31464546908c8381cad4aea650",
            "3e5ae4ce660543b7a0da0f98efcb1b31",
            "c6b963a608fb4e3484d4e3c41ad53697",
            "b70a337e17c444ddb02549c8a04ab0a8",
            "a014db9348614e32a6701f595d7de555",
            "2492df5173a94256a4eae4f1f93f69f9",
            "6f612f591964491783916366eca3f6d3",
            "5d1fa9ae4f2b4e76a8bd26087ae7a153",
            "566598cb731642d5a29e61f2191d210f",
            "63ac3861ced2458ab6db2867894fd938",
            "3d624db7752a4bc5972f26a8f09ab0d1",
            "40a3b598c4834c1ca9d73bfe045ab650",
            "154fb86ee765408281ee32811f7763b2",
            "65affb0b597a476d82225f02b76a682c",
            "535e662ac24b4c4ab5280a1dc014c0cc",
            "54ce75e8408b4bca89020d37ec78a18b",
            "b04ce2905cd943aeab7a1145fc14ea4a",
            "907802e7bfd744e096765b35bc722530",
            "946ee481d3834c6eb60e0ff331383eb6",
            "6fbab320a3c444fc97f466695f454ce9",
            "80322039152d4eb08976b48d5c611caf",
            "6ea06d5ca10246b6966bb31e6112351f",
            "dde7648eeb894938a136eb3b7390d9c9",
            "c2ad5da24c77496eb3c7da357cb069b2",
            "3af28e56a76947bc8708c90b8cd9763b",
            "2bbf9c86a3c44f68b9626e8e941c7a55"
          ]
        },
        "outputId": "42d4aa19-0715-4218-f15f-0b2e48b8479c"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Looking in indexes: https://pypi.org/simple, https://us-python.pkg.dev/colab-wheels/public/simple/\n",
            "Collecting pytorch_lightning\n",
            "  Downloading pytorch_lightning-1.6.4-py3-none-any.whl (585 kB)\n",
            "\u001b[K     |████████████████████████████████| 585 kB 9.0 MB/s \n",
            "\u001b[?25hCollecting fsspec[http]!=2021.06.0,>=2021.05.0\n",
            "  Downloading fsspec-2022.5.0-py3-none-any.whl (140 kB)\n",
            "\u001b[K     |████████████████████████████████| 140 kB 31.8 MB/s \n",
            "\u001b[?25hRequirement already satisfied: protobuf<=3.20.1 in /usr/local/lib/python3.7/dist-packages (from pytorch_lightning) (3.17.3)\n",
            "Collecting PyYAML>=5.4\n",
            "  Downloading PyYAML-6.0-cp37-cp37m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (596 kB)\n",
            "\u001b[K     |████████████████████████████████| 596 kB 38.4 MB/s \n",
            "\u001b[?25hRequirement already satisfied: tqdm>=4.57.0 in /usr/local/lib/python3.7/dist-packages (from pytorch_lightning) (4.64.0)\n",
            "Collecting torchmetrics>=0.4.1\n",
            "  Downloading torchmetrics-0.9.2-py3-none-any.whl (419 kB)\n",
            "\u001b[K     |████████████████████████████████| 419 kB 50.0 MB/s \n",
            "\u001b[?25hRequirement already satisfied: tensorboard>=2.2.0 in /usr/local/lib/python3.7/dist-packages (from pytorch_lightning) (2.8.0)\n",
            "Requirement already satisfied: typing-extensions>=4.0.0 in /usr/local/lib/python3.7/dist-packages (from pytorch_lightning) (4.1.1)\n",
            "Requirement already satisfied: torch>=1.8.* in /usr/local/lib/python3.7/dist-packages (from pytorch_lightning) (1.11.0+cu113)\n",
            "Requirement already satisfied: packaging>=17.0 in /usr/local/lib/python3.7/dist-packages (from pytorch_lightning) (21.3)\n",
            "Requirement already satisfied: numpy>=1.17.2 in /usr/local/lib/python3.7/dist-packages (from pytorch_lightning) (1.21.6)\n",
            "Collecting pyDeprecate>=0.3.1\n",
            "  Downloading pyDeprecate-0.3.2-py3-none-any.whl (10 kB)\n",
            "Collecting aiohttp\n",
            "  Downloading aiohttp-3.8.1-cp37-cp37m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (1.1 MB)\n",
            "\u001b[K     |████████████████████████████████| 1.1 MB 54.5 MB/s \n",
            "\u001b[?25hRequirement already satisfied: requests in /usr/local/lib/python3.7/dist-packages (from fsspec[http]!=2021.06.0,>=2021.05.0->pytorch_lightning) (2.23.0)\n",
            "Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.7/dist-packages (from packaging>=17.0->pytorch_lightning) (3.0.9)\n",
            "Requirement already satisfied: six>=1.9 in /usr/local/lib/python3.7/dist-packages (from protobuf<=3.20.1->pytorch_lightning) (1.15.0)\n",
            "Requirement already satisfied: markdown>=2.6.8 in /usr/local/lib/python3.7/dist-packages (from tensorboard>=2.2.0->pytorch_lightning) (3.3.7)\n",
            "Requirement already satisfied: tensorboard-plugin-wit>=1.6.0 in /usr/local/lib/python3.7/dist-packages (from tensorboard>=2.2.0->pytorch_lightning) (1.8.1)\n",
            "Requirement already satisfied: tensorboard-data-server<0.7.0,>=0.6.0 in /usr/local/lib/python3.7/dist-packages (from tensorboard>=2.2.0->pytorch_lightning) (0.6.1)\n",
            "Requirement already satisfied: wheel>=0.26 in /usr/local/lib/python3.7/dist-packages (from tensorboard>=2.2.0->pytorch_lightning) (0.37.1)\n",
            "Requirement already satisfied: google-auth-oauthlib<0.5,>=0.4.1 in /usr/local/lib/python3.7/dist-packages (from tensorboard>=2.2.0->pytorch_lightning) (0.4.6)\n",
            "Requirement already satisfied: werkzeug>=0.11.15 in /usr/local/lib/python3.7/dist-packages (from tensorboard>=2.2.0->pytorch_lightning) (1.0.1)\n",
            "Requirement already satisfied: google-auth<3,>=1.6.3 in /usr/local/lib/python3.7/dist-packages (from tensorboard>=2.2.0->pytorch_lightning) (1.35.0)\n",
            "Requirement already satisfied: setuptools>=41.0.0 in /usr/local/lib/python3.7/dist-packages (from tensorboard>=2.2.0->pytorch_lightning) (57.4.0)\n",
            "Requirement already satisfied: grpcio>=1.24.3 in /usr/local/lib/python3.7/dist-packages (from tensorboard>=2.2.0->pytorch_lightning) (1.46.3)\n",
            "Requirement already satisfied: absl-py>=0.4 in /usr/local/lib/python3.7/dist-packages (from tensorboard>=2.2.0->pytorch_lightning) (1.1.0)\n",
            "Requirement already satisfied: rsa<5,>=3.1.4 in /usr/local/lib/python3.7/dist-packages (from google-auth<3,>=1.6.3->tensorboard>=2.2.0->pytorch_lightning) (4.8)\n",
            "Requirement already satisfied: pyasn1-modules>=0.2.1 in /usr/local/lib/python3.7/dist-packages (from google-auth<3,>=1.6.3->tensorboard>=2.2.0->pytorch_lightning) (0.2.8)\n",
            "Requirement already satisfied: cachetools<5.0,>=2.0.0 in /usr/local/lib/python3.7/dist-packages (from google-auth<3,>=1.6.3->tensorboard>=2.2.0->pytorch_lightning) (4.2.4)\n",
            "Requirement already satisfied: requests-oauthlib>=0.7.0 in /usr/local/lib/python3.7/dist-packages (from google-auth-oauthlib<0.5,>=0.4.1->tensorboard>=2.2.0->pytorch_lightning) (1.3.1)\n",
            "Requirement already satisfied: importlib-metadata>=4.4 in /usr/local/lib/python3.7/dist-packages (from markdown>=2.6.8->tensorboard>=2.2.0->pytorch_lightning) (4.11.4)\n",
            "Requirement already satisfied: zipp>=0.5 in /usr/local/lib/python3.7/dist-packages (from importlib-metadata>=4.4->markdown>=2.6.8->tensorboard>=2.2.0->pytorch_lightning) (3.8.0)\n",
            "Requirement already satisfied: pyasn1<0.5.0,>=0.4.6 in /usr/local/lib/python3.7/dist-packages (from pyasn1-modules>=0.2.1->google-auth<3,>=1.6.3->tensorboard>=2.2.0->pytorch_lightning) (0.4.8)\n",
            "Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.7/dist-packages (from requests->fsspec[http]!=2021.06.0,>=2021.05.0->pytorch_lightning) (2022.6.15)\n",
            "Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in /usr/local/lib/python3.7/dist-packages (from requests->fsspec[http]!=2021.06.0,>=2021.05.0->pytorch_lightning) (1.24.3)\n",
            "Requirement already satisfied: chardet<4,>=3.0.2 in /usr/local/lib/python3.7/dist-packages (from requests->fsspec[http]!=2021.06.0,>=2021.05.0->pytorch_lightning) (3.0.4)\n",
            "Requirement already satisfied: idna<3,>=2.5 in /usr/local/lib/python3.7/dist-packages (from requests->fsspec[http]!=2021.06.0,>=2021.05.0->pytorch_lightning) (2.10)\n",
            "Requirement already satisfied: oauthlib>=3.0.0 in /usr/local/lib/python3.7/dist-packages (from requests-oauthlib>=0.7.0->google-auth-oauthlib<0.5,>=0.4.1->tensorboard>=2.2.0->pytorch_lightning) (3.2.0)\n",
            "Collecting yarl<2.0,>=1.0\n",
            "  Downloading yarl-1.7.2-cp37-cp37m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (271 kB)\n",
            "\u001b[K     |████████████████████████████████| 271 kB 64.8 MB/s \n",
            "\u001b[?25hCollecting aiosignal>=1.1.2\n",
            "  Downloading aiosignal-1.2.0-py3-none-any.whl (8.2 kB)\n",
            "Collecting asynctest==0.13.0\n",
            "  Downloading asynctest-0.13.0-py3-none-any.whl (26 kB)\n",
            "Requirement already satisfied: attrs>=17.3.0 in /usr/local/lib/python3.7/dist-packages (from aiohttp->fsspec[http]!=2021.06.0,>=2021.05.0->pytorch_lightning) (21.4.0)\n",
            "Collecting multidict<7.0,>=4.5\n",
            "  Downloading multidict-6.0.2-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (94 kB)\n",
            "\u001b[K     |████████████████████████████████| 94 kB 1.9 MB/s \n",
            "\u001b[?25hCollecting frozenlist>=1.1.1\n",
            "  Downloading frozenlist-1.3.0-cp37-cp37m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (144 kB)\n",
            "\u001b[K     |████████████████████████████████| 144 kB 63.0 MB/s \n",
            "\u001b[?25hCollecting async-timeout<5.0,>=4.0.0a3\n",
            "  Downloading async_timeout-4.0.2-py3-none-any.whl (5.8 kB)\n",
            "Requirement already satisfied: charset-normalizer<3.0,>=2.0 in /usr/local/lib/python3.7/dist-packages (from aiohttp->fsspec[http]!=2021.06.0,>=2021.05.0->pytorch_lightning) (2.0.12)\n",
            "Installing collected packages: multidict, frozenlist, yarl, asynctest, async-timeout, aiosignal, fsspec, aiohttp, torchmetrics, PyYAML, pyDeprecate, pytorch-lightning\n",
            "  Attempting uninstall: PyYAML\n",
            "    Found existing installation: PyYAML 3.13\n",
            "    Uninstalling PyYAML-3.13:\n",
            "      Successfully uninstalled PyYAML-3.13\n",
            "Successfully installed PyYAML-6.0 aiohttp-3.8.1 aiosignal-1.2.0 async-timeout-4.0.2 asynctest-0.13.0 frozenlist-1.3.0 fsspec-2022.5.0 multidict-6.0.2 pyDeprecate-0.3.2 pytorch-lightning-1.6.4 torchmetrics-0.9.2 yarl-1.7.2\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "application/vnd.colab-display-data+json": {
              "pip_warning": {
                "packages": [
                  "yaml"
                ]
              }
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "INFO:pytorch_lightning.utilities.rank_zero:GPU available: True, used: True\n",
            "INFO:pytorch_lightning.utilities.rank_zero:TPU available: False, using: 0 TPU cores\n",
            "INFO:pytorch_lightning.utilities.rank_zero:IPU available: False, using: 0 IPUs\n",
            "INFO:pytorch_lightning.utilities.rank_zero:HPU available: False, using: 0 HPUs\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Downloading http://yann.lecun.com/exdb/mnist/train-images-idx3-ubyte.gz\n",
            "Downloading http://yann.lecun.com/exdb/mnist/train-images-idx3-ubyte.gz to ./MNIST/raw/train-images-idx3-ubyte.gz\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "  0%|          | 0/9912422 [00:00<?, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "cf37c5f805404514952c303b4d40cd37"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Extracting ./MNIST/raw/train-images-idx3-ubyte.gz to ./MNIST/raw\n",
            "\n",
            "Downloading http://yann.lecun.com/exdb/mnist/train-labels-idx1-ubyte.gz\n",
            "Downloading http://yann.lecun.com/exdb/mnist/train-labels-idx1-ubyte.gz to ./MNIST/raw/train-labels-idx1-ubyte.gz\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "  0%|          | 0/28881 [00:00<?, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "0c52caf16d494d459dbf57d70b90e5ea"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Extracting ./MNIST/raw/train-labels-idx1-ubyte.gz to ./MNIST/raw\n",
            "\n",
            "Downloading http://yann.lecun.com/exdb/mnist/t10k-images-idx3-ubyte.gz\n",
            "Downloading http://yann.lecun.com/exdb/mnist/t10k-images-idx3-ubyte.gz to ./MNIST/raw/t10k-images-idx3-ubyte.gz\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "  0%|          | 0/1648877 [00:00<?, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "cdfcdb3742fa4dc7af7f58429a7225d9"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Extracting ./MNIST/raw/t10k-images-idx3-ubyte.gz to ./MNIST/raw\n",
            "\n",
            "Downloading http://yann.lecun.com/exdb/mnist/t10k-labels-idx1-ubyte.gz\n",
            "Downloading http://yann.lecun.com/exdb/mnist/t10k-labels-idx1-ubyte.gz to ./MNIST/raw/t10k-labels-idx1-ubyte.gz\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "  0%|          | 0/4542 [00:00<?, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "c7c13c6087f84343ba87bfe722c271d1"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Extracting ./MNIST/raw/t10k-labels-idx1-ubyte.gz to ./MNIST/raw\n",
            "\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "WARNING:pytorch_lightning.loggers.csv_logs:Missing logger folder: logs/lightning_logs\n",
            "INFO:pytorch_lightning.accelerators.gpu:LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0]\n",
            "INFO:pytorch_lightning.callbacks.model_summary:\n",
            "  | Name          | Type       | Params\n",
            "---------------------------------------------\n",
            "0 | model         | Sequential | 55.1 K\n",
            "1 | val_accuracy  | Accuracy   | 0     \n",
            "2 | test_accuracy | Accuracy   | 0     \n",
            "---------------------------------------------\n",
            "55.1 K    Trainable params\n",
            "0         Non-trainable params\n",
            "55.1 K    Total params\n",
            "0.220     Total estimated model params size (MB)\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Sanity Checking: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "78ced02266674b19806de4d4330d2507"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Training: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "91df830d1d8e419aac3a5ecdea81984d"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "d63f2ed3881b47e6befc526261e7ebaa"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "0f60330dd0f54ce2bb7471b76a8b420d"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "b6b322a14b3c47229710710127ab0690"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "0cb55226644747518f661b5b733a2fc5"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "b4ea0b1cfb70479fbb9dc5ee1bbb8aa1"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "40092e852a064af58f04e9ad1364ae40"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "87e813c6e26f414b84e0ef554ba803c4"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "10c567cd699f4ae8ae272cef24368e44"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "53f5b93c62c247adb088388bafb3261a"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "398895ba51c0405881ef47e47cf72c78"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "e909a23056fc490cbbf5243b4b54525f"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "916bc3c1fff2403a9ee22c5e0151e61d"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "c9ba6762d89947769f6bea8a8d061f67"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "4648572a3fa54cec8c94b5ca30456a1c"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "e195f4e87d5b4ad7add18e00b2a857ed"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "e61ec939c5fb41419a3e96c02f40cf49"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "7f5623aeebe14ee5823531d4847b5aaa"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "1d90bb2ac59e48f58e0d52ca4387fcdc"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "a014db9348614e32a6701f595d7de555"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "54ce75e8408b4bca89020d37ec78a18b"
            }
          },
          "metadata": {}
        }
      ],
      "source": [
        "!pip install pytorch_lightning\n",
        "import os\n",
        "import pandas as pd\n",
        "import seaborn as sn\n",
        "import torch\n",
        "from IPython.core.display import display\n",
        "from pytorch_lightning import LightningModule, Trainer\n",
        "from pytorch_lightning.callbacks.progress import TQDMProgressBar\n",
        "from pytorch_lightning.loggers import CSVLogger\n",
        "from torch import nn\n",
        "from torch.nn import functional as F\n",
        "from torch.utils.data import DataLoader, random_split\n",
        "from torchmetrics import Accuracy\n",
        "from torchvision import transforms\n",
        "from torchvision.datasets import MNIST\n",
        "\n",
        "PATH_DATASETS = os.environ.get(\"PATH_DATASETS\", \".\")\n",
        "BATCH_SIZE = 256 if torch.cuda.is_available() else 64\n",
        "\n",
        "class LitMNIST(LightningModule):\n",
        "    def __init__(self, data_dir=PATH_DATASETS, hidden_size=64, learning_rate=2e-4):\n",
        "\n",
        "        super().__init__()\n",
        "\n",
        "        # Set our init args as class attributes\n",
        "        self.data_dir = data_dir\n",
        "        self.hidden_size = hidden_size\n",
        "        self.learning_rate = learning_rate\n",
        "\n",
        "        # Hardcode some dataset specific attributes\n",
        "        self.num_classes = 10\n",
        "        self.dims = (1, 28, 28)\n",
        "        channels, width, height = self.dims\n",
        "        self.transform = transforms.Compose(\n",
        "            [\n",
        "                transforms.ToTensor(),\n",
        "                transforms.Normalize((0.1307,), (0.3081,)),\n",
        "            ]\n",
        "        )\n",
        "\n",
        "        # Define PyTorch model\n",
        "        self.model = nn.Sequential(\n",
        "            nn.Flatten(),\n",
        "            nn.Linear(channels * width * height, hidden_size),\n",
        "            nn.ReLU(),\n",
        "            nn.Dropout(0.1),\n",
        "            nn.Linear(hidden_size, hidden_size),\n",
        "            nn.ReLU(),\n",
        "            nn.Dropout(0.1),\n",
        "            nn.Linear(hidden_size, self.num_classes),\n",
        "        )\n",
        "\n",
        "        self.val_accuracy = Accuracy()\n",
        "        self.test_accuracy = Accuracy()\n",
        "\n",
        "    def forward(self, x):\n",
        "        x = self.model(x)\n",
        "        return F.log_softmax(x, dim=1)\n",
        "\n",
        "    def training_step(self, batch, batch_idx):\n",
        "        x, y = batch\n",
        "        logits = self(x)\n",
        "        loss = F.nll_loss(logits, y)\n",
        "        return loss\n",
        "\n",
        "    def validation_step(self, batch, batch_idx):\n",
        "        x, y = batch\n",
        "        logits = self(x)\n",
        "        loss = F.nll_loss(logits, y)\n",
        "        preds = torch.argmax(logits, dim=1)\n",
        "        self.val_accuracy.update(preds, y)\n",
        "\n",
        "        # Calling self.log will surface up scalars for you in TensorBoard\n",
        "        self.log(\"val_loss\", loss, prog_bar=True)\n",
        "        self.log(\"val_acc\", self.val_accuracy, prog_bar=True)\n",
        "\n",
        "    def test_step(self, batch, batch_idx):\n",
        "        x, y = batch\n",
        "        logits = self(x)\n",
        "        loss = F.nll_loss(logits, y)\n",
        "        preds = torch.argmax(logits, dim=1)\n",
        "        self.test_accuracy.update(preds, y)\n",
        "\n",
        "        # Calling self.log will surface up scalars for you in TensorBoard\n",
        "        self.log(\"test_loss\", loss, prog_bar=True)\n",
        "        self.log(\"test_acc\", self.test_accuracy, prog_bar=True)\n",
        "\n",
        "    def configure_optimizers(self):\n",
        "        optimizer = torch.optim.Adam(self.parameters(), lr=self.learning_rate)\n",
        "        return optimizer\n",
        "\n",
        "    ####################\n",
        "    # DATA RELATED HOOKS\n",
        "    ####################\n",
        "\n",
        "    def prepare_data(self):\n",
        "        # download\n",
        "        MNIST(self.data_dir, train=True, download=True)\n",
        "        MNIST(self.data_dir, train=False, download=True)\n",
        "\n",
        "    def setup(self, stage=None):\n",
        "\n",
        "        # Assign train/val datasets for use in dataloaders\n",
        "        if stage == \"fit\" or stage is None:\n",
        "            mnist_full = MNIST(self.data_dir, train=True, transform=self.transform)\n",
        "            self.mnist_train, self.mnist_val = random_split(mnist_full, [55000, 5000])\n",
        "\n",
        "        # Assign test dataset for use in dataloader(s)\n",
        "        if stage == \"test\" or stage is None:\n",
        "            self.mnist_test = MNIST(self.data_dir, train=False, transform=self.transform)\n",
        "\n",
        "    def train_dataloader(self):\n",
        "        return DataLoader(self.mnist_train, batch_size=BATCH_SIZE)\n",
        "\n",
        "    def val_dataloader(self):\n",
        "        return DataLoader(self.mnist_val, batch_size=BATCH_SIZE)\n",
        "\n",
        "    def test_dataloader(self):\n",
        "        return DataLoader(self.mnist_test, batch_size=BATCH_SIZE)\n",
        "\n",
        "\n",
        "model = LitMNIST()\n",
        "trainer = Trainer(\n",
        "    accelerator=\"auto\",\n",
        "    devices=1 if torch.cuda.is_available() else None,  # limiting got iPython runs\n",
        "    max_epochs=20,\n",
        "    callbacks=[TQDMProgressBar(refresh_rate=20)],\n",
        "    logger=CSVLogger(save_dir=\"logs/\"),\n",
        ")\n",
        "trainer.fit(model)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "fXKx8i3yOlED"
      },
      "source": [
        "We can go ahead and check the training curves which will give us an idea if the model has already converged. Notice that if you run this experiment multiple times, PyTorch Lightning will save the logs in separate folders so you may have to change the path below."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 281
        },
        "id": "7JAz7jQfLtKj",
        "outputId": "70b692a6-af19-4e38-def0-ee888b1ea18b"
      },
      "outputs": [
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "<Figure size 432x288 with 2 Axes>"
            ],
            "image/png": "iVBORw0KGgoAAAANSUhEUgAAAXoAAAEICAYAAABRSj9aAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4yLjIsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+WH4yJAAAgAElEQVR4nO3deXxU9bn48c+THbJBFsKWhB2JgqARBBewLsV9t+Buba3tte291ntbf3ptr73WLna7rdqitYoWUala3FdQ2RfZBGSHBAJkgQQIJCHJ8/vjnOAYEzJJZubMTJ736zUvzpxtngxnnvnO93wXUVWMMcZErxivAzDGGBNcluiNMSbKWaI3xpgoZ4neGGOinCV6Y4yJcpbojTEmylmiDzARUREZ4i7/RUT+2599O/A6N4jIux2N03RNdn12TZbomxGRt0XkwRbWXy4ie0Qkzt9zqeqdqvrzAMQ0wP3QHXttVf2Hql7Q2XO38FqTRGRnoM9rAqOrX58+rzlQRBpF5PFgvUY0sUT/Vc8AN4qINFt/E/APVa33ICZjmtj16bgZ2A98Q0QSQ/nCIhIbytcLBEv0X/UqkAmc1bRCRHoClwDTRWSsiCwUkUoR2S0ifxaRhJZOJCJPi8j/+jz/T/eYEhH5ZrN9LxaRFSJyQESKReRnPps/dv+tFJFDIjJeRG4VkXk+x08QkaUiUuX+O8Fn21wR+bmIzBeRgyLyrohktfeNEZER7rkqRWStiFzms+0iEVnnnn+XiNzjrs8SkdfdY/aJyCciYtddx3X569P9krsZuB84ClzabPvlIrLSjXWLiEx212eIyN/dv2+/iLzqrv9SrO463yqup0XkcRF5U0SqgXPaeD8QkTNFZIH7/1DsvsZpIrLX94tCRK4SkVWt/a0Bo6r2aPYAngCe9Hn+HWClu3wqcDoQBwwA1gP/7rOvAkPc5aeB/3WXJwN7gZOAZGBGs30nASNxvnxHufte4W4b4O4b5/M6twLz3OUMnNLNTW5cU93nme72ucAWYBjQzX3+y1b+9knAzhbWxwObgf8HJABfAw4Cw93tu4Gz3OWewCnu8sPAX9zj43ESlHj9fxzJj658fbr7nwXUutfZn4DXfLaNBaqA891Y+wEnuNveAF5wj4sHJjaP9TjvUxVwhnvOpDbej3z3szHVfZ1MYLS7bR1woc/rvAL8KNjXjJWsWvYMcI2IJLnPb3bXoarLVXWRqtar6nbgr8BEP855HfB3Vf1MVauBn/luVNW5qrpGVRtVdTXwvJ/nBbgY2KSqz7pxPQ98zpdLOn9X1Y2qegR4ERjt57mbnA6k4HwA61T1Q+B1nIsZnJJVgYikqep+Vf3UZ30fIF9Vj6rqJ+pe4abDuvr1eQvwlqrux/lCmiwivdxttwNPqep7bqy7VPVzEekDXAjc6V6fR1X1Iz/jB/iXqs53z1nTxvtxPfC+qj7vvk6Fqq50tz0D3AjOLwzg6+7fEFSW6FugqvOAcuAKERmMU0qYASAiw9yqiD0icgD4BeBPNUhfoNjn+Q7fjSIyTkTmiEiZiFQBd/p53qZz72i2bgdOaabJHp/lwzhJuz36AsWq2tjKa1wNXATsEJGPRGS8u/43OL8E3hWRrSLyk3a+rmmmK1+fItINuBb4B4CqLgSKcJIrQC7Or4PmcoF97pdDR/i+N229H63FAPAccKmIJON8uX6iqrs7GJPfLNG3bjpOSelG4B1V3euufxynNDJUVdNwqjKa3xhryW6cC6BJXrPtM4DZQK6qpuNUdzSdt60ScAnOz0VfecAuP+LyVwmQ26x+/dhrqOpSVb0c6IVTj/yiu/6gqv5IVQcBlwF3i8i5AYyrq+qq1+eVQBrwmPtltgfnC+MWd3sxMLiF44qBDBHp0cK2aqB70xMR6d3CPs3/xuO9H63FgKruAhYCV+FUZT3b0n6BZom+ddOB84Bv4/4sdqUCB4BDInIC8F0/z/cicKuIFIhId+Cnzban4pQ4akRkLF+UUADKgEZgUCvnfhMYJiLXi0iciHwDKMCpWukQEUnyfQBLcEpa/yUi8SIyCeen90wRSRCn3XS6qh7FeX8a3fNcIiJD3BtoVUBD0zbTKV31+rwFeAqnfny0+zgDOFlERgJ/A24TkXNFJEZE+onICW6p+S2cL4ie7jV8tnvOVcCJIjLavdZ/5kccx3s//gGcJyLXuX9vpoj4VkVNB/7L/Rte7sB70G6W6Fvh1m8uwLkxNdtn0z04/6kHcW6KveDn+d4C/gB8iFOV8WGzXb4HPCgiB4EHcEvE7rGHgYeA+e5d/NObnbsCp9XFj4AKnIvoElUt9ye2FvQDjjR75OIk9gtxqg0eA25W1c/dY24CtrvVBXcCN7jrhwLvA4dwSjKPqeqcDsZlXF3x+hSRfsC5wB9UdY/PYznwNnCLqi4BbgN+j1Ow+Igvfk3chHPP6HOgFPh3N76NwIM41+km4EstcFpxvPejCKca80fAPmAlcLLPsa+4Mb3ivndBJ3ZfzBhjQktEtgDfUdX3Q/F6VqI3xpgQEpGrcer8m/9qChq/u0sbY4zpHBGZi3N/4qZmLdiCykr0pssSkckiskFENrfU7FNE8kXkAxFZLU7vzf7u+nPE6XnZ9KgRkStC/xeYSKOqk1S1l6q+E8rXtTp60yW53dA34vSg3AksBaaq6jqffV4CXlfVZ0Tka8BtqnpTs/Nk4Ny87B+qG2vGtFfYVd1kZWXpgAEDvA7DRLHly5eX47Tp36yqWwFEZCZwOU4X9SYFwN3u8hyc/gHNXYPTS7PNJG/Xtgmm5cuXl6tqdkvbwi7RDxgwgGXLlnkdholiItLUK9O3t+NOYFyzXVfhdGz5I05HnVQRyXSbCzaZAvzuOK91B3AHQF5enl3bJmjc67pFVkdvTOvuASaKyAqccUx24XT4AsAdP2Uk0Gp9q6pOU9VCVS3Mzm6xsGVM0IVdid6YENnFl7v896dZl3xVLcEp0SMiKcDVqlrps8t1OJ1ejgY5VmM6xUr0pqtaCgwVZ6aiBJwqGN8epk1j6Td9Ru7F6XrvayrOqIXGhDVL9KZLUmcmprtwql3WAy+q6loReVC+mFBlErBBRDYCOTjd/AFn+jycXwTtGerWGE9Y1Y3pslT1TZwBt3zXPeCzPAuY1cqx2/nyMLvGhC0r0RtjTJSzRG+MMVEuYhL9mp1V/OrtzzlS19D2zsYYE0WONjTy8cYyfvHmejoymkHE1NFv3HuQx+du4brCXAZmJXsdjjHGBFV9QyMLt1bwxurdvL12D5WHj5KcEMtNp+eTm9G97RP4iJhE3ystEYDSAzWW6I0xUam+oZFFW/fxxpoS3v5sD/vd5H5eQQ4XjezDxGHZJMXHtvu8kZPoU50J70sP1nociTHGBNbO/Yd5YWkxLywtpvRgLd0TYjlvhJPcJw3vWHL3FUGJ3i3RW6I3xkSB+oZGPvy8lBlLivhoYxkAk4Zl8z+FuZxzQq9OJ3dfEZPoe3SPJyE2htKDNV6HYowxHVLf0EjRvsO8umIXLywrZu+BWnLSEvn+OUO47rRc+vdsX927vyIm0YsI2amJlB2wEr0xJnw1NiobSw+yrayaon2Hv/TYtf8I9Y2KCJw9NJsHL8/j3BN6ERcb3AaQEZPowbkha1U3xphw09iorCiu5M01u3lzzW52V31R89Cjezx5Gd05qV86F43sQ15Gd84cktXuljOdEVmJPjWRbeXVXodhjDGoOsn9jdW7eWvNbkqqakiIjeHsYVncff4wRvRJIzejO+nd4r0ONdISfRKLt+3zOgxjTBdUc7SBdbsP8NmuKlbvrGLhlgp2VR45ltzv+fpwzivIIS3J+8TeXIQl+kQqDx+ltr6BxLjA3ZE2xhhfjY3Kut0HWFG0n9U7q1izq4pNpYdoaHR6pWYmJzAmryc/umBY2CZ3X5GV6N1OU2UHa4N2d9oY0zUV7zvMvM3lzNtUzoIt5ew/7Mwnk5GcwMh+6Zw3IoeT+qUzqn86fdKTEBGPI/ZfZCV6t9PU3gOW6I0xndPYqHzweSlzNpQyf3M5Oyqc+d1z0hL52gk5nDk0k9MGZNCvR7eISuotiahEn53aVKK3tvTGmI5bW1LFA/9ay/Id+0lJjOP0QRncNmEAZw7NYnB2SsQn9uYiKtEfG+/GmliaABCRycAfgVjgSVX9ZbPt+TjTB2YD+4AbVXWnuy0PeBJnlikFLnInIzFhrOrIUX7/3kamL9xOz+4J/PqaUVw5ph/xQW7H7rWISvSZyYnECJRapynTSSISCzwKnA/sBJaKyGxVXeez2yPAdFV9RkS+BjwM3ORumw48pKrvuROHN4YwfNNOqsrLn+7i4bfWs6+6jhtPz+dH5w8nvXt430QNlIhK9LExQlZKog2DYAJhLLBZVbcCiMhM4HLAN9EXAHe7y3OAV919C4A4VX0PQFUPhSpo037rdx/ggX99xtLt+xmd24OnbxvLSf3SvQ4rpPxK9G39xPXZ72qcOTZPU9Vl7rp7gduBBuAHqvpOZwK23rEmQPoBxT7PdwLjmu2zCrgK59q/EkgVkUxgGFApIi8DA4H3gZ+o6ldmxRGRO4A7APLy8gL9Nxhgw56DvLlmN1VHjnLgyFGqmj3KD9WS3i2eX109kmtPzSUmJrrq3/3RZqL38ycuIpIK/BBY7LOuAJgCnAj0Bd4XkWEtfSD81Ss1iT1VVqI3IXEP8GcRuRX4GNiFU2CJA84CxgBFwAvArcDfmp9AVacB0wAKCwvbPzWQOa6yg7Xc8OQiyg/VkZoYR1q3eNLdx+DsFNK7xdO3RzdumZBPj+4JXofrGX9K9P78xAX4OfAr4D991l0OzFTVWmCbiGx2z7ewowH3Sk1k9c6qjh5uTJNdODdSm/R31x2jqiU4JXrcevirVbVSRHYCK30+E68Cp9NCojfBo6r856xVHKip551/P5vhvVO9Dils+XOruaWfuP18dxCRU4BcVX2jvce2V6/URCqqa6lvsHtfplOWAkNFZKCIJOD88pztu4OIZIlI02fkXpwWOE3H9hCRbPf51/hqwccE2fSFO5i7oYz7LhphSb4NnW5T5H4Qfgf8qBPnuENElonIsrKysuPum52WhCpUVNd19OWMQVXrgbuAd4D1wIuqulZEHhSRy9zdJgEbRGQjkAM85B7bgFOt84GIrAEEeCLEf0KXtnHvQR56cz3nDM/m5vH5XocT9vypumnrJ24qcBIw1+1k0BuY7X5Y2vx5DO2rxzw209SBWnLSkvwI35iWqeqbwJvN1j3gszwLp3FBS8e+B4wKaoCmRTVHG/jB8ytIS4rj19ecHHWdm4LBnxL9cX/iqmqVqmap6gBVHQAsAi5zW93MBqaISKKIDASGAks6E/AXUwraDVljuqJfv72Bz/cc5DfXnHyst7w5vjZL9KpaLyJNP3FjgaeafuICy1R19nGOXSsiL+LUX9YD/9aZFjcAvdJsknBjuqqPNpbx1Pxt3DI+n3NO6OV1OBHDr3b0bf3EbbZ+UrPnD+HWbQZCdsoXVTfGmK6j4lAt97y0imE5Kdx70Qivw4koEdUzFiAhLoaM5ASrujGmC1FVfvzPNVQdPsr0b44lKd7mo2iPiBzJp1eq9Y41pit5btEO3l+/lx9feAIj+qR5HU7EibgSPTjDFVuiNya6Ha6r5/XVu5mxuIiVxZWcNTSL2yYM8DqsiBSRib5XahJbSsu9DsMYEwSf7znAjMVFvLJiFwdr6hnSK4UHLingG6d1zXFqAiEyE707sFljo9p/vDFR4EhdA2+s2c2MxTv4tKiShLgYLjqpN9ePy+e0AT2trXwnRWaiT02kvlHZf7iOzBRrR2tMpNq49yAzFhfx8qc7OVBTz6DsZO6/eARXn9KfnslddxCyQIvQRP9FW3pL9MZElpqjDbyxejczlhSxfMd+EmJjuHBkb6aOzWPcwAwrvQdBZCZ6nykFR/TxOBhjjF9KD9Tw2NwtX5Tes5K576IRXH1qfzKs9B5UkZnoj413Y23pjYkEJZVHmDJtEburjjD5pD5cPzaP0wdZ6T1UIjTR2zAIxkSKpiS/v7qOl+6cwOjcHl6H1OVEZIepbgmxpCbGUWaJ3piwtrvqCFOfcJL8s98aZ0neIxGZ6AGy02yScGPC2e4qpyS/71Ad028fa0neQxGb6HulJtrAZqZTRGSyiGwQkc0i8pMWtueLyAcislpE5opIf59tDSKy0n20OoJrV7Wnqoap0xZRcaiOZ24fy5i8nl6H1KVFcKJPsjp602E+k95fCBQAU93J7H09AkxX1VHAg8DDPtuOqOpo93EZ5pg9VTVMmbaQcrckf4olec9FcKJ3qm5UjzshlTGtOTbpvarWAU2T3vsqAD50l+e0sN00s6eqhqlPLKL8UB3PfNOSfLiI3ESflkjN0UYO1tZ7HYqJTP5MXL8KuMpdvhJIFZFM93mSO8/xIhG5orUXac98yJHuQM1RbvzbYsoO1vLMN0/j1HxL8uEichN9UxNLq6c3wXMPMFFEVgATceY7bpohLV9VC4HrgT+IyOCWTqCq01S1UFULs7OzQxK0F+obGvn+jBVsL69m2s2ncmp+htchGR8RnOht7ljTKW1OXK+qJap6laqOAe5z11W6/+5y/90KzAXGhCDmsPXwW5/z0cYyHrz8JCYMzvI6HNNM5CZ6dxgEa0tvOui4k94DiEiWiDR9Ru4FnnLX9xSRxKZ9gDNw5kXukl5YWsTf5m3j1gkDuH5cntfhmBZEbKLPtqob0wmqWg80TXq/HnixadJ7EWlqRTMJ2CAiG4Ecvpj7eASwTERW4dyk/aWqdslEv3hrBfe/+hlnDc3i/ottHtdwFZFDIACkJcWRFB9jVTemw9qa9F5VZwGzWjhuATAy6AGGuaKKw9z53HJyM7rz5+tPIS42YsuNUS9i/2dEhF6pSey1Er0xIXew5ijfmr6URoW/3XIa6d3ivQ7JHEfElujhi7b0xpjQaWhUfjhzJVvKqpn+zbEMzEr2OiTTBr9K9H50Fb9TRNa43cHnNfUwFJEBInLEp6v4XwIZfNOUgsaY0PnV25/z4eel/OzSAs4YYi1sIkGbJXqfruLn43QqWSois5vdfJqhqn9x978M+B0w2d22RVVHBzZsR6/UJD7ZaJOEGxMqi7dWMO3jrdx4eh43jR/gdTjGT/6U6NvsKq6qB3yeJgMhGZcgOzWRg7X1HKlraHtnY0ynNDQq//PaOvqmJ3HfRc2HBTLhzJ9E709XcUTk30RkC/Br4Ac+mwaKyAoR+UhEzmrpBTraTdw6TRkTOi8uK2bd7gPce9EIuiXEeh2OaYeAtbpR1UdVdTDwY+B+d/VuIM/tWXg3MENE0lo4tkPdxHul2UxTxoTCgZqjPPLOBk4b0JNLRtlEzZHGn0TfZlfxZmYCVwCoaq2qVrjLy4EtwLCOhfpVX8wda4nemGD684eb2Xe4jgcuOdHmeY1A/iR6f7qKD/V5ejGwyV2f7d7MRUQGAUOBrYEIHKzqxphQ2FZezd/nb+OaU/ozsn+61+GYDmiz1Y2q1otIU1fxWOCppq7iwDJVnQ3cJSLnAUeB/cAt7uFnAw+KyFGgEbhTVfcFKvie3ROIixGrujEmiB56Yx0JsTH85+ThXodiOsivDlN+dBX/YSvH/RP4Z2cCPJ6YGCHbphQ0Jmg+2VTG++tL+fHkE44NDW4iT8QOgdDEescaExz1DY38/PV15GV055tnDvA6HNMJEZ/os1OTbKhiY4JgxpIiNu49xH0XjyAxzppTRrKIT/Q2DIIxgVd5uI7fvbeRCYMzuaAgx+twTCdFfqJPTWRfdR119Y1eh2JM1PjD+5s4cOQoD1xaYM0po0AUJHrnBlH5ISvVm/bzY8C+fBH5QERWi8hcEenfbHuaiOwUkT+HLurg2lx6kGcX7WDq2DxO6P2V/o0mAkVBom9qS2+J3rSPz4B9FwIFwNSmkVd9PAJMV9VRwIPAw822/xz4ONixhtKjc7aQGBfD3ecHrG+j8VjkJ/q0pt6x1vLGtFubA/bhfAF86C7P8d0uIqfiTDH4bghiDYmd+w8ze1UJU8fmkZmS6HU4JkAiP9G7VTd7rURv2s+fAftWAVe5y1cCqSKS6U4a/lvgnqBHGUJPfrKNGIFvnTXQ61BMAEV8os9KSUAEyqxEb4LjHmCiiKwAJuKM89QAfA94U1V3Hu/gjo7M6oWKQ7XMXFrEFaP70Se9m9fhmACK6KkEAeJiY8hMtiaWpkPaHLBPVUtwS/QikgJcraqVIjIeOEtEvgekAAkickhVf9Ls+GnANIDCwsKQzNPQUc8s3EHN0Ua+M3GQ16GYAIv4RA9NvWMt0Zt2OzZgH06CnwJc77uDiGQB+1S1EbgXeApAVW/w2edWoLB5ko8k1bX1PLNgOxcU5DCkV6rX4ZgAi/iqG2jqNGVVN6Z9VLUeaBqwbz3wYtOAfe6UmACTgA0ishHnxutDngQbZDOXFlN15Ch3ThrsdSgmCKKmRL+u5EDbOxrTjB8D9s0CZrVxjqeBp4MQXkjU1Tfy5CdbGTcwg1PyenodjgmC6CjRpyZRfqiWhsawrgI1Jiz9a+UudlfV8F0rzUet6Ej0aYk0KlRUWz29Me3R2Kj89eOtjOiTxsRh/k/jaSJLdCR6m1LQmA55f/1eNpce4s6Jg2xMmygWFYk+2+00ZcMVG+M/VeXxj7aQm9GNi0fahN/RLCoSfY47DMKuyiMeR2JM5FiybR8riiq546xBxMVGRSowrYiK/91+PbqRlZLA0u0Bm47WmKj3+EdbyExO4NrC3LZ3NhEtKhK9iDBhcBYLtlSgai1vjGnL+t0HmLuhjG+eOZCkeJs9KtpFRaIHOGNIJmUHa9lUesjrUIwJe098vJXkhFhuHJfvdSgmBKIm0U8YnAXAvE3lHkdiTHirOFTL66t3c21hLund470Ox4SAX4nej1l47hSRNSKyUkTm+U7eICL3usdtEJGvBzJ4X7kZ3cnL6M6CLZbojTmeF5YVU9fQyI2n53kdigmRNhO9n7PwzFDVkao6Gvg18Dv32AKcgaJOBCYDj7nnC4ozhmSxaOs+6hts/lhjWtLQqPxjURHjB2Xa4GVdiD8l+jZn4VFV34FmkoGmO6KXAzNVtVZVtwGb3fMFxRlDMjlUW8+qnVXBegljItqcz0vZVXmEm8db3XxX4k+i92cWHkTk30RkC06J/gftPDYgkzOMH5QJwILNVn1jTEueXbSDnLREzivI8ToUE0IBuxmrqo+q6mDgx8D97Tx2mqoWqmphdnbHx9vITEmkoE8a862e3piv2FFRzUcby7h+bD7x1kGqS/Hnf7vNWXiamQlc0cFjO+2MIZl8uqOSI3UNwXwZYyLOc4t2EBcjTBlrHaS6Gn8S/bFZeEQkAefm6mzfHURkqM/Ti4FN7vJsYIqIJLqz+AwFlnQ+7NZNGJJFXUOj9ZI1xkfN0QZeXLaTr5/Ym5y0JK/DMSHWZqL3cxaeu0RkrYisBO4GbnGPXQu8CKwD3gb+TVWDWtQeOyCD+Fix6hvjFz+aDueLyAcislpE5opIf5/1n7pNiteKyJ2hj95/s1eVUHXkKDfZTdguya8ZpvyYheeHxzn2IUI4/VpyYhxjcnuyYHNFqF7SRCifpsPn4zQUWCois1V1nc9ujwDTVfUZEfka8DBwE7AbGK+qte6k4Z+5x5aE+M/wy3OLdjC0VwrjBmZ4HYrxQFTekZkwJJPPSqqoPFzndSgmvLXZdBin78iH7vKcpu2qWqeqTeNiJxLGn6VVxZWs3lnFTePzbcz5LipsL87OOHNIFqqwcIuV6s1x+dP8dxVwlbt8JZAqIpkAIpIrIqvdc/yqpdJ8oJoOd8b0hTtITojlyjFfadlsuoioTPQn5/YgOSHW6ulNINwDTBSRFcBEnFZjDQCqWqyqo4AhwC0i8pXG6YFqOtxR+6vreG11CVee0o/UJBvXpquKykQfHxvD2IEZzLd6enN8bTb/VdUSVb1KVccA97nrKpvvA3wGnBXccNvvxWXF1NU3ctPpA7wOxXgoKhM9OOPebCuvpsRmnTKt86fpcJaINH1O7gWectf3F5Fu7nJP4ExgQ8gi90Njo/Lc4h2MHZjB8N42rk1XFtWJHmC+DYdgWuFn0+FJwAYR2Qjk8EULshHAYhFZBXwEPKKqa0L6B7Tho01lFO87wk2nW5PKrs6v5pWRaHhOKpnJCczfXG5TpZlW+dF0eBYwq4Xj3gNGBT3ATnh24Q6yUxP5+om9vQ7FeCxqS/QxMcL4wZnMt+kFTRe0q/IIczaUMuW0XBLiovZjbvwU1VfAmUOyKDtYy2abXtB0MS8udVqNXme/Zg1Rnuib6unnWT296UIaGpWXlhVz5pAscjO6ex2OCQNRnehzM7qTm9HNmlmaLuXjTWWUVNUwdaxNFWgcUZ3owam+Wby1wqYXNF3GzCVFZCYncN4Im1zEOKI+0U8YnMXB2nrW7LLpBU30Kz1YwwfrS7n61P52E9YcE/VXwoTBzvSC1p7edAX/XL6L+kblG6fZTVjzhahP9JkpiZzYN4231+7xOhRjgkpVeWFpEWMHZjA4O8XrcEwYifpED04Ts892HWD1zsq2dzYmQi3cWsH2isNMsdK8aaZLJPorT+lHt/hY/rGoyOtQjAmaF5YWk5YUx0Uj+3gdigkzXSLRpyXFc/novsemUzMm2lQeruOtz/Zw5Zh+JMXHeh2OCTNdItED3DAunyNHG3h1xa62dzYmwrz86S7q6hv5xmnWdt58VZdJ9CP7pzOqfzr/WLzDxr4xUUVVmbm0iJP7p1PQN83rcEwY6jKJHuCGcXls3HuIZTv2ex2KMQGzoriSjXsPMcV6wppWdKlEf+nJfUlNiuO5RTu8DsWYgJm5pIjuCbFcenJfr0MxYcqvRC8ik0Vkg4hsFpGftLD9bhFZJyKrReQDEcn32dYgIivdx+zmx4ZS94Q4rj6lP2+t2UPFoVovQzFhwI/rOt+9nleLyFwR6e+uHy0iC0VkrbvtG6GP3nGw5iivrdrNpaP6kpIYtdNLmE5qM9GLSCzwKHAhUABMFZGCZrutAArdiZJnAb/22XZEVUe7j8vw2PXj8qhraGTW8p1eh2I85Od1/Qgw3b2uHwQedlQoYpgAABgESURBVNcfBm5W1ROBycAfRKRHaCL/stdW7ebI0QamjLW286Z1/pToxwKbVXWrqtYBM4HLfXdQ1Tmqeth9ughnkuWwNCwnlbEDMpixpIjGRrsp24W1eV3jfAF86C7PadquqhtVdZO7XAKUAtkhibqZmUuLOKF3KqNzPfmeMRHCn0TfDyj2eb7TXdea24G3fJ4nicgyEVkkIle0dICI3OHus6ysrMyPkDrnhtPz2FFxmPlbbPybLsyf63oVcJW7fCWQKiKZvjuIyFggAdjS0osE89reXHqQ1Tur+MZpuYhIQM9toktAb8aKyI1AIfAbn9X5qloIXI/zE3dw8+NUdZqqFqpqYXZ28AtGk0/qTUZygvWUNW25B5goIiuAicAuoKFpo4j0AZ4FblPVFsfBDua1vWSb03rsnOG9AnpeE338SfS7AN8KwP7uui8RkfOA+4DLVPXYnU5V3eX+uxWYC4zpRLwBkRgXy7Wn9ue99XvZe6DG63CMN9q8rlW1RFWvUtUxONc2qloJICJpwBvAfaq6KDQhf9nK4v307B5PfqbNImWOz59EvxQYKiIDRSQBmAJ8qfWMiIwB/oqT5Et91vcUkUR3OQs4A1gXqOA74/pxeTQ0KjOXFLe9s4lG/lzXWSLS9Bm5F3jKXZ8AvIJzo3ZWCGP+khVFlYzO7WHVNqZNbSZ6Va0H7gLeAdYDL6rqWhF5UESaWtH8BkgBXmrWjHIEsExEVuHczPqlqoZFos/PTOasoVnMXFpks091QX5e15OADSKyEcgBHnLXXwecDdzq03R4dCjjP1BzlM1lhxiT1zOUL2silF8Nb1X1TeDNZuse8Fk+r5XjFgAjOxNgMN0wLp87n1vOnA1lnF9g0651NX5c17Nwmgs3P+454LmgB3gcq4urUMVa2xi/dKmesc2dO6IXOWmJ1lPWRJyVxc6N2JMt0Rs/dOlEHx8bw9SxeXy0sYyNew96HY4xfltRVMng7GTSu8V7HYqJAF060QPcMn4AyQmxPDpns9ehGOMXVWVlcaXVzxu/dflE3zM5gRvH5/PaqhK2lVd7HY4xbSred4SK6jqrnzd+6/KJHuBbZw4iPjaGx6xUbyLACrd+fkyeJXrjH0v0QHZqIlPH5vHKil0U7zvc9gHGeGhFUSXd4mMZnpPqdSgmQliid31n4iBiRPjLRy0OWWJM2FhZXMnI/unExdrH1/jHrhRXn/RuXFPYn5eW7WRPlQ2LYMJTbX0D60oOMMbq5007WKL38d2Jg2lQZdrHW70OxZgWrSs5QF1Do9XPm3axRO8jN6M7V47px4wlOyi3GahMGFpRVAnA6FxrWmn8Z4m+me9NGkxtfSNPfrLN61CM+YqVxZX0SU+id3qS16GYCGKJvplB2SlcMqovzy7cTuXhOq/DMeZLVhTvt/bzpt0s0bfgrnOGUF3XwFPzt3sdijHHlB+qpXjfEaufN+1mib4Fw3un8vUTc3h6/jYO1Bz1OhxjAFhp9fOmgyzRt+Kuc4ZyoKaeZxfayJYmPKwsriQ2RhjZL93rUEyEsUTfipH90zlneDZ/m7eN6tp6r8MxQSAik0Vkg4hsFpGftLA9X0Q+EJHVIjJXRPr7bHtbRCpF5PVQxbuieD8n9E6lW0JsqF7SRAlL9Mfxg3OHsv9wHT9/PSwmxTIBJCKxwKPAhUABMFVECprt9gjOdIGjgAeBh322/Qa4KRSxAjQ0KquKq6x+3nSIJfrjGJPXk+9NGszMpcX8a+VX5kM3kW0ssFlVt6pqHTATuLzZPgXAh+7yHN/tqvoBELJJDLaUHeJQbb3Vz5sOsUTfhv84bxiF+T35fy+vYbsNYxxN+gG+M8PvdNf5WgVc5S5fCaSKSGYIYvuKphuxVqI3HWGJvg1xsTH8ceoY4mJjuOv5T6mtb/A6JBM69wATRWQFMBHYBbTrAhCRO0RkmYgsKysr63AgK4r3k5YUx8DM5A6fw3Rdluj90K9HNx659mQ+23WAX771udfhmMDYBeT6PO/vrjtGVUtU9SpVHQPc566rbM+LqOo0VS1U1cLs7OwOB7uiqJLReT2JiZEOn8N0XZbo/XR+QQ63ThjA3+dv5711e70Ox3TeUmCoiAwUkQRgCjDbdwcRyRKRps/IvcBTIY4RgOraejbuPWg9Yk2H+ZXo/WiGdreIrHOboX0gIvk+224RkU3u45ZABh9q9150Aif1S+Oel1axq/KI1+GYTlDVeuAu4B1gPfCiqq4VkQdF5DJ3t0nABhHZCOQADzUdLyKfAC8B54rIThH5erBiXb2zika1+nnTcW0mej+boa0ACt1maLOAX7vHZgA/BcbhtHL4qYhEbLOBxLhY/jz1FBoalR8+v4L6hkavQzKdoKpvquowVR2sqg+56x5Q1dnu8ixVHeru8y1VrfU59ixVzVbVbqraX1XfCVacTVMHju5vid50jD8l+jaboanqHFVtmoNvEU59J8DXgfdUdZ+q7gfeAyYHJnRvDMhK5qErT2LZjv38/v2NXodjuoCVRZUMzEqmZ3KC16GYCOVPovenGZqv24G32nNsoFomhMrlo/vxjcJcHpu7hY82hn+8JnKpKiuKK61+3nRKQG/GisiNQCFOr0G/BaplQij97LITGZ6TyvdnfMqWskNeh2OiVElVDWUHa61+3nSKP4m+zWZoACJyHk4TtMt86jL9OjYSdUuI5YmbC4mPjeH2p5eyv9rGrjeBt6LIqZ8fYz1iTSf4k+j9aYY2BvgrTpIv9dn0DnCBiPR0b8Je4K6LCrkZ3Zl286mUVNZw53PLqau3m7MmsNaWHCAuRjihT6rXoZgI1mai97MZ2m+AFOAlEVkpIk2tFvYBP8f5slgKPOiuixqn5mfw62tGsXjbPv771c9QVa9DMlFke3k1eRndiY+1Li+m4+L82UlV3wTebLbuAZ/l845z7FN41NEkVK4Y048tZYf404ebGdIrhW+fPcjrkEyU2F5xmAFZNuyB6RwrJgTIf5w3jItG9uYXb623nrMmIFSVHRXVDLDxbUwnWaIPkJgY4bfXjmZkv3R+OHMF60oOeB2SiXClB2s5XNfAgKzuXodiIpwl+gBqaomTlhTPt55ZSunBGq9DMhFsmzsstpXoTWdZog+wnLQknrylkP2Hj3Lb35dScai27YOMaUHT/AcDrY7edJIl+iA4qV86j994CptLD3HdXxdSYgOgmQ7YXnGYhNgY+vbo5nUoJsJZog+SScN78ezt4yg9UMs1jy9gq/WeNe20vbya3IxuxNoY9KaTLNEH0diBGTx/x+nU1jdy7V8W8tmuKq9DMhFke0W1VduYgLBEH2Qn9UvnpTvHkxQfy9Rpi1i8tcLrkEwEaGxUtldUk283Yk0AWKIPgUHZKbx053h6pSVy81NL+PBza2dvjm/vwRpqjjZaZykTEJboQ6Rvj268dOcEhuWkcsf05by6IirGdot4fsyelu/OmrZaROaKSH+fbUGbPa2paaVNBm4CwRJ9CGUkJzDj2+MoHNCTf39hJX/5aIuNjeMhP2dPewSY7s6e9iDwsHtsUGdP21HhzONjnaVMIFiiD7HUpHievm0sl4zqwy/f+pz/98pnNiWhd9qcPQ3nC+BDd3mOz/agzp62vbyahLgY+qZb00rTeZboPZAUH8v/TRnD9yYN5vklRXzzmWUcrDnqdVhdkT8zoK0CrnKXrwRSRSTTz2M7PHvaNnfUyhhrWmkCwBK9R2JihP+afAK/vGok8zeXc+1frGNVmLoHmCgiK4CJOBPnNPh7cEdnT9tug5mZALJE77EpY/N4+rbT2LX/CFc8Ot/a2odWmzOgqWqJql6lqmNwZlBDVSv9ObajGhuVHRWHGWj18yZALNGHgbOGZjPruxOIj43hur8u5IP11vwyRPyZPS1LRJo+J/fyxdwKQZs9bc+BGmrrrWmlCRxL9GFieO9UXvneBAZnp/Dt6cv484ebaGi0FjnB5OfsaZOADSKyEcgBHnKPDdrsadutaaUJML9mmDKh0SstiRe+czo//ucaHnl3I/M2l/OHb4yhd3qS16FFLT9mT5sFzGrl2KDMnratwkn0+VaiNwFiJfow0z0hjv+bMprfXDOK1TurmPzHj3l37R6vwzIhtL28msS4GPqk2Re8CQxL9GFIRLi2MJfXv38m/Xp0445nl/Pfr35GzVG/G3uYCLat/DD5mda00gSOJfowNig7hZe/N4FvnTmQZxft4PI/z2fj3oNeh2WCzOaJNYFmiT7MJcbFcv8lBTx922lUVNdy6Z/m8eiczVQdsQ5W0aixUdmx77ANT2wCyq9E78fAT2eLyKciUi8i1zTb1iAiK93H7ObHGv9MGt6Lt354NmcNzeI372xgwsMf8L+vr7NOVlGmpOoIdfWNNjyxCag2W934DPx0Pk4376UiMltV1/nsVgTcitOLsLkjqjo6ALF2edmpiTx5y2msLaniiY+38vcF23l6wXYuPbkv3z5rEAV907wO0XTS9nIbzMwEnj8l+jYHflLV7aq6GrDRuULgxL7p/GHKGD7+r3O4ZcIA3l27h4v+7xNu+ttiFmwp9zo80wlNTSut6sYEkj+J3q/Bm44jyR3UaZGIXNHSDh0d+Kmr69ejG/99SQEL7j2XH08+gQ17DnL9E4v51jNLj41nbiLLjvJqkuJjyEm1ppUmcEJxMzZfVQuB64E/iMjg5jt0dOAn40jvFs93Jw3mkx+fw70XnsCirfu44Pcf8dAb6zhgo2JGlKbBzKxppQkkfxJ9pwZvUtVd7r9bgbnAmHbEZ9ohMS6W70wczIf3TOSqMf15ct42zvnNXJ5fUmTDKUSIbeXV5Gda/bwJLH8SfZsDP7XGHfAp0V3OAs4A1h3/KNNZvVKT+NU1o3jtrjMZlJ3MvS+v4dI/zWPhlgqb0SqMNTQqxfuO2GBmJuDaTPT+DPwkIqeJyE7gWuCvIrLWPXwEsExEVuHMzvPLZq11TBCd1C+dF78znj9NHUPVkaNMfWIR5/72Ix55ZwPrSg5Y0g8zJZVHqGtotMHMTMD5NaiZHwM/LcWp0ml+3AJgZCdjNJ0gIlx6cl/OL8jhn5/u5I3Vu3ls7mb+PGczA7OSuWhkby4a2YeCPmmIWL2wl7a7LW6sRG8CzUav7CKS4mO5YVw+N4zLp/xQLe+s3cOba3bz+NwtPDpnCwOzkvnWWQOZcloesXYj0BPHhie2RG8CzBJ9F5SVkngs6VccquXddXuZtXwn973yGS8sLebnl5/Eybk9vA6zy9lWfphu8bH0Sk30OhQTZWysmy4uMyWRqWPzmHXneP44ZTR7qmq44rH53PvyGvZX13kdXtD5MbxHnojMEZEVIrJaRC5y1yeIyN9FZI2IrBKRSZ2NZXuF0+LGqtBMoFmiN4BTl3/56H588KOJ3H7GQF5cVsw5v3WaZjZGadNMn+E9LgQKgKkiUtBst/txGiCMwWlx9pi7/tsAqjoSZ3iQ3/pMOdgh28urrdrGBIUlevMlqUnx3H9JAW/+4CyG5aRy78truPLxBXyyqYza+qgbD7/N4T0ABZoGEUoHStzlAuBDAFUtBSqBwo4GUt/QSNG+w3Yj1gSF1dGbFg3vncoLd5zOv1aW8L9vrOemvy0hKT6GsQMzOXNIJmcMyWJE77RI78HZ0vAe45rt8zPgXRH5PpAMnOeuXwVcJiLP43QoPNX9d4nvwSJyB3AHQF5eXquBlFTWUN+o1rTSBIUletMqEeGKMf244MQcFmyuYN7mcuZvLucXb34OQEZyAhMGZzJxWDYXjuxDSmJUXk5TgadV9bciMh54VkROwpkrdgSwDNgBLAC+8pNHVacB0wAKCwtbrQM7Nk+s9Yo1QRCVn0wTWN0T4jivIIfzCnIA2Hughvmby5m3uZx5m8p5ffVufjp7LZeO6suUsbmMzu0RKTcU/Rne43ZgMoCqLhSRJCDLra75j6adRGQBsLGjgVjTShNMluhNu+WkJXHVKf256pT+qCoriit5YUkxr60u4YVlxQzPSWXK2FyuHNOPHt0TvA73eI4N74GT4KfgDL7nqwg4F3haREYASUCZiHQHRFWrReR8oL4zvb63lVeTnBBLtjWtNEFgid50iohwSl5PTsnryf2XjOC1Vbt5YWkR//PaOh5+63Mmn9ibM4dmMTq3B4OzU8KqM5aq1otI0/AescBTTcN7AMtUdTbwI+AJEfkPnBuzt6qqikgv4B0RacT5kripM7E4TSuTI+WXkIkwluhNwKQmxXP9uDyuH5fHupIDzFxaxL9WljB7ldNQJSUxjpH90jk5twejc51/+6R38zRmP4b3WIczGF/z47YDwwMVx46KwxT0sRnCTHBYojdBUdA3jQcvP4mfXXoiW8urWVVcyaqdlawsruRv87ZytMG5L9k3PYlxgzIZNzCDcYMyGdAFOwzVNzRSvO8wF57U2+tQTJSyRG+CKiZGGNIrhSG9Urj6VGfcu5qjDazffYCVxZUs276fTzaV8coK5x5or9TEY4l/wuBMBmWneBl+SOzcf4T6RrU29CZoLNGbkEuKj2VMXk/G5PXktjMGoqpsKatm8bYKFm/dx+JtFbzmVvcMykp2WvyMyOHU/J5hVccfKDZPrAk2S/TGcyJflPpvGJePqrKj4jCfbCrjvfWl/H3+NqZ9vJWe3eP52gk5nF/Qi7OGZpMcJe32m5pWDrDOUiZIouOTYqKKiDAgK5kBWcncNH4AB2uO8vHGct5fv5f31+/ln5/uJDZGyM/szpDslGNfEkN6pTA4OyXivgB2VBwmJTGOrJSwbopqIlhkfSJMl5SaFM/Fo/pw8ag+1Dc0smzHfuZtKmdT6UE2lx7iw89LqfcZeK1vehLfP3coU8e2PuRAONlWXs2ArK53E9qEjiV6E1HiYmM4fVAmpw/KPLaurr6Ron3VbC49xObSQ2wqPUR2SuR0PDq5fzpxsTa+oAkeS/Qm4iXExTCkVypDeqV6HUqH3H1BwJrjG9MiK0YYY0yUs0RvjDFRzhK9McZEOb8SvR/zap4tIp+KSL2IXNNs2y0issl93BKowI0xxvinzUTv57yaRcCtwIxmx2YAP8WZtWcs8FMR6dn5sI0xxvjLnxJ9m/Nqqup2VV0NNDY79uvAe6q6T1X3A+/hTuJgjDEmNPxJ9C3Nq9nPz/N35lhjjDEBEBY3Y0XkDhFZJiLLysrKvA7HGGOiij8dpvyZV/N4x05qduzc5jv5TqAsImUisqOV82UB5X6+dqiEW0zhFg+EX0z5Xrzo8uXLyyPo2g63eCD8Ygq3eFq9rv1J9P7Mq9mad4Bf+NyAvQC493gHqGp2a9tEZJmqFvr52iERbjGFWzwQnjF5IZKu7XCLB8IvpnCL53jarLpR1XqgaV7N9cCLTfNqishlACJymojsBK4F/ioia91j9wE/x/myWAo86K4zxhgTIn6NdePHvJpLcaplWjr2KeCpTsRojDGmE8LiZmw7TPM6gBaEW0zhFg+EZ0zhJtzeo3CLB8IvpnCLp1Wiqm3vZYwxJmJFWoneGGNMO1miN8aYKBcxib6tgdU8iGe7iKwRkZUissyjGJ4SkVIR+cxnXYaIvOcOIvdeKMcWaiWen4nILvd9WikiF4UqnkgQbtc12LXdjngi5tqOiETv58BqXjhHVUd72Jb2ab46dtBPgA9UdSjwgfvcy3gAfu++T6PdFlyGsL6uwa5tf+KBCLm2IyLR48fAal2Rqn4MNO+XcDnwjLv8DHCFx/GY1tl13Qq7tgMrUhJ9OA6OpsC7IrJcRO7wOBZfOaq6213eA+R4GYzrLhFZ7f78tWGqvxCO1zXYtd0eEXFtR0qiD0dnquopOD+7/01EzvY6oObUaTvrdfvZx4HBwGhgN/Bbb8MxfrBr2z8Rc21HSqLvzMBqQaGqu9x/S4FXcH6Gh4O9ItIHwP231MtgVHWvqjaoaiPwBOHzPoWDsLuuwa5tf0XStR0pif7YwGoikoAzsNpsr4IRkWQRSW1axhms7bPjHxUys4GmKRtvAf7lYSxNH8gmVxI+71M4CKvrGuzabo9Iurb9GuvGa6paLyJNA6vFAk+p6loPQ8oBXhERcN7DGar6dqiDEJHncYaBznIHlfsp8EvgRRG5HdgBXOdxPJNEZDTOz+ztwHdCFU+4C8PrGuzabk88EXNt2xAIxhgT5SKl6sYYY0wHWaI3xpgoZ4neGGOinCV6Y4yJcpbojTEmylmiN8aYKGeJ3hhjotz/B0R8Bo+ez0pGAAAAAElFTkSuQmCC\n"
          },
          "metadata": {
            "needs_background": "light"
          }
        }
      ],
      "source": [
        "from matplotlib import pyplot as plt\n",
        "import numpy as np\n",
        "import pandas as pd\n",
        "\n",
        "path = \"logs/lightning_logs/version_0/metrics.csv\"\n",
        "metrics = pd.read_csv(path)\n",
        "\n",
        "plt.subplot(1, 2, 1)\n",
        "plt.title(\"Validation Loss\")\n",
        "plt.plot(metrics['epoch'], metrics['val_loss'])\n",
        "\n",
        "plt.subplot(1, 2, 2)\n",
        "plt.title(\"Validation Accuracy\")\n",
        "plt.plot(metrics['epoch'], metrics['val_acc'])\n",
        "\n",
        "plt.show()\n"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "Similarly, if we wanted to use keras, you would use the following syntax."
      ],
      "metadata": {
        "id": "OLqNLvFZYIvK"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "# Adapted from https://keras.io/examples/vision/mnist_convnet/\n",
        "\n",
        "import numpy as np\n",
        "from tensorflow import keras\n",
        "from tensorflow.keras import layers\n",
        "\n",
        "# Model / data parameters\n",
        "num_classes = 10\n",
        "input_shape = (28, 28, 1)\n",
        "\n",
        "# Load the data and split it between train and test sets\n",
        "(x_train, y_train), (x_test, y_test) = keras.datasets.mnist.load_data()\n",
        "\n",
        "# Scale images to the [0, 1] range\n",
        "x_train = x_train.astype(\"float32\") / 255\n",
        "x_test = x_test.astype(\"float32\") / 255\n",
        "# Make sure images have shape (28, 28, 1)\n",
        "x_train = np.expand_dims(x_train, -1)\n",
        "x_test = np.expand_dims(x_test, -1)\n",
        "print(\"x_train shape:\", x_train.shape)\n",
        "print(x_train.shape[0], \"train samples\")\n",
        "print(x_test.shape[0], \"test samples\")\n",
        "\n",
        "\n",
        "# convert class vectors to binary class matrices\n",
        "y_train = keras.utils.to_categorical(y_train, num_classes)\n",
        "y_test = keras.utils.to_categorical(y_test, num_classes)\n",
        "\n",
        "model = keras.Sequential(\n",
        "    [\n",
        "        keras.Input(shape=input_shape),\n",
        "        layers.Conv2D(32, kernel_size=(3, 3), activation=\"relu\"),\n",
        "        layers.MaxPooling2D(pool_size=(2, 2)),\n",
        "        layers.Conv2D(64, kernel_size=(3, 3), activation=\"relu\"),\n",
        "        layers.MaxPooling2D(pool_size=(2, 2)),\n",
        "        layers.Flatten(),\n",
        "        layers.Dropout(0.5),\n",
        "        layers.Dense(num_classes, activation=\"softmax\"),\n",
        "    ]\n",
        ")\n",
        "\n",
        "model.summary()\n",
        "\n",
        "batch_size = 128\n",
        "epochs = 15\n",
        "\n",
        "model.compile(loss=\"categorical_crossentropy\", optimizer=\"adam\", metrics=[\"accuracy\"])\n",
        "\n",
        "model.fit(x_train, y_train, batch_size=batch_size, epochs=epochs, validation_split=0.1)\n",
        "\n",
        "score = model.evaluate(x_test, y_test, verbose=0)\n",
        "print(\"Test loss:\", score[0])\n",
        "print(\"Test accuracy:\", score[1])"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "rR_86jxNYV86",
        "outputId": "d63f84f9-e0f7-481a-9e76-bc86eb6312f3"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Downloading data from https://storage.googleapis.com/tensorflow/tf-keras-datasets/mnist.npz\n",
            "11493376/11490434 [==============================] - 0s 0us/step\n",
            "11501568/11490434 [==============================] - 0s 0us/step\n",
            "x_train shape: (60000, 28, 28, 1)\n",
            "60000 train samples\n",
            "10000 test samples\n",
            "Model: \"sequential\"\n",
            "_________________________________________________________________\n",
            " Layer (type)                Output Shape              Param #   \n",
            "=================================================================\n",
            " conv2d (Conv2D)             (None, 26, 26, 32)        320       \n",
            "                                                                 \n",
            " max_pooling2d (MaxPooling2D  (None, 13, 13, 32)       0         \n",
            " )                                                               \n",
            "                                                                 \n",
            " conv2d_1 (Conv2D)           (None, 11, 11, 64)        18496     \n",
            "                                                                 \n",
            " max_pooling2d_1 (MaxPooling  (None, 5, 5, 64)         0         \n",
            " 2D)                                                             \n",
            "                                                                 \n",
            " flatten (Flatten)           (None, 1600)              0         \n",
            "                                                                 \n",
            " dropout (Dropout)           (None, 1600)              0         \n",
            "                                                                 \n",
            " dense (Dense)               (None, 10)                16010     \n",
            "                                                                 \n",
            "=================================================================\n",
            "Total params: 34,826\n",
            "Trainable params: 34,826\n",
            "Non-trainable params: 0\n",
            "_________________________________________________________________\n",
            "Epoch 1/15\n",
            "422/422 [==============================] - 9s 12ms/step - loss: 0.3588 - accuracy: 0.8897 - val_loss: 0.0795 - val_accuracy: 0.9788\n",
            "Epoch 2/15\n",
            "422/422 [==============================] - 4s 10ms/step - loss: 0.1099 - accuracy: 0.9657 - val_loss: 0.0566 - val_accuracy: 0.9860\n",
            "Epoch 3/15\n",
            "422/422 [==============================] - 3s 8ms/step - loss: 0.0841 - accuracy: 0.9746 - val_loss: 0.0465 - val_accuracy: 0.9885\n",
            "Epoch 4/15\n",
            "422/422 [==============================] - 3s 8ms/step - loss: 0.0697 - accuracy: 0.9786 - val_loss: 0.0420 - val_accuracy: 0.9892\n",
            "Epoch 5/15\n",
            "422/422 [==============================] - 3s 8ms/step - loss: 0.0628 - accuracy: 0.9797 - val_loss: 0.0385 - val_accuracy: 0.9888\n",
            "Epoch 6/15\n",
            "422/422 [==============================] - 3s 7ms/step - loss: 0.0566 - accuracy: 0.9824 - val_loss: 0.0362 - val_accuracy: 0.9908\n",
            "Epoch 7/15\n",
            "422/422 [==============================] - 2s 5ms/step - loss: 0.0509 - accuracy: 0.9844 - val_loss: 0.0342 - val_accuracy: 0.9898\n",
            "Epoch 8/15\n",
            "422/422 [==============================] - 2s 5ms/step - loss: 0.0485 - accuracy: 0.9845 - val_loss: 0.0323 - val_accuracy: 0.9913\n",
            "Epoch 9/15\n",
            "422/422 [==============================] - 2s 5ms/step - loss: 0.0412 - accuracy: 0.9865 - val_loss: 0.0346 - val_accuracy: 0.9897\n",
            "Epoch 10/15\n",
            "422/422 [==============================] - 2s 5ms/step - loss: 0.0431 - accuracy: 0.9856 - val_loss: 0.0316 - val_accuracy: 0.9913\n",
            "Epoch 11/15\n",
            "422/422 [==============================] - 2s 5ms/step - loss: 0.0393 - accuracy: 0.9871 - val_loss: 0.0283 - val_accuracy: 0.9922\n",
            "Epoch 12/15\n",
            "422/422 [==============================] - 2s 5ms/step - loss: 0.0376 - accuracy: 0.9875 - val_loss: 0.0322 - val_accuracy: 0.9910\n",
            "Epoch 13/15\n",
            "422/422 [==============================] - 2s 5ms/step - loss: 0.0352 - accuracy: 0.9886 - val_loss: 0.0302 - val_accuracy: 0.9913\n",
            "Epoch 14/15\n",
            "422/422 [==============================] - 2s 5ms/step - loss: 0.0351 - accuracy: 0.9885 - val_loss: 0.0314 - val_accuracy: 0.9917\n",
            "Epoch 15/15\n",
            "422/422 [==============================] - 2s 5ms/step - loss: 0.0330 - accuracy: 0.9897 - val_loss: 0.0263 - val_accuracy: 0.9927\n",
            "Test loss: 0.025620050728321075\n",
            "Test accuracy: 0.9914000034332275\n"
          ]
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "jMkxxeDjNDsT"
      },
      "source": [
        "## 2. Melanoma diagnosis with MobileNet in PyTorch\n",
        "\n",
        "Now let's look at the following example.\n",
        "It is based on this [code](https://github.com/tomealbuquerque/ordinal-losses) and covers the main topics on a classification task:\n",
        "\n",
        "\n",
        "| Class  | Clinical Meaning |  \n",
        "|---|---| \n",
        "|  0 | Common Nevus  | \n",
        "|  1 | Atypical Nevus | \n",
        "|  2 | Melanoma  |\n",
        "\n",
        "\n",
        "## Target\n",
        "\n",
        "### Common Nevus\n",
        "<div>\n",
        "<img src=\"https://drive.google.com/uc?export=view&id=1URtHY7IhelBAXao4yXWjJQ8HCkZW5lLk\" width=\"300\"/>\n",
        "</div>\n",
        "\n",
        "### Atypical Nevus\n",
        "<div>\n",
        "<img src=\"https://drive.google.com/uc?export=view&id=13a4oUE-gNNq-qPKI_viCFDtzrrnLWVyp\" width=\"300\"/>\n",
        "</div>\n",
        "\n",
        "### Melanoma\n",
        "<div>\n",
        "<img src=\"https://drive.google.com/uc?export=view&id=1y8qBhNDFK5DKlo5xDsO041__5lp7N2YX\" width=\"300\"/>\n",
        "</div>\n",
        "\n",
        "\n"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "### Load Data into Colab"
      ],
      "metadata": {
        "id": "WVQQZX8EWys1"
      }
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "joWqohueNHgz",
        "outputId": "7c285397-4aa9-4261-9c43-c38d839dd4f4"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Looking in indexes: https://pypi.org/simple, https://us-python.pkg.dev/colab-wheels/public/simple/\n",
            "Requirement already satisfied: PyDrive in /usr/local/lib/python3.7/dist-packages (1.3.1)\n",
            "Requirement already satisfied: PyYAML>=3.0 in /usr/local/lib/python3.7/dist-packages (from PyDrive) (6.0)\n",
            "Requirement already satisfied: google-api-python-client>=1.2 in /usr/local/lib/python3.7/dist-packages (from PyDrive) (1.12.11)\n",
            "Requirement already satisfied: oauth2client>=4.0.0 in /usr/local/lib/python3.7/dist-packages (from PyDrive) (4.1.3)\n",
            "Requirement already satisfied: google-auth<3dev,>=1.16.0 in /usr/local/lib/python3.7/dist-packages (from google-api-python-client>=1.2->PyDrive) (1.35.0)\n",
            "Requirement already satisfied: google-api-core<3dev,>=1.21.0 in /usr/local/lib/python3.7/dist-packages (from google-api-python-client>=1.2->PyDrive) (1.31.6)\n",
            "Requirement already satisfied: google-auth-httplib2>=0.0.3 in /usr/local/lib/python3.7/dist-packages (from google-api-python-client>=1.2->PyDrive) (0.0.4)\n",
            "Requirement already satisfied: six<2dev,>=1.13.0 in /usr/local/lib/python3.7/dist-packages (from google-api-python-client>=1.2->PyDrive) (1.15.0)\n",
            "Requirement already satisfied: httplib2<1dev,>=0.15.0 in /usr/local/lib/python3.7/dist-packages (from google-api-python-client>=1.2->PyDrive) (0.17.4)\n",
            "Requirement already satisfied: uritemplate<4dev,>=3.0.0 in /usr/local/lib/python3.7/dist-packages (from google-api-python-client>=1.2->PyDrive) (3.0.1)\n",
            "Requirement already satisfied: pytz in /usr/local/lib/python3.7/dist-packages (from google-api-core<3dev,>=1.21.0->google-api-python-client>=1.2->PyDrive) (2022.1)\n",
            "Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.6.0 in /usr/local/lib/python3.7/dist-packages (from google-api-core<3dev,>=1.21.0->google-api-python-client>=1.2->PyDrive) (1.56.2)\n",
            "Requirement already satisfied: setuptools>=40.3.0 in /usr/local/lib/python3.7/dist-packages (from google-api-core<3dev,>=1.21.0->google-api-python-client>=1.2->PyDrive) (57.4.0)\n",
            "Requirement already satisfied: protobuf<4.0.0dev,>=3.12.0 in /usr/local/lib/python3.7/dist-packages (from google-api-core<3dev,>=1.21.0->google-api-python-client>=1.2->PyDrive) (3.17.3)\n",
            "Requirement already satisfied: packaging>=14.3 in /usr/local/lib/python3.7/dist-packages (from google-api-core<3dev,>=1.21.0->google-api-python-client>=1.2->PyDrive) (21.3)\n",
            "Requirement already satisfied: requests<3.0.0dev,>=2.18.0 in /usr/local/lib/python3.7/dist-packages (from google-api-core<3dev,>=1.21.0->google-api-python-client>=1.2->PyDrive) (2.23.0)\n",
            "Requirement already satisfied: cachetools<5.0,>=2.0.0 in /usr/local/lib/python3.7/dist-packages (from google-auth<3dev,>=1.16.0->google-api-python-client>=1.2->PyDrive) (4.2.4)\n",
            "Requirement already satisfied: rsa<5,>=3.1.4 in /usr/local/lib/python3.7/dist-packages (from google-auth<3dev,>=1.16.0->google-api-python-client>=1.2->PyDrive) (4.8)\n",
            "Requirement already satisfied: pyasn1-modules>=0.2.1 in /usr/local/lib/python3.7/dist-packages (from google-auth<3dev,>=1.16.0->google-api-python-client>=1.2->PyDrive) (0.2.8)\n",
            "Requirement already satisfied: pyasn1>=0.1.7 in /usr/local/lib/python3.7/dist-packages (from oauth2client>=4.0.0->PyDrive) (0.4.8)\n",
            "Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.7/dist-packages (from packaging>=14.3->google-api-core<3dev,>=1.21.0->google-api-python-client>=1.2->PyDrive) (3.0.9)\n",
            "Requirement already satisfied: idna<3,>=2.5 in /usr/local/lib/python3.7/dist-packages (from requests<3.0.0dev,>=2.18.0->google-api-core<3dev,>=1.21.0->google-api-python-client>=1.2->PyDrive) (2.10)\n",
            "Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.7/dist-packages (from requests<3.0.0dev,>=2.18.0->google-api-core<3dev,>=1.21.0->google-api-python-client>=1.2->PyDrive) (2022.6.15)\n",
            "Requirement already satisfied: chardet<4,>=3.0.2 in /usr/local/lib/python3.7/dist-packages (from requests<3.0.0dev,>=2.18.0->google-api-core<3dev,>=1.21.0->google-api-python-client>=1.2->PyDrive) (3.0.4)\n",
            "Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in /usr/local/lib/python3.7/dist-packages (from requests<3.0.0dev,>=2.18.0->google-api-core<3dev,>=1.21.0->google-api-python-client>=1.2->PyDrive) (1.24.3)\n"
          ]
        }
      ],
      "source": [
        "#package to import google drive files to colab\n",
        "!pip install PyDrive"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "FSZxCLLyNTQU",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "987d96d0-b009-42e8-cef3-3fd78bdc384d"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "WARNING:googleapiclient.discovery_cache:file_cache is unavailable when using oauth2client >= 4.0.0 or google-auth\n",
            "Traceback (most recent call last):\n",
            "  File \"/usr/local/lib/python3.7/dist-packages/googleapiclient/discovery_cache/file_cache.py\", line 33, in <module>\n",
            "    from oauth2client.contrib.locked_file import LockedFile\n",
            "ModuleNotFoundError: No module named 'oauth2client.contrib.locked_file'\n",
            "\n",
            "During handling of the above exception, another exception occurred:\n",
            "\n",
            "Traceback (most recent call last):\n",
            "  File \"/usr/local/lib/python3.7/dist-packages/googleapiclient/discovery_cache/file_cache.py\", line 37, in <module>\n",
            "    from oauth2client.locked_file import LockedFile\n",
            "ModuleNotFoundError: No module named 'oauth2client.locked_file'\n",
            "\n",
            "During handling of the above exception, another exception occurred:\n",
            "\n",
            "Traceback (most recent call last):\n",
            "  File \"/usr/local/lib/python3.7/dist-packages/googleapiclient/discovery_cache/__init__.py\", line 44, in autodetect\n",
            "    from . import file_cache\n",
            "  File \"/usr/local/lib/python3.7/dist-packages/googleapiclient/discovery_cache/file_cache.py\", line 41, in <module>\n",
            "    \"file_cache is unavailable when using oauth2client >= 4.0.0 or google-auth\"\n",
            "ImportError: file_cache is unavailable when using oauth2client >= 4.0.0 or google-auth\n"
          ]
        }
      ],
      "source": [
        "from pydrive.auth import GoogleAuth\n",
        "from pydrive.drive import GoogleDrive\n",
        "from google.colab import auth\n",
        "from oauth2client.client import GoogleCredentials\n",
        "import zipfile\n",
        "\n",
        "# 1. Authenticate and create the PyDrive client.\n",
        "auth.authenticate_user()\n",
        "gauth = GoogleAuth()\n",
        "gauth.credentials = GoogleCredentials.get_application_default()\n",
        "drive = GoogleDrive(gauth)\n",
        "\n",
        "#2. Get the file\n",
        "downloaded = drive.CreateFile({'id':\"1Wb3H6ABEyeIlc2r5UPocWkzLnXHvKhmJ\"})   # replace the id with id of file you want to access\n",
        "file_id= \"1Wb3H6ABEyeIlc2r5UPocWkzLnXHvKhmJ\"\n",
        "downloaded.GetContentFile(\"dataset.zip\")\n",
        "with zipfile.ZipFile(\"dataset.zip\", 'r') as zip_ref:\n",
        "    zip_ref.extractall(\".\")\n",
        "\n",
        "#import pdb \n",
        "#pdb.set_trace()\n",
        "#downloaded.GetContentFile('k7.pickle')"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "### Data Loading and Model Optimization"
      ],
      "metadata": {
        "id": "WIVdADlbW6ED"
      }
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "GhkwJV85dRmQ",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 68,
          "referenced_widgets": [
            "c011c90961b843ae9be7981d7e144efa",
            "e4159809957142c7950503bb52768be5",
            "55fa8707c6a7401882d79e1631ba13eb",
            "0694b3ddf60a4d0eb171f9b3bc987461",
            "7e16e882b67748ff82fb0c4a9b953dcb",
            "2bdcb96a676846d3af96e9e4f14918e0",
            "6cf8089692ba472fa52659a38effb711",
            "8c5cbd1e8eea45b48932b33638c473ef",
            "f50f1318e26a458ca203a247649b723c",
            "2cba881c69c44dc98899f636eaa7e611",
            "3ca0d0e1302c47e68a3caf8cb733d0ba"
          ]
        },
        "outputId": "af88a847-4354-4b71-b70b-866f03ad82c2"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "Downloading: \"https://download.pytorch.org/models/mobilenet_v2-b0353104.pth\" to /root/.cache/torch/hub/checkpoints/mobilenet_v2-b0353104.pth\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "  0%|          | 0.00/13.6M [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "c011c90961b843ae9be7981d7e144efa"
            }
          },
          "metadata": {}
        }
      ],
      "source": [
        "#Main pipeline for multiclass classification\n",
        "#import libraries\n",
        "import numpy as np\n",
        "from time import time\n",
        "import torch\n",
        "from torch import nn, optim\n",
        "import torch.nn.functional as F\n",
        "from torch.utils.data import Dataset, DataLoader, Subset\n",
        "from tqdm import tqdm\n",
        "from torchvision import models, transforms\n",
        "import pickle\n",
        "import pandas as pd\n",
        "from sklearn.model_selection import train_test_split\n",
        "from PIL import Image\n",
        "import os \n",
        "\n",
        "\n",
        "\n",
        "device = torch.device('cuda' if torch.cuda.is_available() else 'cpu')\n",
        "\n",
        "#hyperparameters to tune\n",
        "#number of classes \n",
        "K = 3\n",
        "#number of images per mini-batch\n",
        "batchsize=16\n",
        "#epochs to finish the train \n",
        "epochs=15\n",
        "#learning rate\n",
        "lr=1e-4\n",
        "#pre-trained architecture\n",
        "architecture='mobilenet_v2'\n",
        "\n",
        "#Prepare dataset loader\n",
        "class MyDataset(Dataset):\n",
        "    def __init__(self, type, transform, K):\n",
        "        df = pd.read_excel(\"PH2_dataset.xlsx\")\n",
        "        x = df[\"Image Name\"]\n",
        "        y = df[\"Label\"]\n",
        "        self.type = type\n",
        "        if type == \"train\":\n",
        "          self.x, _, self.y, _ = train_test_split(x, y, test_size=0.10, random_state=42)\n",
        "        else:\n",
        "          _, self.x, _, self.y = train_test_split(x, y, test_size=0.10, random_state=42)\n",
        "        self.transform = transform\n",
        "\n",
        "    def __getitem__(self, i):\n",
        "        X = self.transform(np.array(Image.open(os.path.join(\"images\",self.x.iloc[i]) + \".bmp\")))\n",
        "        Y = self.y.iloc[i]\n",
        "        return X, Y\n",
        "\n",
        "    def __len__(self):\n",
        "        return len(self.x)\n",
        "\n",
        "#train transforms\n",
        "train_transforms = transforms.Compose([\n",
        "    transforms.ToPILImage(),\n",
        "    #transforms.RandomAffine(180, (0, 0.1), (0.9, 1.1)),\n",
        "    transforms.RandomHorizontalFlip(),\n",
        "    transforms.RandomVerticalFlip(),\n",
        "    transforms.Resize((112,112)),\n",
        "    transforms.ToTensor(),\n",
        "    transforms.Normalize((0.485, 0.456, 0.406), (0.229, 0.224, 0.225))\n",
        "])\n",
        "\n",
        "#val transforms\n",
        "val_transforms = transforms.Compose([\n",
        "    transforms.ToPILImage(),\n",
        "    transforms.Resize((112,112)),\n",
        "    transforms.ToTensor(), \n",
        "    transforms.Normalize((0.485, 0.456, 0.406), (0.229, 0.224, 0.225))\n",
        "])\n",
        "\n",
        "#dataloaders\n",
        "tr_ds = MyDataset('train', train_transforms, K)\n",
        "tr = DataLoader(tr_ds, batchsize, True)#random selection of images - True\n",
        "ts_ds = MyDataset('test', val_transforms, K)\n",
        "ts = DataLoader(ts_ds, batchsize)\n",
        "\n",
        "#loss\n",
        "ce = nn.CrossEntropyLoss()\n",
        "\n",
        "# Model\n",
        "class Base(nn.Module):\n",
        "    def __init__(self, pretrained_model, n_outputs):\n",
        "        super().__init__()\n",
        "        self.n_outputs = n_outputs\n",
        "        model = getattr(models, pretrained_model)(pretrained=True) #using transfer learning from a pretrained model - True\n",
        "        model = nn.Sequential(*tuple(model.children())[:-1])\n",
        "        last_dimension = torch.flatten(model(torch.randn(1, 3, 112, 112))).shape[0]\n",
        "        model.requires_grad= False\n",
        "        self.model = nn.Sequential(\n",
        "            model,\n",
        "            nn.Flatten(),\n",
        "            nn.Dropout(0.5),\n",
        "            nn.Linear(last_dimension, 64),\n",
        "            nn.Dropout(0.5),\n",
        "            nn.ReLU(),\n",
        "            nn.Linear(64, 16),\n",
        "            nn.ReLU(),\n",
        "            nn.Linear(16, n_outputs)\n",
        "        )\n",
        "\n",
        "    def forward(self, x):\n",
        "        return self.model(x)\n",
        "\n",
        "    def loss(self, Yhat, Y):\n",
        "        return ce(Yhat, Y)\n",
        "\n",
        "    def to_proba(self, Yhat):\n",
        "        return F.softmax(Yhat, 1)\n",
        "\n",
        "    def to_classes(self, Phat):\n",
        "        return Phat.argmax(1)\n",
        "\n",
        "#test cycle\n",
        "def test(val):\n",
        "    model.eval()\n",
        "    val_avg_acc = 0\n",
        "    with torch.no_grad():\n",
        "      for X, Y in tqdm(val):\n",
        "          X = X.to(device)\n",
        "          Y = Y.to(device, torch.int64)\n",
        "          Yhat = model(X)\n",
        "          Khat = model.to_classes(model.to_proba(Yhat))\n",
        "          val_avg_acc += (Y == Khat).float().mean() / len(val)\n",
        "    return val_avg_acc\n",
        "\n",
        "#train cycle\n",
        "def train(tr, val, epochs=epochs, verbose=True):\n",
        "    for epoch in range(epochs):\n",
        "        if verbose:\n",
        "            print(f'* Epoch {epoch+1}/{epochs}')\n",
        "        tic = time()\n",
        "        model.train()\n",
        "        avg_acc = 0\n",
        "        avg_loss = 0\n",
        "        for X, Y in tqdm(tr):\n",
        "            X = X.to(device)\n",
        "            Y = Y.to(device, torch.int64)\n",
        "            opt.zero_grad()\n",
        "            Yhat = model(X)\n",
        "            loss = model.loss(Yhat, Y)\n",
        "            loss.backward()\n",
        "            opt.step()\n",
        "            Khat = model.to_classes(model.to_proba(Yhat))\n",
        "            avg_acc += (Y == Khat).float().mean() / len(tr)\n",
        "            avg_loss += loss / len(tr)\n",
        "        dt = time() - tic\n",
        "        out = ' - %ds - Loss: %f, Acc: %f' % (dt, avg_loss, avg_acc)\n",
        "        if val:\n",
        "            model.eval()\n",
        "            out += ', Test Acc: %f' % test(val)\n",
        "        if verbose:\n",
        "            print(out)\n",
        "        scheduler.step(avg_loss)\n",
        "\n",
        "#get output probabilities from the model\n",
        "def predict_proba(data):\n",
        "    model.eval()\n",
        "    Phat = []\n",
        "    with torch.no_grad():\n",
        "        for X, _ in data:\n",
        "            phat = model.to_classes(model.to_proba(model(X.to(device))))\n",
        "            Phat += list(phat.cpu().numpy())\n",
        "    return Phat\n",
        "\n",
        "#Give to the model the architecture and number of classes (K)\n",
        "model = Base(architecture, K)\n",
        "#put the model on 'GPU' or 'CPU'\n",
        "model = model.to(device)\n",
        "#Define optimizer and scheduler \n",
        "opt = optim.Adam(model.parameters(), lr)\n",
        "scheduler = optim.lr_scheduler.ReduceLROnPlateau(opt, verbose=True)\n"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "o4bjNCpFN-ao",
        "outputId": "907f92c1-fbc2-4d24-93ab-248d63a5de46"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "* Epoch 1/15\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "100%|██████████| 12/12 [00:01<00:00,  6.25it/s]\n",
            "100%|██████████| 2/2 [00:00<00:00, 15.69it/s]\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            " - 1s - Loss: 1.086264, Acc: 0.348958, Test Acc: 0.312500\n",
            "* Epoch 2/15\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "100%|██████████| 12/12 [00:01<00:00,  8.00it/s]\n",
            "100%|██████████| 2/2 [00:00<00:00, 15.81it/s]\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            " - 1s - Loss: 1.003187, Acc: 0.510417, Test Acc: 0.593750\n",
            "* Epoch 3/15\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "100%|██████████| 12/12 [00:01<00:00,  8.06it/s]\n",
            "100%|██████████| 2/2 [00:00<00:00, 17.02it/s]\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            " - 1s - Loss: 0.912222, Acc: 0.531250, Test Acc: 0.687500\n",
            "* Epoch 4/15\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "100%|██████████| 12/12 [00:01<00:00,  8.14it/s]\n",
            "100%|██████████| 2/2 [00:00<00:00, 15.52it/s]\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            " - 1s - Loss: 0.805012, Acc: 0.630208, Test Acc: 0.687500\n",
            "* Epoch 5/15\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "100%|██████████| 12/12 [00:01<00:00,  8.15it/s]\n",
            "100%|██████████| 2/2 [00:00<00:00, 15.67it/s]\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            " - 1s - Loss: 0.667201, Acc: 0.718750, Test Acc: 0.718750\n",
            "* Epoch 6/15\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "100%|██████████| 12/12 [00:01<00:00,  8.13it/s]\n",
            "100%|██████████| 2/2 [00:00<00:00, 15.80it/s]\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            " - 1s - Loss: 0.553081, Acc: 0.770833, Test Acc: 0.718750\n",
            "* Epoch 7/15\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "100%|██████████| 12/12 [00:01<00:00,  8.06it/s]\n",
            "100%|██████████| 2/2 [00:00<00:00, 16.20it/s]\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            " - 1s - Loss: 0.541374, Acc: 0.807292, Test Acc: 0.781250\n",
            "* Epoch 8/15\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "100%|██████████| 12/12 [00:01<00:00,  8.11it/s]\n",
            "100%|██████████| 2/2 [00:00<00:00, 16.65it/s]\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            " - 1s - Loss: 0.431749, Acc: 0.859375, Test Acc: 0.781250\n",
            "* Epoch 9/15\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "100%|██████████| 12/12 [00:01<00:00,  8.04it/s]\n",
            "100%|██████████| 2/2 [00:00<00:00, 16.22it/s]\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            " - 1s - Loss: 0.414562, Acc: 0.885417, Test Acc: 0.781250\n",
            "* Epoch 10/15\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "100%|██████████| 12/12 [00:01<00:00,  8.11it/s]\n",
            "100%|██████████| 2/2 [00:00<00:00, 16.15it/s]\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            " - 1s - Loss: 0.314020, Acc: 0.869792, Test Acc: 0.781250\n",
            "* Epoch 11/15\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "100%|██████████| 12/12 [00:01<00:00,  8.05it/s]\n",
            "100%|██████████| 2/2 [00:00<00:00, 16.84it/s]\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            " - 1s - Loss: 0.316446, Acc: 0.906250, Test Acc: 0.875000\n",
            "* Epoch 12/15\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "100%|██████████| 12/12 [00:01<00:00,  8.12it/s]\n",
            "100%|██████████| 2/2 [00:00<00:00, 16.72it/s]\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            " - 1s - Loss: 0.219488, Acc: 0.963542, Test Acc: 0.843750\n",
            "* Epoch 13/15\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "100%|██████████| 12/12 [00:01<00:00,  7.82it/s]\n",
            "100%|██████████| 2/2 [00:00<00:00, 17.38it/s]\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            " - 1s - Loss: 0.236317, Acc: 0.911458, Test Acc: 0.718750\n",
            "* Epoch 14/15\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "100%|██████████| 12/12 [00:01<00:00,  7.88it/s]\n",
            "100%|██████████| 2/2 [00:00<00:00, 15.51it/s]\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            " - 1s - Loss: 0.116212, Acc: 0.968750, Test Acc: 0.750000\n",
            "* Epoch 15/15\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "100%|██████████| 12/12 [00:01<00:00,  8.19it/s]\n",
            "100%|██████████| 2/2 [00:00<00:00, 14.87it/s]"
          ]
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            " - 1s - Loss: 0.156450, Acc: 0.968750, Test Acc: 0.750000\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "\n"
          ]
        }
      ],
      "source": [
        "#Start the training process\n",
        "train(tr, ts)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "V2ZHcfshNqi9"
      },
      "source": [
        "###Evaluate Model Performance"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 501
        },
        "id": "Cse-6Wu9NXNN",
        "outputId": "65513e87-64c7-4f53-d247-b2828785fb25"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Classification Report:\n",
            "               precision    recall  f1-score   support\n",
            "\n",
            "         0.0       0.70      0.88      0.78         8\n",
            "         1.0       0.60      0.50      0.55         6\n",
            "         2.0       1.00      0.83      0.91         6\n",
            "\n",
            "    accuracy                           0.75        20\n",
            "   macro avg       0.77      0.74      0.74        20\n",
            "weighted avg       0.76      0.75      0.75        20\n",
            "\n",
            "Confusion Matrix:\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "<Figure size 432x288 with 2 Axes>"
            ],
            "image/png": "iVBORw0KGgoAAAANSUhEUgAAAVQAAAD8CAYAAAAoqlyCAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4yLjIsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+WH4yJAAAR+ElEQVR4nO3de5SV1XnH8d9zZgZBRY22c6AyUeMYrGKiwtI03klQRKLipaJprBGd1rW8pXalukzVWBGp0aWt0Wa8NbZelvWytGKxLsXiJUFBKRcx3oIwBGa0RAVvMGee/sERJ8nMe85h9jl7Zs/349pLznkv+/HV9fjsd7/7PebuAgD0XS52AACQChIqAARCQgWAQEioABAICRUAAiGhAkAgJFQA6IGZjTazhd3ah2Z2YeYxPIcKANnMrE7SKkkHuvs7ve1HhQoApX1L0ltZyVSS6qsdxbD9zqUErrLFT1wbO4TkjdpxWOwQBoWh9bK+nqOSnPPpwp/+laSWbl+1untrD7tOlXRvqfNVPaECQH9VTJ49JdDNzGyIpGMlXVLqfCRUAGmx4Hcyj5b0sru3l9qRhAogLbm60Gc8VWUM9yUmpQCkxqz8VvJUto2kCZIeKqdrKlQAaQk45Hf3jyTtVO7+JFQAaSmj8qwWEiqAtISflCobCRVAWqhQASCQ8LP8ZSOhAkgLQ34ACIQhPwAEQoUKAIGQUAEgkDompQAgDO6hAkAgDPkBIBAqVAAIhAoVAAKhQgWAQFh6CgCBMOQHgEAY8gNAIFSoABAICRUAAmFSCgAC4R4qAAQSccgfr2cAqAaz8lvJU9kOZvaAmb1mZsvM7M+y9qdCBZAUCzvkv1HSbHc/ycyGSNo6a2cSKoCkhEqoZra9pEMlnSFJ7r5B0oasYxjyA0iK5az8ZtZiZvO7tZZup9pN0ruS7jSzV8zsNjPbJqtvKtSiPXZp1L/NPHPz59123kn/cMss3XTPM9FiStENMy7Xiy/M1Q5f2lE33/Vg7HCS9fyzczXzmunqKnRpyokna9rZLaUPSkQlFaq7t0pq7WVzvaT9JZ3n7vPM7EZJF0v6+97OR4Va9MY7HfrG1Gv0janX6JunzdTHn27Uo3P+N3ZYyfn20cfqyp/cHDuMpBUKBV09/Urd/C+36eFHZ2n244/prTffjB1WzZhZ2a2ENklt7j6v+PkBbUqwvSKh9uCIA0br123vasXq38YOJTlj9h2r4dttFzuMpC1ZvEhNTbtoVFOTGoYM0cRJx+iZOU/FDqtmQiVUd18jaaWZjS5+9S1Jr2Ydw5C/BycfNVb3z14QOwxgi3S0t2vEyBGbPzfm81q8aFHEiGos7HP950m6uzjD/7ak72ftXDKhmtmeko6TtHPxq1WSHnX3ZX0MtF9qqK/TMYfto8v++dHYoQDYAiEfm3L3hZLGlbt/5pDfzP5O0n3alPNfLDaTdK+ZXZxx3OaZs873lpYbS79w1MF7aeFrK9Wxdl3sUIAt0pjPa83qNZs/d7S3K5/PR4yotnK5XNkttFIV6jRJe7v7xu5fmtn1kpZKuqang7rPnA3b71wPEGfN/PnEcQz3MaDtPWYfrVixXG1tK5VvzGv247M049rrYodVM4Ef7K9IqRTdJelPevh+ZHFbUrYeOkTjD9xTjzy9MHYoyZp5xcW66K//Um0r3tHpJxypJx57OHZIyamvr9cll16mc1rO0vHHTtKRE49Wc/MescOqHaughe7avfcC0swmSrpJ0huSVha//rKkZknnuvvsUh0MtAp1IFr8xLWxQ0jeqB2HxQ5hUBha3/c090dn3Fd2znnvX6cGTauZQ353n21mX5V0gH53Uuoldy+EDAQAQog55C85y+/uXZJ+WYNYAKDPLNePEyoADCT9ukIFgIGEhAoAgZBQASAQEioAhBIvn5JQAaSlGktKy0VCBZAUhvwAEApDfgAIgwoVAAIhoQJAICRUAAiEtfwAEAgVKgAEQkIFgEAi5lMSKoC0UKECQCC5gJNSZrZc0jpJBUmd7p75k9IkVABJqUKBeoS7v1fOjiRUAEkJWaFW3He0ngGgCswqadZiZvO7tZbfO51L+m8zW9DDtj9AhQogKZVMSrl7q6TWjF0OdvdVZtYo6Ukze83d5/a2MxUqgKRUUqGW4u6rin/vkPSwpAOy9iehAkhKLpcru2Uxs23MbPjnf5Z0pKQlWccw5AeQlICz/HlJDxdvIdRLusfdZ2cdQEIFkJRQD/a7+9uSvl7JMSRUAElh6SkABMLSUwAIhAoVAAKJuVKq6gn1x9f/oNpdDHoPLf1N7BCSd/4hu8cOAWViyA8AgTDkB4BAqFABIBAqVAAIJOlJKQCoJYb8ABAICRUAAuEeKgAEQoUKAIFQoQJAIMzyA0AgOYb8ABAGQ34ACIRJKQAIJOItVBIqgLQwKQUAgZhIqAAQBEN+AAgk9KSUmdVJmi9plbtPztqXhAogKVWY5L9A0jJJ25XaMRe8awCIKGdWdivFzEZJOkbSbeX0TYUKICmBZ/lvkPRDScPL6jtkzwAQm1klzVrMbH631vLFeWyypA53X1Bu31SoAJJSyVp+d2+V1NrL5oMkHWtmkyQNlbSdmf27u/9Fr31XEigA9HdWQcvi7pe4+yh331XSVElPZyVTiQoVQGJYyw8AgVTjwX53f0bSM6X2I6ECSApr+QEgEIb8ABAIa/kBIBAqVAAIJGKBSkIFkJY6JqXi69y4QbN+8kN1dW5UV1dBu+1/sPb/TuYzvNgCXOfaeP7ZuZp5zXR1Fbo05cSTNe3sltIHJYIhfz9QV9+gST+YoYahw9RV6NRj1/6tRu09To1f2TN2aEnhOldfoVDQ1dOv1M9uvVP5fF6nnXKSDj9ivHZvbo4dWk3E/NVTlp4WmZkahg6TJHUVOtVVKMS9GZMornP1LVm8SE1Nu2hUU5MahgzRxEnH6Jk5T8UOq2ZCvr6vUlSo3XR1FfTI1Rfow3d/oz89bLIad6Nqqgauc3V1tLdrxMgRmz835vNavGhRxIhqa0BWqGb2/Yxtm1+JNe+x+7a0i5rL5eo05Uc3aeqMu/Te8te1dtXy2CElieuMajKzsltofRny/7i3De7e6u7j3H3cgZOn9qGLOLbaeluNHP01rVpa9msQsQW4ztXRmM9rzeo1mz93tLcrn89HjKi26szKbqFlJlQzW9RLWywpqX9Dn6z7QJ99vF6S1LnhM61a9oq2HzEqclTp4TpX395j9tGKFcvV1rZSGzds0OzHZ+mwI8bHDqtmclZ+C63UPdS8pKMk/fb3vjdJL4QPJ55PPlir//n5dfKuLrm7vjL2EH35awfGDis5XOfqq6+v1yWXXqZzWs5SV1dBx085Uc3Ne8QOq2ZiLj01d+99o9ntku509+d62HaPu59WqoN/nPNW7x0AA8T5h+weO4RBYWh935/5uOg/f1V2zrnuO6ODpt/MCtXdp2VsK5lMAaDWeDkKAAQS87EpEiqApNSz9BQAwqBCBYBAqrGktFwkVABJoUIFgECY5QeAQEK9YNrMhkqaK2krbcqVD7j75VnHkFABJCVghfqZpPHuvt7MGiQ9Z2b/5e6/7O0AEiqApFigF+z6pmWk64sfG4otcxUWL5gGkJSQL0cxszozWyipQ9KT7j4vs+8w/wgA0D9UklC7v7u52H7nx7fcveDu+0oaJekAMxuT1TdDfgBJqeTF0e7eKqm1jP3eN7M5kiZKWtLbflSoAJJSlyu/ZTGzPzazHYp/HiZpgqTXso6hQgWQlIArpUZK+rmZ1WlT8Xm/uz+WdQAJFUBSQj025e6LJO1XyTEkVABJYekpAASSC/Qc6pYgoQJIChUqAARSH/HtKCRUAEmhQgWAQHjBNAAEQoUKAIHEXP5JQgWQFIb8ABAICRUAAol4C5WECiAtTEoBQCCVvA81NBIqgKQwyw8AgSQ9KXX+IbtXu4tBr23tJ7FDSN64K56MHcKgsOSqCX0+B0N+AAiEIT8ABEKFCgCB8BwqAARSR4UKAGHwYD8ABGL8phQAhBGzQo35hAEABJeTld2ymFmTmc0xs1fNbKmZXVCqbypUAEkJWKF2SrrI3V82s+GSFpjZk+7+am8HkFABJCXU0lN3Xy1pdfHP68xsmaSdJfWaUBnyA0hKzspvZtZiZvO7tZaezmlmu0raT9K8rL6pUAEkpZJZfndvldSaeT6zbSU9KOlCd/8wa18SKoCkhJzlN7MGbUqmd7v7Q6X2J6ECSEqo51Bt00sBbpe0zN2vL+cY7qECSEol91BLOEjS9ySNN7OFxTYp6wAqVABJCTjL/5wqfNcKCRVAUnjbFAAEkvRPoABALVGhAkAovL4PAMJgyA8AgTDkB4BQGPIDQBi8sR8AAuE3pQAgEO6hAkAgxiw/AITBkB8AAmHIDwChUKECQBg8NtVPPP/sXM28Zrq6Cl2acuLJmnZ2j7/XhT64YcblevGFudrhSzvq5rsejB1Osp646GB99FmnulwqdLlOuSXzt+WSwj3UfqBQKOjq6VfqZ7feqXw+r9NOOUmHHzFeuzc3xw4tKd8++lhNPmGqrp/+o9ihJO/MOxbo/Y83xg6j5mImVH4CpWjJ4kVqatpFo5qa1DBkiCZOOkbPzHkqdljJGbPvWA3fbrvYYSBhVsFfoVGhFnW0t2vEyBGbPzfm81q8aFHEiIAt55Jaz9hf7tJ/vNSmB+avih1SzfTrIb+Z7SlpZ0nz3H19t+8nuvvsagYHYMuc3vqSOtZ9ph23adCtZ4zVr9/7SAuWvx87rJqI+dhU5pDfzM6X9Iik8yQtMbPjum2+OuO4FjObb2bzb7+1NUykVdaYz2vN6jWbP3e0tyufz0eMCNhyHes+kySt/WijnlrWoX123j5yRDVkFbTASlWoZ0sa6+7rzWxXSQ+Y2a7ufmNWOO7eKqlVkj7tlAeKtar2HrOPVqxYrra2lco35jX78Vmace11scMCKjasIScz08cbChrWkNM3m3fSLXPejh1WzfTnF0znPh/mu/tyMztcm5LqLopbWQdXX1+vSy69TOe0nKWuroKOn3Kimpv3iB1WcmZecbEWvzJfH37wvk4/4Uh998xzdNTkKbHDSspO226lG0/7uiSpLmd6fNEaPf/G/0WOqnZCJiYzu0PSZEkd7j6m5P7uvReQZva0pL9x94XdvquXdIek77p7XakOBkqFOpC1rf0kdgjJO/6fnosdwqCw5KoJfc6Hr7d/XHbO+Wp+68z+zOxQSesl3VVOQi312NTpktZ0/8LdO939dEmHljo5ANRayMem3H2upLXl9p055Hf3toxtz5fbCQDUSiW3UM2sRVL3JZGtxTmgLcJzqACSUsk9g+4T6CGQUAEkhRdMA0AgrOUHgEBCPtdvZvdK+oWk0WbWZmbTsvanQgWQloAVqrufWsn+JFQASeEF0wAQSL9+2xQADCQ5EioAhMKQHwCCYMgPAIHEfA0eCRVAUqhQASAQlp4CQCAM+QEgEIb8ABAIK6UAIBQqVAAIg3uoABBIf/4ZaQAYUHjBNAAkgAoVQFJ4bAoAAuGxKQAIhAoVAAIhoQJAIAz5ASAQHpsCgECsglbyXGYTzexXZvammV1can8SKoC0BMqoZlYn6aeSjpa0l6RTzWyvrGMY8gNISsClpwdIetPd35YkM7tP0nGSXu3tgKon1KH1Ud9VsEXMrMXdW2PHUa7mxmGxQ6jYQLvGS66aEDuEig20axxKJTnHzFoktXT7qrXbNdtZ0spu29okHZh1Pob8PWspvQv6iGtcfVzjEty91d3HdWt9+h8QCRUAerZKUlO3z6OK3/WKhAoAPXtJ0h5mtpuZDZE0VdKjWQcwKdWzQXffKQKucfVxjfvA3TvN7FxJT0iqk3SHuy/NOsbcvSbBAUDqGPIDQCAkVAAIhITaTaXLzFA5M7vDzDrMbEnsWFJlZk1mNsfMXjWzpWZ2QeyYBgvuoRYVl5m9LmmCNj3A+5KkU92911URqJyZHSppvaS73H1M7HhSZGYjJY1095fNbLikBZKO57/l6qNC/cLmZWbuvkHS58vMEJC7z5W0NnYcKXP31e7+cvHP6yQt06ZVP6gyEuoXelpmxn+EGNDMbFdJ+0maFzeSwYGECiTKzLaV9KCkC939w9jxDAYk1C9UvMwM6K/MrEGbkund7v5Q7HgGCxLqFypeZgb0R2Zmkm6XtMzdr48dz2BCQi1y905Jny8zWybp/lLLzFA5M7tX0i8kjTazNjObFjumBB0k6XuSxpvZwmKbFDuowYDHpgAgECpUAAiEhAoAgZBQASAQEioABEJCBYBASKgAEAgJFQAC+X9hi4GQiA0ShAAAAABJRU5ErkJggg==\n"
          },
          "metadata": {
            "needs_background": "light"
          }
        }
      ],
      "source": [
        "#evaluate model performance\n",
        "from sklearn.metrics import classification_report, confusion_matrix\n",
        "import matplotlib.pyplot as plt\n",
        "import seaborn as sns\n",
        "df = pd.read_excel(\"PH2_dataset.xlsx\")\n",
        "x = df[\"Image Name\"]\n",
        "y = df[\"Label\"]\n",
        "y_pred=predict_proba(ts)\n",
        "_,_,_,y_true =  train_test_split(x, y, test_size=0.10, random_state=42)\n",
        "print('Classification Report:\\n', classification_report(y_true, y_pred))\n",
        "\n",
        "print('Confusion Matrix:')\n",
        "cm = sns.heatmap(confusion_matrix(y_true, y_pred), annot=True, cmap='Blues')\n",
        "plt.show()"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "## Topics not covered - PyTorch"
      ],
      "metadata": {
        "id": "UYdQniLaLWZ5"
      }
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "2i-CCDP9zGQm"
      },
      "source": [
        "### Data Augmentation - Albumentations\n",
        "\n",
        "```\n",
        "#or using Albumentations\n",
        "import albumentations as A\n",
        "from albumentations.pytorch import ToTensorV2\n",
        "\n",
        "train_transforms = A.Compose([\n",
        "    A.Resize(224, 224), \n",
        "    A.RandomCrop(128, 128),\n",
        "    A.HorizontalFlip(),\n",
        "    A.Normalize(mean=[0.485, 0.456, 0.406], std=[0.229, 0.224, 0.225]),\n",
        "    ToTensorV2()\n",
        "])\n",
        "\n",
        "```"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "V7dzHylvykpg"
      },
      "source": [
        "### Custom Layers/Models;\n",
        "\n",
        "\n",
        "Writing custom models is easy in PyTorch.\n",
        "You need to:\n",
        "\n",
        "\n",
        "1.   Extend the nn.Module class\n",
        "2.   Implement the \\_\\_init__ method\n",
        "3.   Implement the forward method\n",
        "\n",
        "You can also use nn.Module's inside your nn.Module. This is how available architectures are implemented in PyTorch.\n",
        "\n",
        "Let's look at the following example:\n",
        "\n",
        "```\n",
        "from torch import nn\n",
        "\n",
        "class Model_example(nn.Module):\n",
        "    def __init__(self, pretrained_model, n_outputs):\n",
        "        super().__init__()\n",
        "        self.n_outputs = n_outputs\n",
        "        model = getattr(models, pretrained_model)(pretrained=True)\n",
        "        #remove last layer from pre-trained model \n",
        "        model = nn.Sequential(*tuple(model.children())[:-1])\n",
        "        #get last dimension of the model\n",
        "        last_dimension = torch.flatten(model(torch.randn(1, 3, 224, 224))).shape[0]\n",
        "        self.model = nn.Sequential(\n",
        "            model,\n",
        "            nn.Flatten(),\n",
        "            nn.Dropout(0.2),\n",
        "            nn.Linear(last_dimension, 512),\n",
        "            nn.Dropout(0.2),\n",
        "            nn.ReLU(),\n",
        "            nn.Linear(512, 256),\n",
        "            nn.ReLU(),\n",
        "            nn.Linear(256, n_outputs)\n",
        "        )\n",
        "\n",
        "    def forward(self, x):\n",
        "        return self.model(x)\n",
        "```\n",
        "\n",
        "By doing this you can use functions like:\n",
        "* model(x)  # forward\n",
        "* torch.save(model.state_dict(), path)  # save model\n",
        "* model.load_state_dict(torch.load(path))  # load model\n",
        "* model.parameters()  # for the optimizer for example\n",
        "* model.train()\n",
        "* model.eval()\n"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "YXP2KaVXzye6"
      },
      "source": [
        "# Closing remarks\n"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "Q_NPXLvJeSq8"
      },
      "source": [
        "## Some tips!\n",
        "\n",
        "* save your experiments - training takes time, and sometimes you want to check something later or reuse your model. As such, you should save your model, hyperparameters, data, training curves, etc., and keep it.\n",
        "\n",
        "**Example:** you trained a few models, evaluated their accuracy, and you got rid of them. Later, you were asked to assess the rocAUC too. If you discarded your model, you would have to retrain, which can take a few days.\n",
        "\n",
        "* the devil is in the details - many things in deep learning depend on little details. Errors are often silent. Due to this, you should adopt a defensive posture and evaluate and debug intermediate results as much as possible. In the end, you will save time.\n",
        "\n",
        "* do not reinvent the wheel unless you are having fun - many of the things you need are either implemented on PyTorch or other repositories. If you are implementing something by yourself, make sure you are wasting time because you want to."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "r2OEodiMz5De"
      },
      "source": [
        "## What can I use besides Pytorch? \n",
        "\n",
        "### Fast.AI\n",
        "\n",
        "https://www.fast.ai/\n",
        "\n",
        "### Pytorch Lightning \n",
        "\n",
        "https://www.pytorchlightning.ai/\n",
        "\n",
        "### Jax \n",
        "\n",
        "https://github.com/google/jax\n",
        "\n",
        "## See you in VISUM 2022\n",
        "\n",
        "Pedro Neto\n",
        "\n",
        "Eduardo Castro\n",
        "\n",
        "<center><h1>Thank you!!</h1></center>\n"
      ]
    }
  ],
  "metadata": {
    "accelerator": "GPU",
    "colab": {
      "collapsed_sections": [],
      "name": "VISUM 2022 - Basics 5 - pytorch and tensorflow - by Pedro Neto and Eduardo Castro.ipynb",
      "provenance": []
    },
    "gpuClass": "standard",
    "kernelspec": {
      "display_name": "Python 3",
      "name": "python3"
    },
    "widgets": {
      "application/vnd.jupyter.widget-state+json": {
        "cf37c5f805404514952c303b4d40cd37": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_9e8dc63d07444e61abd6d1b08183f358",
              "IPY_MODEL_8a3307861bb44136b2fb7ed6bbe7bd21",
              "IPY_MODEL_fd3de0b826da481b88a77a858cab499a"
            ],
            "layout": "IPY_MODEL_9db9728e4bee4f34af37e2f73f7e76f2"
          }
        },
        "9e8dc63d07444e61abd6d1b08183f358": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_557f7fe8a0c84988aae627295ab13cff",
            "placeholder": "​",
            "style": "IPY_MODEL_c2b204f20d404cb4936569fec68caf0a",
            "value": ""
          }
        },
        "8a3307861bb44136b2fb7ed6bbe7bd21": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_dd7f10ec88e04214b03db21504102b77",
            "max": 9912422,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_0b3886f17eee46b59379a84c01797039",
            "value": 9912422
          }
        },
        "fd3de0b826da481b88a77a858cab499a": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_8f615d79f33f41e2b6976c3337cbacca",
            "placeholder": "​",
            "style": "IPY_MODEL_fdef0e5867a74cef83997c2046952844",
            "value": " 9913344/? [00:00&lt;00:00, 57935627.05it/s]"
          }
        },
        "9db9728e4bee4f34af37e2f73f7e76f2": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "557f7fe8a0c84988aae627295ab13cff": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "c2b204f20d404cb4936569fec68caf0a": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "dd7f10ec88e04214b03db21504102b77": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "0b3886f17eee46b59379a84c01797039": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "8f615d79f33f41e2b6976c3337cbacca": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "fdef0e5867a74cef83997c2046952844": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "0c52caf16d494d459dbf57d70b90e5ea": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_0ab1353ad7d34026890fc640db16c537",
              "IPY_MODEL_e86400a71e2548218cdf0a289667fd7e",
              "IPY_MODEL_082db835aa2d4cc9a5ed790854189de2"
            ],
            "layout": "IPY_MODEL_5c65791b8b30459881f279013e21f388"
          }
        },
        "0ab1353ad7d34026890fc640db16c537": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_40bc49ebe8684d468b65e5918f767bc7",
            "placeholder": "​",
            "style": "IPY_MODEL_6a1bba7da28f436086d421f0d64ba6bb",
            "value": ""
          }
        },
        "e86400a71e2548218cdf0a289667fd7e": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_45e346e3ca0e4cfb8cd7b9cbed5d539a",
            "max": 28881,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_89bd1e3dc61b46b1b440e5e9d112a22f",
            "value": 28881
          }
        },
        "082db835aa2d4cc9a5ed790854189de2": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_f0e1e7022aa04216b3e9aea432a85059",
            "placeholder": "​",
            "style": "IPY_MODEL_dca30ed2910847e9bb82bf6690da20a0",
            "value": " 29696/? [00:00&lt;00:00, 336933.08it/s]"
          }
        },
        "5c65791b8b30459881f279013e21f388": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "40bc49ebe8684d468b65e5918f767bc7": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "6a1bba7da28f436086d421f0d64ba6bb": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "45e346e3ca0e4cfb8cd7b9cbed5d539a": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "89bd1e3dc61b46b1b440e5e9d112a22f": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "f0e1e7022aa04216b3e9aea432a85059": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "dca30ed2910847e9bb82bf6690da20a0": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "cdfcdb3742fa4dc7af7f58429a7225d9": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_e1ce6cb052d04af78413a187dc25688b",
              "IPY_MODEL_306e9a7b30634d64a4e06b20c336cb63",
              "IPY_MODEL_83f5bf81a32d4d609b75cbf1206fe377"
            ],
            "layout": "IPY_MODEL_71af350cd6774dae9e9df5642014fe14"
          }
        },
        "e1ce6cb052d04af78413a187dc25688b": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_dba4e9a223064c7ea91cf3295a95c9e4",
            "placeholder": "​",
            "style": "IPY_MODEL_77ad3b4cc7444a51b4574b3fad576374",
            "value": ""
          }
        },
        "306e9a7b30634d64a4e06b20c336cb63": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_9ea26fa9145041f4a26671e22756d6a5",
            "max": 1648877,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_e4db0c7cdeeb4e7891867cfbb62d7cf6",
            "value": 1648877
          }
        },
        "83f5bf81a32d4d609b75cbf1206fe377": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_294fad46371541a2b7cad27c099c4983",
            "placeholder": "​",
            "style": "IPY_MODEL_8f51b8e9277a4abd97fb6a58819055e3",
            "value": " 1649664/? [00:01&lt;00:00, 1443893.83it/s]"
          }
        },
        "71af350cd6774dae9e9df5642014fe14": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "dba4e9a223064c7ea91cf3295a95c9e4": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "77ad3b4cc7444a51b4574b3fad576374": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "9ea26fa9145041f4a26671e22756d6a5": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "e4db0c7cdeeb4e7891867cfbb62d7cf6": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "294fad46371541a2b7cad27c099c4983": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "8f51b8e9277a4abd97fb6a58819055e3": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "c7c13c6087f84343ba87bfe722c271d1": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_729244d8bc304209bc587f1ce7632ae6",
              "IPY_MODEL_64437bec6ccc420383da3cb256ca19fb",
              "IPY_MODEL_c4cbeab2e1644734abab55f88b8ce152"
            ],
            "layout": "IPY_MODEL_292c74494dc34ad8afc91304a9ece1c8"
          }
        },
        "729244d8bc304209bc587f1ce7632ae6": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_49968bac05aa48c1bec903f8790092bc",
            "placeholder": "​",
            "style": "IPY_MODEL_48bd96ed58a54bdaa6a7f05c48bd3aeb",
            "value": ""
          }
        },
        "64437bec6ccc420383da3cb256ca19fb": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_f2510536d92e406fbb8617df45ab7e1f",
            "max": 4542,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_4516c650a4d34c3c9fa98a05ea082664",
            "value": 4542
          }
        },
        "c4cbeab2e1644734abab55f88b8ce152": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_dbbc5c9156474c1b81aa7638bed07b53",
            "placeholder": "​",
            "style": "IPY_MODEL_f6f11cd407c54b34a2a036ce49dc8632",
            "value": " 5120/? [00:00&lt;00:00, 169213.12it/s]"
          }
        },
        "292c74494dc34ad8afc91304a9ece1c8": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "49968bac05aa48c1bec903f8790092bc": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "48bd96ed58a54bdaa6a7f05c48bd3aeb": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "f2510536d92e406fbb8617df45ab7e1f": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "4516c650a4d34c3c9fa98a05ea082664": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "dbbc5c9156474c1b81aa7638bed07b53": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "f6f11cd407c54b34a2a036ce49dc8632": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "78ced02266674b19806de4d4330d2507": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_77042b094ac14413b69d3e74928b7d39",
              "IPY_MODEL_5916e99c1af747728a1ae9f9831313e1",
              "IPY_MODEL_72b16ac528004c56a774a806b03aa8bb"
            ],
            "layout": "IPY_MODEL_56a86df8bf2f4543948e19cd526034e4"
          }
        },
        "77042b094ac14413b69d3e74928b7d39": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_e69318745c4645bbb259ab3426968ef3",
            "placeholder": "​",
            "style": "IPY_MODEL_78a935005afa40328286fc7ba3e63cb9",
            "value": "Sanity Checking DataLoader 0: 100%"
          }
        },
        "5916e99c1af747728a1ae9f9831313e1": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_357a783d39f74b6887fa04067c3ef492",
            "max": 2,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_80a510a0b39447a48174cbe4222dff62",
            "value": 2
          }
        },
        "72b16ac528004c56a774a806b03aa8bb": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_3865e4c35e1e4b56b2d6d87dd86dde93",
            "placeholder": "​",
            "style": "IPY_MODEL_c7d8c3fee960458e92a1e510a5366dd4",
            "value": " 2/2 [00:00&lt;00:00, 21.41it/s]"
          }
        },
        "56a86df8bf2f4543948e19cd526034e4": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "e69318745c4645bbb259ab3426968ef3": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "78a935005afa40328286fc7ba3e63cb9": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "357a783d39f74b6887fa04067c3ef492": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "80a510a0b39447a48174cbe4222dff62": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "3865e4c35e1e4b56b2d6d87dd86dde93": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "c7d8c3fee960458e92a1e510a5366dd4": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "91df830d1d8e419aac3a5ecdea81984d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_6c5994e11459475d9d50d3ad2cfa1b8d",
              "IPY_MODEL_346682a13c004c6784173b2034ed2ce1",
              "IPY_MODEL_2f48e527702d4d218cbdffa1f4aeee5c"
            ],
            "layout": "IPY_MODEL_7c1421aa3e984d6a9b4cd6b56232ae74"
          }
        },
        "6c5994e11459475d9d50d3ad2cfa1b8d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_3bf9edcf699940638530da3a90f75662",
            "placeholder": "​",
            "style": "IPY_MODEL_f9c12e7dacc843ec8d5965285c5b56ee",
            "value": "Epoch 19: 100%"
          }
        },
        "346682a13c004c6784173b2034ed2ce1": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_120a42f704c5474a9d731ed53a05c89f",
            "max": 235,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_730b4311faf24bc989f470e96de83f9d",
            "value": 235
          }
        },
        "2f48e527702d4d218cbdffa1f4aeee5c": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_b6b2f425659e4414bf64e5d55107b0e1",
            "placeholder": "​",
            "style": "IPY_MODEL_f40294149934428f9ae0b16d99eb6939",
            "value": " 235/235 [00:09&lt;00:00, 24.14it/s, loss=0.106, v_num=0, val_loss=0.114, val_acc=0.966]"
          }
        },
        "7c1421aa3e984d6a9b4cd6b56232ae74": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "3bf9edcf699940638530da3a90f75662": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "f9c12e7dacc843ec8d5965285c5b56ee": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "120a42f704c5474a9d731ed53a05c89f": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "730b4311faf24bc989f470e96de83f9d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "b6b2f425659e4414bf64e5d55107b0e1": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "f40294149934428f9ae0b16d99eb6939": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "d63f2ed3881b47e6befc526261e7ebaa": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_17bfc631ae714e64b5eca6809d280adc",
              "IPY_MODEL_595ad7b1e7534ef38597ea2af72294ed",
              "IPY_MODEL_ad7572bf7ad5427988d2fdc65b87cf03"
            ],
            "layout": "IPY_MODEL_62cae968a1ae4d14b90506080f8ffcca"
          }
        },
        "17bfc631ae714e64b5eca6809d280adc": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_f8ee4b451f154d57a344e0a6ffa0a348",
            "placeholder": "​",
            "style": "IPY_MODEL_46f403ffddd6499682b141ebe97e0e8c",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "595ad7b1e7534ef38597ea2af72294ed": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_5f5290f52e604a2cb00ffa5a9c9c9c62",
            "max": 20,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_645eb426e46946879700b6192deba98f",
            "value": 20
          }
        },
        "ad7572bf7ad5427988d2fdc65b87cf03": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_2ab2979d49cc4f6cb35eede0e847cffd",
            "placeholder": "​",
            "style": "IPY_MODEL_dfa9c9ace36f4d5f877b874dd0775436",
            "value": " 20/20 [00:00&lt;00:00, 26.23it/s]"
          }
        },
        "62cae968a1ae4d14b90506080f8ffcca": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "f8ee4b451f154d57a344e0a6ffa0a348": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "46f403ffddd6499682b141ebe97e0e8c": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "5f5290f52e604a2cb00ffa5a9c9c9c62": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "645eb426e46946879700b6192deba98f": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "2ab2979d49cc4f6cb35eede0e847cffd": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "dfa9c9ace36f4d5f877b874dd0775436": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "0f60330dd0f54ce2bb7471b76a8b420d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_14ea327c2a79465c8448a10b755b0edf",
              "IPY_MODEL_1eaf5b9d76bd47c0b12d411cb31dd987",
              "IPY_MODEL_2a4e3f38408349b9b793fb67fedd4da1"
            ],
            "layout": "IPY_MODEL_dbf0c3bd5be44d0f838c1c9725f563b5"
          }
        },
        "14ea327c2a79465c8448a10b755b0edf": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_6c4f54a975f04070840c1fd00f39c4e3",
            "placeholder": "​",
            "style": "IPY_MODEL_4c7b22ed0e7643a8a04c09d394068b75",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "1eaf5b9d76bd47c0b12d411cb31dd987": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_fe9a5a1fd38e459b80886897c07ee2f8",
            "max": 20,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_122705b02bcd4ba599b043426d6f535f",
            "value": 20
          }
        },
        "2a4e3f38408349b9b793fb67fedd4da1": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_bbdf0faaf24847949a9de1480910c45e",
            "placeholder": "​",
            "style": "IPY_MODEL_f4d127b9820f419d86e93f64af73c445",
            "value": " 20/20 [00:00&lt;00:00, 26.66it/s]"
          }
        },
        "dbf0c3bd5be44d0f838c1c9725f563b5": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "6c4f54a975f04070840c1fd00f39c4e3": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "4c7b22ed0e7643a8a04c09d394068b75": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "fe9a5a1fd38e459b80886897c07ee2f8": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "122705b02bcd4ba599b043426d6f535f": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "bbdf0faaf24847949a9de1480910c45e": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "f4d127b9820f419d86e93f64af73c445": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "b6b322a14b3c47229710710127ab0690": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_35a2cb64b8f345399cd4ba366da94df7",
              "IPY_MODEL_d88822e965444eeca0634fc00923a113",
              "IPY_MODEL_0bf4f90afcf34941971d8aab457c0640"
            ],
            "layout": "IPY_MODEL_e5969ed807e94bfa8c4858d8e2ff9929"
          }
        },
        "35a2cb64b8f345399cd4ba366da94df7": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_28f0f1746a33436dabff5c0d6e73575e",
            "placeholder": "​",
            "style": "IPY_MODEL_d28d942ca7434333b343a124daa92967",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "d88822e965444eeca0634fc00923a113": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_604223bcb2194cac9b00bc28f6fe5e02",
            "max": 20,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_098fe9c7fd5a4d35a83c780b4c5a4d23",
            "value": 20
          }
        },
        "0bf4f90afcf34941971d8aab457c0640": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_61e009396e76472cb64e2c53d4e31ae8",
            "placeholder": "​",
            "style": "IPY_MODEL_56123558f5914de591da957ad23541f5",
            "value": " 20/20 [00:00&lt;00:00, 27.90it/s]"
          }
        },
        "e5969ed807e94bfa8c4858d8e2ff9929": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "28f0f1746a33436dabff5c0d6e73575e": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "d28d942ca7434333b343a124daa92967": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "604223bcb2194cac9b00bc28f6fe5e02": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "098fe9c7fd5a4d35a83c780b4c5a4d23": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "61e009396e76472cb64e2c53d4e31ae8": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "56123558f5914de591da957ad23541f5": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "0cb55226644747518f661b5b733a2fc5": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_53cdd5aa8bae43059892a6dc66ca7c1d",
              "IPY_MODEL_65e80ae05dd84790844b6bf885556266",
              "IPY_MODEL_5ce4b2d670aa49e79f3540f2f0b717e8"
            ],
            "layout": "IPY_MODEL_06cc712b3696452985dc8c9604a2af16"
          }
        },
        "53cdd5aa8bae43059892a6dc66ca7c1d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_bf04a031ecf34a3e9b280874be622874",
            "placeholder": "​",
            "style": "IPY_MODEL_b1d00a72ffa5455bb71a5bd18b9a1ffc",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "65e80ae05dd84790844b6bf885556266": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_2d6cd2c551d141b39fcfff3d0ba3311a",
            "max": 20,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_8f4dcdaa213941e0b15c46b67fe6fb67",
            "value": 20
          }
        },
        "5ce4b2d670aa49e79f3540f2f0b717e8": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_ae459f3c849e40b3ba52a2159723908a",
            "placeholder": "​",
            "style": "IPY_MODEL_ef80cee01e524241a0546fc53924fed4",
            "value": " 20/20 [00:00&lt;00:00, 27.02it/s]"
          }
        },
        "06cc712b3696452985dc8c9604a2af16": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "bf04a031ecf34a3e9b280874be622874": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "b1d00a72ffa5455bb71a5bd18b9a1ffc": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "2d6cd2c551d141b39fcfff3d0ba3311a": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "8f4dcdaa213941e0b15c46b67fe6fb67": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "ae459f3c849e40b3ba52a2159723908a": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "ef80cee01e524241a0546fc53924fed4": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "b4ea0b1cfb70479fbb9dc5ee1bbb8aa1": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_20e5c6431b2442638fadf21fd9a96252",
              "IPY_MODEL_6be82eb294844d60a8c5850322321116",
              "IPY_MODEL_4b08b84119004714a26305cef95a7f3c"
            ],
            "layout": "IPY_MODEL_431ff2bfdaba4194b7f325975de8e65c"
          }
        },
        "20e5c6431b2442638fadf21fd9a96252": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_6a22fb5e23f6435bacf0f6bbc795f381",
            "placeholder": "​",
            "style": "IPY_MODEL_cc3e3a3c894d43bea66462f55cbf69a5",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "6be82eb294844d60a8c5850322321116": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_ef382106ce254deb923da70ecd43426d",
            "max": 20,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_ec88dc8a28cb4f31bbea3f9c62cd8907",
            "value": 20
          }
        },
        "4b08b84119004714a26305cef95a7f3c": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_a9b4cbf3eb3341d4a3a100a8d74efafc",
            "placeholder": "​",
            "style": "IPY_MODEL_78507c291f22441296426fc24923c473",
            "value": " 20/20 [00:00&lt;00:00, 26.35it/s]"
          }
        },
        "431ff2bfdaba4194b7f325975de8e65c": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "6a22fb5e23f6435bacf0f6bbc795f381": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "cc3e3a3c894d43bea66462f55cbf69a5": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "ef382106ce254deb923da70ecd43426d": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "ec88dc8a28cb4f31bbea3f9c62cd8907": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "a9b4cbf3eb3341d4a3a100a8d74efafc": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "78507c291f22441296426fc24923c473": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "40092e852a064af58f04e9ad1364ae40": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_6eac7b99f23e4d93961df5592836935d",
              "IPY_MODEL_cb80518256a044c59a284fc94a00580d",
              "IPY_MODEL_5ad65590bcdf40c3bec676b856647f80"
            ],
            "layout": "IPY_MODEL_2258ddc4ca494ee1801dd0d12c6d8baa"
          }
        },
        "6eac7b99f23e4d93961df5592836935d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_843c6f63746247d7979975550757412c",
            "placeholder": "​",
            "style": "IPY_MODEL_b509a932de1d40beba492d1cc0097a94",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "cb80518256a044c59a284fc94a00580d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_7de4cfda7df0490b91ffc63bb490c592",
            "max": 20,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_5674dd34b1904c9196d5985b9b1f29fe",
            "value": 20
          }
        },
        "5ad65590bcdf40c3bec676b856647f80": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_6f483551399444d2b88ec091f413ce84",
            "placeholder": "​",
            "style": "IPY_MODEL_28c46049c4004791aed166ea7e557e17",
            "value": " 20/20 [00:00&lt;00:00, 27.17it/s]"
          }
        },
        "2258ddc4ca494ee1801dd0d12c6d8baa": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "843c6f63746247d7979975550757412c": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "b509a932de1d40beba492d1cc0097a94": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "7de4cfda7df0490b91ffc63bb490c592": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "5674dd34b1904c9196d5985b9b1f29fe": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "6f483551399444d2b88ec091f413ce84": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "28c46049c4004791aed166ea7e557e17": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "87e813c6e26f414b84e0ef554ba803c4": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_0f45cd1d306b495f95e407899640e85e",
              "IPY_MODEL_e60571fe22a3473aaf9c045ac87c5e64",
              "IPY_MODEL_e4b8bb3b58974aeb84e768efc6e6f6eb"
            ],
            "layout": "IPY_MODEL_efc0f7e2c10b41af81bb22d300b6f27f"
          }
        },
        "0f45cd1d306b495f95e407899640e85e": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_7df0bc5362654fc0809a3aa07037edf7",
            "placeholder": "​",
            "style": "IPY_MODEL_a72b03c3d58d4df096950b6f601d5f50",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "e60571fe22a3473aaf9c045ac87c5e64": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_f3654298a3354def81ff01ec1279b5ff",
            "max": 20,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_764e33e7d8b74ac2ade75f4282575931",
            "value": 20
          }
        },
        "e4b8bb3b58974aeb84e768efc6e6f6eb": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_622413ed3f894b35ba3f41bf7af973d9",
            "placeholder": "​",
            "style": "IPY_MODEL_e42b8c0c9874425681068c58cc695ee5",
            "value": " 20/20 [00:00&lt;00:00, 26.85it/s]"
          }
        },
        "efc0f7e2c10b41af81bb22d300b6f27f": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "7df0bc5362654fc0809a3aa07037edf7": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "a72b03c3d58d4df096950b6f601d5f50": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "f3654298a3354def81ff01ec1279b5ff": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "764e33e7d8b74ac2ade75f4282575931": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "622413ed3f894b35ba3f41bf7af973d9": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "e42b8c0c9874425681068c58cc695ee5": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "10c567cd699f4ae8ae272cef24368e44": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_5ec3f70250fc4cb58d09419bcaa18d8b",
              "IPY_MODEL_5b81761d8f7c4bc5b52ceb79b9f608ed",
              "IPY_MODEL_24c3a7b7e37f439087740810fb61f0e3"
            ],
            "layout": "IPY_MODEL_ae03f64264e14d909d44aa97262bdf95"
          }
        },
        "5ec3f70250fc4cb58d09419bcaa18d8b": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_b0b44e75fb2b4404a820ff80b5d03971",
            "placeholder": "​",
            "style": "IPY_MODEL_ef7454e8d8c945049488ca223625f5a5",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "5b81761d8f7c4bc5b52ceb79b9f608ed": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_478e356f8dcc40698197d7b476d7c074",
            "max": 20,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_6585263f478545bfa36b6cbfe2952eef",
            "value": 20
          }
        },
        "24c3a7b7e37f439087740810fb61f0e3": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_77da66ccbd0841cd99a4bc1f657f4b4c",
            "placeholder": "​",
            "style": "IPY_MODEL_54819de1935b4d3890c3524415cac3f4",
            "value": " 20/20 [00:00&lt;00:00, 26.93it/s]"
          }
        },
        "ae03f64264e14d909d44aa97262bdf95": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "b0b44e75fb2b4404a820ff80b5d03971": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "ef7454e8d8c945049488ca223625f5a5": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "478e356f8dcc40698197d7b476d7c074": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "6585263f478545bfa36b6cbfe2952eef": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "77da66ccbd0841cd99a4bc1f657f4b4c": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "54819de1935b4d3890c3524415cac3f4": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "53f5b93c62c247adb088388bafb3261a": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_5e43aeae88af4581bfd8ca77caa8815b",
              "IPY_MODEL_4693e6ce4c2c400daede56d6af1730d3",
              "IPY_MODEL_fd33975baac94e8db770d917da989d5b"
            ],
            "layout": "IPY_MODEL_b36220d8f82f44599563c29415984e6e"
          }
        },
        "5e43aeae88af4581bfd8ca77caa8815b": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_411d60cb74cd42a4b4bf312cd75501bf",
            "placeholder": "​",
            "style": "IPY_MODEL_6a0189381c7b4f56a356353a02ddda0c",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "4693e6ce4c2c400daede56d6af1730d3": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_3da56e7a0be24a3491f7264505c726d3",
            "max": 20,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_38b6228468ce44d99e618723ee9a4cb6",
            "value": 20
          }
        },
        "fd33975baac94e8db770d917da989d5b": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_b37c167ea3954763a9f9a98f9f3abb85",
            "placeholder": "​",
            "style": "IPY_MODEL_b079911da1684c14894b063a16a3d9dd",
            "value": " 20/20 [00:00&lt;00:00, 27.26it/s]"
          }
        },
        "b36220d8f82f44599563c29415984e6e": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "411d60cb74cd42a4b4bf312cd75501bf": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "6a0189381c7b4f56a356353a02ddda0c": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "3da56e7a0be24a3491f7264505c726d3": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "38b6228468ce44d99e618723ee9a4cb6": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "b37c167ea3954763a9f9a98f9f3abb85": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "b079911da1684c14894b063a16a3d9dd": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "398895ba51c0405881ef47e47cf72c78": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_e7869707b4af4f15ab6ffc2f64cd5aae",
              "IPY_MODEL_051dfef46e704bcd9bcb5f2cb2537901",
              "IPY_MODEL_6738513d0ac445719474450a45f45122"
            ],
            "layout": "IPY_MODEL_c1c57778f7984dd1953d0a8e3268604c"
          }
        },
        "e7869707b4af4f15ab6ffc2f64cd5aae": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_98e208eef1534d19a89a5a3b407683b8",
            "placeholder": "​",
            "style": "IPY_MODEL_ddc610e1b8b4491dba22fc886d85cbfe",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "051dfef46e704bcd9bcb5f2cb2537901": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_e187c1d7010e410ead93e4159764f172",
            "max": 20,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_015343c49063470f89eddbc9dfd67f3b",
            "value": 20
          }
        },
        "6738513d0ac445719474450a45f45122": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_86bf9f0b4ebe48d59948b28be3fda173",
            "placeholder": "​",
            "style": "IPY_MODEL_44aec7f4acfd4152ae7150d4d57eb5b5",
            "value": " 20/20 [00:00&lt;00:00, 25.75it/s]"
          }
        },
        "c1c57778f7984dd1953d0a8e3268604c": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "98e208eef1534d19a89a5a3b407683b8": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "ddc610e1b8b4491dba22fc886d85cbfe": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "e187c1d7010e410ead93e4159764f172": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "015343c49063470f89eddbc9dfd67f3b": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "86bf9f0b4ebe48d59948b28be3fda173": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "44aec7f4acfd4152ae7150d4d57eb5b5": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "e909a23056fc490cbbf5243b4b54525f": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_76e56eb263f047e8a96021830e1f2ebb",
              "IPY_MODEL_45ada10700cc4a43919ce8cad006f671",
              "IPY_MODEL_3ab11111c8c34990a4feb2558c6e515e"
            ],
            "layout": "IPY_MODEL_2c3a547ce2464527aa6f87ca0728e987"
          }
        },
        "76e56eb263f047e8a96021830e1f2ebb": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_8c340499abb14da2b914900f76b721d0",
            "placeholder": "​",
            "style": "IPY_MODEL_0b45339c497c4650bae76031029f0e98",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "45ada10700cc4a43919ce8cad006f671": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_a17cc832b0a642eeadedbc4a5cab71cc",
            "max": 20,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_7b765aaae9054a87acb7ca70c9bd6cae",
            "value": 20
          }
        },
        "3ab11111c8c34990a4feb2558c6e515e": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_05d6efa91299484aae6041cdd5d696bf",
            "placeholder": "​",
            "style": "IPY_MODEL_7ecbcc19ee43481fbe81ae0c4723cf02",
            "value": " 20/20 [00:00&lt;00:00, 28.09it/s]"
          }
        },
        "2c3a547ce2464527aa6f87ca0728e987": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "8c340499abb14da2b914900f76b721d0": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "0b45339c497c4650bae76031029f0e98": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "a17cc832b0a642eeadedbc4a5cab71cc": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "7b765aaae9054a87acb7ca70c9bd6cae": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "05d6efa91299484aae6041cdd5d696bf": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "7ecbcc19ee43481fbe81ae0c4723cf02": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "916bc3c1fff2403a9ee22c5e0151e61d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_db04027c450c4d7caa40df01e783f0f2",
              "IPY_MODEL_f01957e5e33542b2b81cb0b8d72302dc",
              "IPY_MODEL_9dc0533746af4d75aed15444c151b984"
            ],
            "layout": "IPY_MODEL_0f88a74dcaf748d19e652775cacdaeee"
          }
        },
        "db04027c450c4d7caa40df01e783f0f2": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_fd91ece6b256477bb355608be2742357",
            "placeholder": "​",
            "style": "IPY_MODEL_6bc9088cda254fc9948afa0a6af3e574",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "f01957e5e33542b2b81cb0b8d72302dc": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_088e4f506e154a20afc4799ca084d834",
            "max": 20,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_12c80c499e814112b2cb57da1c9f4b10",
            "value": 20
          }
        },
        "9dc0533746af4d75aed15444c151b984": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_05eaaddc234c4cdcb39a2d5b385c8d1d",
            "placeholder": "​",
            "style": "IPY_MODEL_480be2d70bd045dea3585dbfb71ae612",
            "value": " 20/20 [00:00&lt;00:00, 27.23it/s]"
          }
        },
        "0f88a74dcaf748d19e652775cacdaeee": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "fd91ece6b256477bb355608be2742357": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "6bc9088cda254fc9948afa0a6af3e574": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "088e4f506e154a20afc4799ca084d834": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "12c80c499e814112b2cb57da1c9f4b10": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "05eaaddc234c4cdcb39a2d5b385c8d1d": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "480be2d70bd045dea3585dbfb71ae612": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "c9ba6762d89947769f6bea8a8d061f67": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_1f536c2caf5946039c3b53a053aa2b84",
              "IPY_MODEL_1389cd56c6914111abbd4e78a3a6401b",
              "IPY_MODEL_1b4ca023870f44d89e3f83809d9142ee"
            ],
            "layout": "IPY_MODEL_b2f9f84e066848298dcc265da7de1116"
          }
        },
        "1f536c2caf5946039c3b53a053aa2b84": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_d4e4ebb4aba14e7eaa9579bccde42f30",
            "placeholder": "​",
            "style": "IPY_MODEL_b801ea2af483454ca9ceb618c233a727",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "1389cd56c6914111abbd4e78a3a6401b": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_db9b7eeba4e7442289c17f7f46864d92",
            "max": 20,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_d91225e0d54f437db344f1e45769a4b4",
            "value": 20
          }
        },
        "1b4ca023870f44d89e3f83809d9142ee": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_50492ae5ea9b42fd88bbf151668c517d",
            "placeholder": "​",
            "style": "IPY_MODEL_7cdbe747683e444a974295c782799acd",
            "value": " 20/20 [00:00&lt;00:00, 27.12it/s]"
          }
        },
        "b2f9f84e066848298dcc265da7de1116": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "d4e4ebb4aba14e7eaa9579bccde42f30": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "b801ea2af483454ca9ceb618c233a727": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "db9b7eeba4e7442289c17f7f46864d92": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "d91225e0d54f437db344f1e45769a4b4": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "50492ae5ea9b42fd88bbf151668c517d": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "7cdbe747683e444a974295c782799acd": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "4648572a3fa54cec8c94b5ca30456a1c": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_1032e57fb34644bfb80bb15afa3ab7cf",
              "IPY_MODEL_d60dd5e1c97d4dbd918f24da60426822",
              "IPY_MODEL_eaa548ad0b9e43ec922cf5fb13184811"
            ],
            "layout": "IPY_MODEL_03e9144572024952a3e7252ba66da5bb"
          }
        },
        "1032e57fb34644bfb80bb15afa3ab7cf": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_f4d2e319b3e44567936528a561950f5f",
            "placeholder": "​",
            "style": "IPY_MODEL_12f6cd915ade4b858373fa9381efa56c",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "d60dd5e1c97d4dbd918f24da60426822": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_c00c3f264e3f40ddbab072f413a4920a",
            "max": 20,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_ad2e8f38951c4783bf2300209dc28905",
            "value": 20
          }
        },
        "eaa548ad0b9e43ec922cf5fb13184811": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_de28c2a50ed6490ab5bcb3f3d845ca11",
            "placeholder": "​",
            "style": "IPY_MODEL_41343f9ea6b242ceb307fd1ae31c958b",
            "value": " 20/20 [00:00&lt;00:00, 27.14it/s]"
          }
        },
        "03e9144572024952a3e7252ba66da5bb": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "f4d2e319b3e44567936528a561950f5f": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "12f6cd915ade4b858373fa9381efa56c": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "c00c3f264e3f40ddbab072f413a4920a": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "ad2e8f38951c4783bf2300209dc28905": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "de28c2a50ed6490ab5bcb3f3d845ca11": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "41343f9ea6b242ceb307fd1ae31c958b": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "e195f4e87d5b4ad7add18e00b2a857ed": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_233940ed1d48458fb3570fa4cbabf04f",
              "IPY_MODEL_0f9c0c11adc247d2a673e6dc06658ab2",
              "IPY_MODEL_fb7bd2693b8f49cf88d106c2e68dd9a3"
            ],
            "layout": "IPY_MODEL_45fc25e7ee98424a94513bf3de61bb4d"
          }
        },
        "233940ed1d48458fb3570fa4cbabf04f": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_f19fa3710d214700b3cb68dbe6804a35",
            "placeholder": "​",
            "style": "IPY_MODEL_8bc84b21a29f4dc2b2ebfa81a708c31f",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "0f9c0c11adc247d2a673e6dc06658ab2": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_6bcf15e34d414c9b89592883ab6f49bb",
            "max": 20,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_73dcf42d7e864cf69c25a25efb11f2a4",
            "value": 20
          }
        },
        "fb7bd2693b8f49cf88d106c2e68dd9a3": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_1203cdc392834d7f83a5d1874bbcfc4f",
            "placeholder": "​",
            "style": "IPY_MODEL_96525ea07cc141c3bcccb6d5407452e3",
            "value": " 20/20 [00:00&lt;00:00, 27.13it/s]"
          }
        },
        "45fc25e7ee98424a94513bf3de61bb4d": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "f19fa3710d214700b3cb68dbe6804a35": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "8bc84b21a29f4dc2b2ebfa81a708c31f": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "6bcf15e34d414c9b89592883ab6f49bb": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "73dcf42d7e864cf69c25a25efb11f2a4": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "1203cdc392834d7f83a5d1874bbcfc4f": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "96525ea07cc141c3bcccb6d5407452e3": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "e61ec939c5fb41419a3e96c02f40cf49": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_fa8aa26656994a318cd3916167f1479a",
              "IPY_MODEL_cb4743af140c41c2a85b99ab17295a8b",
              "IPY_MODEL_f82a56a3081046e3aec1eb4e8a415a9a"
            ],
            "layout": "IPY_MODEL_ec7e9eea1eb0471588e0ba3412d6d161"
          }
        },
        "fa8aa26656994a318cd3916167f1479a": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_70ccaae0e0d94515b13565b608fdd669",
            "placeholder": "​",
            "style": "IPY_MODEL_e353a996dc464345bf983859d15bdcd8",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "cb4743af140c41c2a85b99ab17295a8b": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_3ff2d8fa24054dcfb3258109f4c02422",
            "max": 20,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_89759658685d47d8bbd0f30a6e55ccd4",
            "value": 20
          }
        },
        "f82a56a3081046e3aec1eb4e8a415a9a": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_460a76c71ef443b29cb7d7553aa06476",
            "placeholder": "​",
            "style": "IPY_MODEL_0ba09c04302b4c8885eb2b4494faa328",
            "value": " 20/20 [00:00&lt;00:00, 27.76it/s]"
          }
        },
        "ec7e9eea1eb0471588e0ba3412d6d161": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "70ccaae0e0d94515b13565b608fdd669": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "e353a996dc464345bf983859d15bdcd8": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "3ff2d8fa24054dcfb3258109f4c02422": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "89759658685d47d8bbd0f30a6e55ccd4": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "460a76c71ef443b29cb7d7553aa06476": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "0ba09c04302b4c8885eb2b4494faa328": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "7f5623aeebe14ee5823531d4847b5aaa": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_5e12b15bdeaa4f4ba02dd3d105623762",
              "IPY_MODEL_01f21108a0204acb9a873d9658172708",
              "IPY_MODEL_a106561805024f03afc341747617378d"
            ],
            "layout": "IPY_MODEL_13eee2791df54a1396a1632bf3b4f11f"
          }
        },
        "5e12b15bdeaa4f4ba02dd3d105623762": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_46c0a68d41684ee9a660c86400ffca82",
            "placeholder": "​",
            "style": "IPY_MODEL_5a494357410b4a38a16dff5510939a04",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "01f21108a0204acb9a873d9658172708": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_3f04ccbe609f45188917549033486392",
            "max": 20,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_8a28a00c480e4157a9edff253680c3a4",
            "value": 20
          }
        },
        "a106561805024f03afc341747617378d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_976a71d9db20405cb7f5b6b5fcecbf9e",
            "placeholder": "​",
            "style": "IPY_MODEL_a166f6330a264f9fb16cbd207952b95b",
            "value": " 20/20 [00:00&lt;00:00, 27.51it/s]"
          }
        },
        "13eee2791df54a1396a1632bf3b4f11f": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "46c0a68d41684ee9a660c86400ffca82": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "5a494357410b4a38a16dff5510939a04": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "3f04ccbe609f45188917549033486392": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "8a28a00c480e4157a9edff253680c3a4": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "976a71d9db20405cb7f5b6b5fcecbf9e": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "a166f6330a264f9fb16cbd207952b95b": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "1d90bb2ac59e48f58e0d52ca4387fcdc": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_c6b0d2d9838942df8d10b72e75dac4fa",
              "IPY_MODEL_5700cd229f6e45a3a68b2ba774bcc2e3",
              "IPY_MODEL_5d1d0b9d45e244f2a8c548fa290819b0"
            ],
            "layout": "IPY_MODEL_3f9b7cffeb3c418893fabe4ac003937b"
          }
        },
        "c6b0d2d9838942df8d10b72e75dac4fa": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_4a00332773e54af6a1995721a9dbf03d",
            "placeholder": "​",
            "style": "IPY_MODEL_bbf3ef2529754249883a074f0868eefe",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "5700cd229f6e45a3a68b2ba774bcc2e3": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_33c76f31464546908c8381cad4aea650",
            "max": 20,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_3e5ae4ce660543b7a0da0f98efcb1b31",
            "value": 20
          }
        },
        "5d1d0b9d45e244f2a8c548fa290819b0": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_c6b963a608fb4e3484d4e3c41ad53697",
            "placeholder": "​",
            "style": "IPY_MODEL_b70a337e17c444ddb02549c8a04ab0a8",
            "value": " 20/20 [00:00&lt;00:00, 27.44it/s]"
          }
        },
        "3f9b7cffeb3c418893fabe4ac003937b": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "4a00332773e54af6a1995721a9dbf03d": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "bbf3ef2529754249883a074f0868eefe": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "33c76f31464546908c8381cad4aea650": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "3e5ae4ce660543b7a0da0f98efcb1b31": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "c6b963a608fb4e3484d4e3c41ad53697": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "b70a337e17c444ddb02549c8a04ab0a8": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "a014db9348614e32a6701f595d7de555": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_2492df5173a94256a4eae4f1f93f69f9",
              "IPY_MODEL_6f612f591964491783916366eca3f6d3",
              "IPY_MODEL_5d1fa9ae4f2b4e76a8bd26087ae7a153"
            ],
            "layout": "IPY_MODEL_566598cb731642d5a29e61f2191d210f"
          }
        },
        "2492df5173a94256a4eae4f1f93f69f9": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_63ac3861ced2458ab6db2867894fd938",
            "placeholder": "​",
            "style": "IPY_MODEL_3d624db7752a4bc5972f26a8f09ab0d1",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "6f612f591964491783916366eca3f6d3": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_40a3b598c4834c1ca9d73bfe045ab650",
            "max": 20,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_154fb86ee765408281ee32811f7763b2",
            "value": 20
          }
        },
        "5d1fa9ae4f2b4e76a8bd26087ae7a153": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_65affb0b597a476d82225f02b76a682c",
            "placeholder": "​",
            "style": "IPY_MODEL_535e662ac24b4c4ab5280a1dc014c0cc",
            "value": " 20/20 [00:00&lt;00:00, 26.86it/s]"
          }
        },
        "566598cb731642d5a29e61f2191d210f": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "63ac3861ced2458ab6db2867894fd938": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "3d624db7752a4bc5972f26a8f09ab0d1": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "40a3b598c4834c1ca9d73bfe045ab650": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "154fb86ee765408281ee32811f7763b2": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "65affb0b597a476d82225f02b76a682c": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "535e662ac24b4c4ab5280a1dc014c0cc": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "54ce75e8408b4bca89020d37ec78a18b": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_b04ce2905cd943aeab7a1145fc14ea4a",
              "IPY_MODEL_907802e7bfd744e096765b35bc722530",
              "IPY_MODEL_946ee481d3834c6eb60e0ff331383eb6"
            ],
            "layout": "IPY_MODEL_6fbab320a3c444fc97f466695f454ce9"
          }
        },
        "b04ce2905cd943aeab7a1145fc14ea4a": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_80322039152d4eb08976b48d5c611caf",
            "placeholder": "​",
            "style": "IPY_MODEL_6ea06d5ca10246b6966bb31e6112351f",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "907802e7bfd744e096765b35bc722530": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_dde7648eeb894938a136eb3b7390d9c9",
            "max": 20,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_c2ad5da24c77496eb3c7da357cb069b2",
            "value": 20
          }
        },
        "946ee481d3834c6eb60e0ff331383eb6": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_3af28e56a76947bc8708c90b8cd9763b",
            "placeholder": "​",
            "style": "IPY_MODEL_2bbf9c86a3c44f68b9626e8e941c7a55",
            "value": " 20/20 [00:00&lt;00:00, 27.03it/s]"
          }
        },
        "6fbab320a3c444fc97f466695f454ce9": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "80322039152d4eb08976b48d5c611caf": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "6ea06d5ca10246b6966bb31e6112351f": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "dde7648eeb894938a136eb3b7390d9c9": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "c2ad5da24c77496eb3c7da357cb069b2": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "3af28e56a76947bc8708c90b8cd9763b": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "2bbf9c86a3c44f68b9626e8e941c7a55": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "c011c90961b843ae9be7981d7e144efa": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_e4159809957142c7950503bb52768be5",
              "IPY_MODEL_55fa8707c6a7401882d79e1631ba13eb",
              "IPY_MODEL_0694b3ddf60a4d0eb171f9b3bc987461"
            ],
            "layout": "IPY_MODEL_7e16e882b67748ff82fb0c4a9b953dcb"
          }
        },
        "e4159809957142c7950503bb52768be5": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_2bdcb96a676846d3af96e9e4f14918e0",
            "placeholder": "​",
            "style": "IPY_MODEL_6cf8089692ba472fa52659a38effb711",
            "value": "100%"
          }
        },
        "55fa8707c6a7401882d79e1631ba13eb": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_8c5cbd1e8eea45b48932b33638c473ef",
            "max": 14212972,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_f50f1318e26a458ca203a247649b723c",
            "value": 14212972
          }
        },
        "0694b3ddf60a4d0eb171f9b3bc987461": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_2cba881c69c44dc98899f636eaa7e611",
            "placeholder": "​",
            "style": "IPY_MODEL_3ca0d0e1302c47e68a3caf8cb733d0ba",
            "value": " 13.6M/13.6M [00:01&lt;00:00, 12.0MB/s]"
          }
        },
        "7e16e882b67748ff82fb0c4a9b953dcb": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "2bdcb96a676846d3af96e9e4f14918e0": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "6cf8089692ba472fa52659a38effb711": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "8c5cbd1e8eea45b48932b33638c473ef": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "f50f1318e26a458ca203a247649b723c": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "2cba881c69c44dc98899f636eaa7e611": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "3ca0d0e1302c47e68a3caf8cb733d0ba": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        }
      }
    }
  },
  "nbformat": 4,
  "nbformat_minor": 0
}