Classification_Test_4.ipynb

{
  "nbformat": 4,
  "nbformat_minor": 0,
  "metadata": {
    "kernelspec": {
      "display_name": "Python 3",
      "language": "python",
      "name": "python3"
    },
    "language_info": {
      "codemirror_mode": {
        "name": "ipython",
        "version": 3
      },
      "file_extension": ".py",
      "mimetype": "text/x-python",
      "name": "python",
      "nbconvert_exporter": "python",
      "pygments_lexer": "ipython3",
      "version": "3.6.5"
    },
    "colab": {
      "name": "Classification Test 4.ipynb",
      "version": "0.3.2",
      "provenance": [],
      "collapsed_sections": [
        "b-Fa9hPz8TTJ",
        "72RBDx7F8TTK"
      ]
    }
  },
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "B4fZM-H98TOr",
        "colab_type": "text"
      },
      "source": [
        "# Classification Test 3\n",
        "\n",
        "\n",
        "- S&P500의 505개 주식 중, 2010년 부터 데이터를 얻을 수 있었던 453개 주식의 수익률을 가지고 개별 기업의 주가 수익률의 방향을 예측해보는 실험을 해보았다.\n",
        "- 연구의 목적: Classification model 비교\n",
        "- PCA-SVM, Random Forest, Gaussian Naive Bayesian, Decision Tree, Adaboost, Gradient Boost, M\n",
        "XGboost, KNN, MPC"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "OwXw4X0o8TOt",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "import numpy as np\n",
        "import pandas as pd\n",
        "!pip install -q yfinance\n",
        "import yfinance as yf\n",
        "import matplotlib.pyplot as plt\n",
        "import seaborn as sns"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "SBWeYAfc8TO0",
        "colab_type": "text"
      },
      "source": [
        "## Data"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "UCi5ONr8-YVE",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 54
        },
        "outputId": "c89f029a-9b8a-4820-a188-ea7640e60f35"
      },
      "source": [
        "table = pd.read_html('https://en.wikipedia.org/wiki/List_of_S%26P_500_companies')[0]\n",
        "tickers = table['Symbol'].tolist()\n",
        "print (tickers)"
      ],
      "execution_count": 2,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "['MMM', 'ABT', 'ABBV', 'ABMD', 'ACN', 'ATVI', 'ADBE', 'AMD', 'AAP', 'AES', 'AMG', 'AFL', 'A', 'APD', 'AKAM', 'ALK', 'ALB', 'ARE', 'ALXN', 'ALGN', 'ALLE', 'AGN', 'ADS', 'LNT', 'ALL', 'GOOGL', 'GOOG', 'MO', 'AMZN', 'AMCR', 'AEE', 'AAL', 'AEP', 'AXP', 'AIG', 'AMT', 'AWK', 'AMP', 'ABC', 'AME', 'AMGN', 'APH', 'APC', 'ADI', 'ANSS', 'ANTM', 'AON', 'AOS', 'APA', 'AIV', 'AAPL', 'AMAT', 'APTV', 'ADM', 'ARNC', 'ANET', 'AJG', 'AIZ', 'ATO', 'T', 'ADSK', 'ADP', 'AZO', 'AVB', 'AVY', 'BHGE', 'BLL', 'BAC', 'BK', 'BAX', 'BBT', 'BDX', 'BRK.B', 'BBY', 'BIIB', 'BLK', 'HRB', 'BA', 'BKNG', 'BWA', 'BXP', 'BSX', 'BMY', 'AVGO', 'BR', 'BF.B', 'CHRW', 'COG', 'CDNS', 'CPB', 'COF', 'CPRI', 'CAH', 'KMX', 'CCL', 'CAT', 'CBOE', 'CBRE', 'CBS', 'CE', 'CELG', 'CNC', 'CNP', 'CTL', 'CERN', 'CF', 'SCHW', 'CHTR', 'CVX', 'CMG', 'CB', 'CHD', 'CI', 'XEC', 'CINF', 'CTAS', 'CSCO', 'C', 'CFG', 'CTXS', 'CLX', 'CME', 'CMS', 'KO', 'CTSH', 'CL', 'CMCSA', 'CMA', 'CAG', 'CXO', 'COP', 'ED', 'STZ', 'COO', 'CPRT', 'GLW', 'CTVA', 'COST', 'COTY', 'CCI', 'CSX', 'CMI', 'CVS', 'DHI', 'DHR', 'DRI', 'DVA', 'DE', 'DAL', 'XRAY', 'DVN', 'FANG', 'DLR', 'DFS', 'DISCA', 'DISCK', 'DISH', 'DG', 'DLTR', 'D', 'DOV', 'DOW', 'DTE', 'DUK', 'DRE', 'DD', 'DXC', 'ETFC', 'EMN', 'ETN', 'EBAY', 'ECL', 'EIX', 'EW', 'EA', 'EMR', 'ETR', 'EOG', 'EFX', 'EQIX', 'EQR', 'ESS', 'EL', 'EVRG', 'ES', 'RE', 'EXC', 'EXPE', 'EXPD', 'EXR', 'XOM', 'FFIV', 'FB', 'FAST', 'FRT', 'FDX', 'FIS', 'FITB', 'FE', 'FRC', 'FISV', 'FLT', 'FLIR', 'FLS', 'FMC', 'FL', 'F', 'FTNT', 'FTV', 'FBHS', 'FOXA', 'FOX', 'BEN', 'FCX', 'GPS', 'GRMN', 'IT', 'GD', 'GE', 'GIS', 'GM', 'GPC', 'GILD', 'GPN', 'GS', 'GWW', 'HAL', 'HBI', 'HOG', 'HIG', 'HAS', 'HCA', 'HCP', 'HP', 'HSIC', 'HSY', 'HES', 'HPE', 'HLT', 'HFC', 'HOLX', 'HD', 'HON', 'HRL', 'HST', 'HPQ', 'HUM', 'HBAN', 'HII', 'IDXX', 'INFO', 'ITW', 'ILMN', 'IR', 'INTC', 'ICE', 'IBM', 'INCY', 'IP', 'IPG', 'IFF', 'INTU', 'ISRG', 'IVZ', 'IPGP', 'IQV', 'IRM', 'JKHY', 'JEC', 'JBHT', 'JEF', 'SJM', 'JNJ', 'JCI', 'JPM', 'JNPR', 'KSU', 'K', 'KEY', 'KEYS', 'KMB', 'KIM', 'KMI', 'KLAC', 'KSS', 'KHC', 'KR', 'LB', 'LHX', 'LH', 'LRCX', 'LW', 'LEG', 'LEN', 'LLY', 'LNC', 'LIN', 'LKQ', 'LMT', 'L', 'LOW', 'LYB', 'MTB', 'MAC', 'M', 'MRO', 'MPC', 'MKTX', 'MAR', 'MMC', 'MLM', 'MAS', 'MA', 'MKC', 'MXIM', 'MCD', 'MCK', 'MDT', 'MRK', 'MET', 'MTD', 'MGM', 'MCHP', 'MU', 'MSFT', 'MAA', 'MHK', 'TAP', 'MDLZ', 'MNST', 'MCO', 'MS', 'MOS', 'MSI', 'MSCI', 'MYL', 'NDAQ', 'NOV', 'NKTR', 'NTAP', 'NFLX', 'NWL', 'NEM', 'NWSA', 'NWS', 'NEE', 'NLSN', 'NKE', 'NI', 'NBL', 'JWN', 'NSC', 'NTRS', 'NOC', 'NCLH', 'NRG', 'NUE', 'NVDA', 'ORLY', 'OXY', 'OMC', 'OKE', 'ORCL', 'PCAR', 'PKG', 'PH', 'PAYX', 'PYPL', 'PNR', 'PBCT', 'PEP', 'PKI', 'PRGO', 'PFE', 'PM', 'PSX', 'PNW', 'PXD', 'PNC', 'PPG', 'PPL', 'PFG', 'PG', 'PGR', 'PLD', 'PRU', 'PEG', 'PSA', 'PHM', 'PVH', 'QRVO', 'PWR', 'QCOM', 'DGX', 'RL', 'RJF', 'RTN', 'O', 'REG', 'REGN', 'RF', 'RSG', 'RMD', 'RHI', 'ROK', 'ROL', 'ROP', 'ROST', 'RCL', 'CRM', 'SBAC', 'SLB', 'STX', 'SEE', 'SRE', 'SHW', 'SPG', 'SWKS', 'SLG', 'SNA', 'SO', 'LUV', 'SPGI', 'SWK', 'SBUX', 'STT', 'SYK', 'STI', 'SIVB', 'SYMC', 'SYF', 'SNPS', 'SYY', 'TMUS', 'TROW', 'TTWO', 'TPR', 'TGT', 'TEL', 'FTI', 'TFX', 'TXN', 'TXT', 'TMO', 'TIF', 'TWTR', 'TJX', 'TMK', 'TSS', 'TSCO', 'TDG', 'TRV', 'TRIP', 'TSN', 'UDR', 'ULTA', 'USB', 'UAA', 'UA', 'UNP', 'UAL', 'UNH', 'UPS', 'URI', 'UTX', 'UHS', 'UNM', 'VFC', 'VLO', 'VAR', 'VTR', 'VRSN', 'VRSK', 'VZ', 'VRTX', 'VIAB', 'V', 'VNO', 'VMC', 'WAB', 'WMT', 'WBA', 'DIS', 'WM', 'WAT', 'WEC', 'WCG', 'WFC', 'WELL', 'WDC', 'WU', 'WRK', 'WY', 'WHR', 'WMB', 'WLTW', 'WYNN', 'XEL', 'XRX', 'XLNX', 'XYL', 'YUM', 'ZBH', 'ZION', 'ZTS']\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "8ufA0Dxj8TO2",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 731
        },
        "outputId": "4f52bac4-4d82-4db4-c624-07104305439a"
      },
      "source": [
        "data = yf.download(tickers, start='2009-08-07',end='2019-08-07')"
      ],
      "execution_count": 95,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "[**********************52%                       ]  261 of 505 downloaded"
          ],
          "name": "stdout"
        },
        {
          "output_type": "stream",
          "text": [
            "Exception in thread Thread-1280:\n",
            "Traceback (most recent call last):\n",
            "  File \"/usr/lib/python3.6/threading.py\", line 916, in _bootstrap_inner\n",
            "    self.run()\n",
            "  File \"/usr/lib/python3.6/threading.py\", line 864, in run\n",
            "    self._target(*self._args, **self._kwargs)\n",
            "  File \"/usr/local/lib/python3.6/dist-packages/multitasking/__init__.py\", line 102, in _run_via_pool\n",
            "    return callee(*args, **kwargs)\n",
            "  File \"/usr/local/lib/python3.6/dist-packages/yfinance/__init__.py\", line 514, in _download_one_threaded\n",
            "    period, interval, prepost, proxy)\n",
            "  File \"/usr/local/lib/python3.6/dist-packages/yfinance/__init__.py\", line 527, in _download_one\n",
            "    proxy=proxy)\n",
            "  File \"/usr/local/lib/python3.6/dist-packages/yfinance/__init__.py\", line 348, in history\n",
            "    raise ValueError(self.ticker, err_msg)\n",
            "ValueError: ('BRK.B', 'No data found, symbol may be delisted')\n",
            "\n"
          ],
          "name": "stderr"
        },
        {
          "output_type": "stream",
          "text": [
            "[**********************72%**********             ]  366 of 505 downloaded"
          ],
          "name": "stdout"
        },
        {
          "output_type": "stream",
          "text": [
            "Exception in thread Thread-1386:\n",
            "Traceback (most recent call last):\n",
            "  File \"/usr/local/lib/python3.6/dist-packages/yfinance/__init__.py\", line 357, in history\n",
            "    quotes = self._parse_quotes(data[\"chart\"][\"result\"][0])\n",
            "  File \"/usr/local/lib/python3.6/dist-packages/yfinance/__init__.py\", line 206, in _parse_quotes\n",
            "    timestamps = data[\"timestamp\"]\n",
            "KeyError: 'timestamp'\n",
            "\n",
            "During handling of the above exception, another exception occurred:\n",
            "\n",
            "Traceback (most recent call last):\n",
            "  File \"/usr/lib/python3.6/threading.py\", line 916, in _bootstrap_inner\n",
            "    self.run()\n",
            "  File \"/usr/lib/python3.6/threading.py\", line 864, in run\n",
            "    self._target(*self._args, **self._kwargs)\n",
            "  File \"/usr/local/lib/python3.6/dist-packages/multitasking/__init__.py\", line 102, in _run_via_pool\n",
            "    return callee(*args, **kwargs)\n",
            "  File \"/usr/local/lib/python3.6/dist-packages/yfinance/__init__.py\", line 514, in _download_one_threaded\n",
            "    period, interval, prepost, proxy)\n",
            "  File \"/usr/local/lib/python3.6/dist-packages/yfinance/__init__.py\", line 527, in _download_one\n",
            "    proxy=proxy)\n",
            "  File \"/usr/local/lib/python3.6/dist-packages/yfinance/__init__.py\", line 360, in history\n",
            "    raise ValueError(self.ticker, err_msg)\n",
            "ValueError: ('BF.B', 'No data found for this date range, symbol may be delisted')\n",
            "\n"
          ],
          "name": "stderr"
        },
        {
          "output_type": "stream",
          "text": [
            "[*********************100%***********************]  503 of 505 downloaded\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "LvQ16K-P8TO8",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 1000
        },
        "outputId": "4908fb15-ff82-4bda-9475-2748a34e2d29"
      },
      "source": [
        "close = data['Adj Close'][1:]\n",
        "close = close.dropna(axis=0,how='all')\n",
        "close.dropna(axis=1,inplace=True)\n",
        "ret = close.pct_change()\n",
        "ret = ret.dropna()"
      ],
      "execution_count": 96,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>A</th>\n",
              "      <th>AAL</th>\n",
              "      <th>AAP</th>\n",
              "      <th>AAPL</th>\n",
              "      <th>ABC</th>\n",
              "      <th>ABMD</th>\n",
              "      <th>ABT</th>\n",
              "      <th>ACN</th>\n",
              "      <th>ADBE</th>\n",
              "      <th>ADI</th>\n",
              "      <th>ADM</th>\n",
              "      <th>ADP</th>\n",
              "      <th>ADS</th>\n",
              "      <th>ADSK</th>\n",
              "      <th>AEE</th>\n",
              "      <th>AEP</th>\n",
              "      <th>AES</th>\n",
              "      <th>AFL</th>\n",
              "      <th>AGN</th>\n",
              "      <th>AIG</th>\n",
              "      <th>AIV</th>\n",
              "      <th>AIZ</th>\n",
              "      <th>AJG</th>\n",
              "      <th>AKAM</th>\n",
              "      <th>ALB</th>\n",
              "      <th>ALGN</th>\n",
              "      <th>ALK</th>\n",
              "      <th>ALL</th>\n",
              "      <th>ALXN</th>\n",
              "      <th>AMAT</th>\n",
              "      <th>AMD</th>\n",
              "      <th>AME</th>\n",
              "      <th>AMG</th>\n",
              "      <th>AMGN</th>\n",
              "      <th>AMP</th>\n",
              "      <th>AMT</th>\n",
              "      <th>AMZN</th>\n",
              "      <th>ANSS</th>\n",
              "      <th>ANTM</th>\n",
              "      <th>AON</th>\n",
              "      <th>...</th>\n",
              "      <th>UNM</th>\n",
              "      <th>UNP</th>\n",
              "      <th>UPS</th>\n",
              "      <th>URI</th>\n",
              "      <th>USB</th>\n",
              "      <th>UTX</th>\n",
              "      <th>V</th>\n",
              "      <th>VAR</th>\n",
              "      <th>VFC</th>\n",
              "      <th>VIAB</th>\n",
              "      <th>VLO</th>\n",
              "      <th>VNO</th>\n",
              "      <th>VRSN</th>\n",
              "      <th>VRTX</th>\n",
              "      <th>VTR</th>\n",
              "      <th>VZ</th>\n",
              "      <th>WAB</th>\n",
              "      <th>WAT</th>\n",
              "      <th>WBA</th>\n",
              "      <th>WCG</th>\n",
              "      <th>WDC</th>\n",
              "      <th>WEC</th>\n",
              "      <th>WELL</th>\n",
              "      <th>WFC</th>\n",
              "      <th>WHR</th>\n",
              "      <th>WLTW</th>\n",
              "      <th>WM</th>\n",
              "      <th>WMB</th>\n",
              "      <th>WMT</th>\n",
              "      <th>WU</th>\n",
              "      <th>WY</th>\n",
              "      <th>WYNN</th>\n",
              "      <th>XEC</th>\n",
              "      <th>XEL</th>\n",
              "      <th>XLNX</th>\n",
              "      <th>XOM</th>\n",
              "      <th>XRAY</th>\n",
              "      <th>XRX</th>\n",
              "      <th>YUM</th>\n",
              "      <th>ZION</th>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>Date</th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>2009-08-10</th>\n",
              "      <td>0.004439</td>\n",
              "      <td>-0.045902</td>\n",
              "      <td>-0.019243</td>\n",
              "      <td>-0.004829</td>\n",
              "      <td>-0.001139</td>\n",
              "      <td>0.009589</td>\n",
              "      <td>0.015844</td>\n",
              "      <td>0.007749</td>\n",
              "      <td>-0.012041</td>\n",
              "      <td>0.003855</td>\n",
              "      <td>-0.000448</td>\n",
              "      <td>-0.008065</td>\n",
              "      <td>-0.014031</td>\n",
              "      <td>0.004630</td>\n",
              "      <td>0.003480</td>\n",
              "      <td>-0.005296</td>\n",
              "      <td>0.007201</td>\n",
              "      <td>-0.018377</td>\n",
              "      <td>-0.004302</td>\n",
              "      <td>0.057483</td>\n",
              "      <td>-0.063616</td>\n",
              "      <td>0.003597</td>\n",
              "      <td>-0.005481</td>\n",
              "      <td>-0.001542</td>\n",
              "      <td>-0.011248</td>\n",
              "      <td>0.027641</td>\n",
              "      <td>-0.017143</td>\n",
              "      <td>-0.018843</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000910</td>\n",
              "      <td>-0.005405</td>\n",
              "      <td>-0.008403</td>\n",
              "      <td>-0.024184</td>\n",
              "      <td>0.012341</td>\n",
              "      <td>-0.016177</td>\n",
              "      <td>0.002848</td>\n",
              "      <td>-0.010314</td>\n",
              "      <td>-0.009592</td>\n",
              "      <td>0.009594</td>\n",
              "      <td>-0.006087</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.023810</td>\n",
              "      <td>-0.034361</td>\n",
              "      <td>-0.007227</td>\n",
              "      <td>-0.014371</td>\n",
              "      <td>-0.010133</td>\n",
              "      <td>0.005238</td>\n",
              "      <td>-0.004249</td>\n",
              "      <td>0.005359</td>\n",
              "      <td>-0.025200</td>\n",
              "      <td>0.008946</td>\n",
              "      <td>0.008648</td>\n",
              "      <td>-0.005502</td>\n",
              "      <td>0.006940</td>\n",
              "      <td>-0.009185</td>\n",
              "      <td>-0.008073</td>\n",
              "      <td>-0.005020</td>\n",
              "      <td>-0.008924</td>\n",
              "      <td>0.009360</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.016170</td>\n",
              "      <td>-0.005412</td>\n",
              "      <td>0.008796</td>\n",
              "      <td>-0.025443</td>\n",
              "      <td>-0.004032</td>\n",
              "      <td>-0.045699</td>\n",
              "      <td>-0.004078</td>\n",
              "      <td>0.005286</td>\n",
              "      <td>0.018349</td>\n",
              "      <td>0.008632</td>\n",
              "      <td>-0.002199</td>\n",
              "      <td>-0.036286</td>\n",
              "      <td>-0.035202</td>\n",
              "      <td>0.048203</td>\n",
              "      <td>0.003715</td>\n",
              "      <td>0.002950</td>\n",
              "      <td>-0.004125</td>\n",
              "      <td>-0.005505</td>\n",
              "      <td>0.034362</td>\n",
              "      <td>-0.000981</td>\n",
              "      <td>0.051298</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2009-08-11</th>\n",
              "      <td>0.002525</td>\n",
              "      <td>-0.051546</td>\n",
              "      <td>-0.018060</td>\n",
              "      <td>-0.011160</td>\n",
              "      <td>-0.001140</td>\n",
              "      <td>-0.010855</td>\n",
              "      <td>0.004199</td>\n",
              "      <td>-0.011534</td>\n",
              "      <td>-0.027422</td>\n",
              "      <td>-0.001920</td>\n",
              "      <td>-0.006720</td>\n",
              "      <td>-0.005807</td>\n",
              "      <td>-0.011129</td>\n",
              "      <td>0.005027</td>\n",
              "      <td>-0.004624</td>\n",
              "      <td>0.001452</td>\n",
              "      <td>-0.039321</td>\n",
              "      <td>-0.017161</td>\n",
              "      <td>0.016975</td>\n",
              "      <td>-0.131678</td>\n",
              "      <td>-0.034565</td>\n",
              "      <td>-0.009409</td>\n",
              "      <td>0.021433</td>\n",
              "      <td>-0.050952</td>\n",
              "      <td>-0.001468</td>\n",
              "      <td>-0.042267</td>\n",
              "      <td>-0.009690</td>\n",
              "      <td>-0.019204</td>\n",
              "      <td>-0.026079</td>\n",
              "      <td>-0.019091</td>\n",
              "      <td>-0.024457</td>\n",
              "      <td>-0.015408</td>\n",
              "      <td>-0.021286</td>\n",
              "      <td>0.025757</td>\n",
              "      <td>-0.045002</td>\n",
              "      <td>-0.003195</td>\n",
              "      <td>-0.010422</td>\n",
              "      <td>-0.015219</td>\n",
              "      <td>-0.010608</td>\n",
              "      <td>0.016147</td>\n",
              "      <td>...</td>\n",
              "      <td>0.006707</td>\n",
              "      <td>0.012318</td>\n",
              "      <td>-0.001004</td>\n",
              "      <td>-0.030377</td>\n",
              "      <td>-0.039871</td>\n",
              "      <td>-0.002039</td>\n",
              "      <td>-0.003556</td>\n",
              "      <td>-0.009094</td>\n",
              "      <td>-0.008226</td>\n",
              "      <td>-0.027586</td>\n",
              "      <td>-0.016368</td>\n",
              "      <td>-0.023859</td>\n",
              "      <td>0.017544</td>\n",
              "      <td>-0.020278</td>\n",
              "      <td>-0.018754</td>\n",
              "      <td>-0.010090</td>\n",
              "      <td>-0.025324</td>\n",
              "      <td>-0.003284</td>\n",
              "      <td>0.000405</td>\n",
              "      <td>-0.005444</td>\n",
              "      <td>0.003498</td>\n",
              "      <td>0.000671</td>\n",
              "      <td>-0.023734</td>\n",
              "      <td>-0.061179</td>\n",
              "      <td>-0.006067</td>\n",
              "      <td>-0.005733</td>\n",
              "      <td>0.004780</td>\n",
              "      <td>-0.027027</td>\n",
              "      <td>0.006483</td>\n",
              "      <td>-0.022043</td>\n",
              "      <td>-0.036545</td>\n",
              "      <td>-0.017201</td>\n",
              "      <td>-0.037214</td>\n",
              "      <td>-0.000740</td>\n",
              "      <td>-0.008824</td>\n",
              "      <td>-0.009073</td>\n",
              "      <td>-0.006513</td>\n",
              "      <td>-0.034347</td>\n",
              "      <td>-0.038310</td>\n",
              "      <td>-0.083133</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2009-08-12</th>\n",
              "      <td>0.020151</td>\n",
              "      <td>0.047101</td>\n",
              "      <td>0.008856</td>\n",
              "      <td>0.015211</td>\n",
              "      <td>0.006849</td>\n",
              "      <td>0.052126</td>\n",
              "      <td>-0.015532</td>\n",
              "      <td>0.008133</td>\n",
              "      <td>0.035088</td>\n",
              "      <td>0.003367</td>\n",
              "      <td>-0.018042</td>\n",
              "      <td>0.009346</td>\n",
              "      <td>0.014945</td>\n",
              "      <td>0.030846</td>\n",
              "      <td>-0.004065</td>\n",
              "      <td>0.001933</td>\n",
              "      <td>0.033488</td>\n",
              "      <td>0.046825</td>\n",
              "      <td>-0.007587</td>\n",
              "      <td>0.016190</td>\n",
              "      <td>0.039506</td>\n",
              "      <td>0.032112</td>\n",
              "      <td>0.022782</td>\n",
              "      <td>-0.003796</td>\n",
              "      <td>0.024991</td>\n",
              "      <td>0.095286</td>\n",
              "      <td>0.039139</td>\n",
              "      <td>0.062937</td>\n",
              "      <td>-0.000923</td>\n",
              "      <td>0.033364</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-0.004695</td>\n",
              "      <td>0.027342</td>\n",
              "      <td>-0.010351</td>\n",
              "      <td>0.032623</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.028722</td>\n",
              "      <td>0.037370</td>\n",
              "      <td>0.001340</td>\n",
              "      <td>0.009041</td>\n",
              "      <td>...</td>\n",
              "      <td>0.044821</td>\n",
              "      <td>0.012618</td>\n",
              "      <td>0.016080</td>\n",
              "      <td>0.030075</td>\n",
              "      <td>-0.003367</td>\n",
              "      <td>0.042906</td>\n",
              "      <td>0.003569</td>\n",
              "      <td>0.021519</td>\n",
              "      <td>0.001185</td>\n",
              "      <td>0.004559</td>\n",
              "      <td>-0.007924</td>\n",
              "      <td>0.006022</td>\n",
              "      <td>0.031404</td>\n",
              "      <td>0.005027</td>\n",
              "      <td>0.005049</td>\n",
              "      <td>0.019819</td>\n",
              "      <td>0.020785</td>\n",
              "      <td>0.001745</td>\n",
              "      <td>0.019028</td>\n",
              "      <td>0.005895</td>\n",
              "      <td>0.012006</td>\n",
              "      <td>0.012735</td>\n",
              "      <td>0.001216</td>\n",
              "      <td>0.010541</td>\n",
              "      <td>0.014388</td>\n",
              "      <td>0.001483</td>\n",
              "      <td>0.040438</td>\n",
              "      <td>0.024306</td>\n",
              "      <td>0.014945</td>\n",
              "      <td>0.022539</td>\n",
              "      <td>0.036015</td>\n",
              "      <td>0.073720</td>\n",
              "      <td>0.015185</td>\n",
              "      <td>0.002963</td>\n",
              "      <td>0.023145</td>\n",
              "      <td>0.014331</td>\n",
              "      <td>0.019666</td>\n",
              "      <td>0.008163</td>\n",
              "      <td>0.002043</td>\n",
              "      <td>-0.012484</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2009-08-13</th>\n",
              "      <td>0.008642</td>\n",
              "      <td>0.027682</td>\n",
              "      <td>-0.051767</td>\n",
              "      <td>0.018850</td>\n",
              "      <td>0.006803</td>\n",
              "      <td>0.020860</td>\n",
              "      <td>0.006675</td>\n",
              "      <td>0.015082</td>\n",
              "      <td>0.011804</td>\n",
              "      <td>0.022531</td>\n",
              "      <td>0.007809</td>\n",
              "      <td>0.014275</td>\n",
              "      <td>0.054899</td>\n",
              "      <td>-0.021431</td>\n",
              "      <td>0.002915</td>\n",
              "      <td>-0.002412</td>\n",
              "      <td>0.002700</td>\n",
              "      <td>0.009098</td>\n",
              "      <td>-0.003670</td>\n",
              "      <td>-0.012215</td>\n",
              "      <td>0.011876</td>\n",
              "      <td>0.013146</td>\n",
              "      <td>0.007034</td>\n",
              "      <td>-0.009254</td>\n",
              "      <td>-0.005737</td>\n",
              "      <td>-0.049451</td>\n",
              "      <td>-0.013183</td>\n",
              "      <td>0.017982</td>\n",
              "      <td>-0.016174</td>\n",
              "      <td>0.022422</td>\n",
              "      <td>0.025070</td>\n",
              "      <td>0.030660</td>\n",
              "      <td>0.006654</td>\n",
              "      <td>-0.020918</td>\n",
              "      <td>0.015796</td>\n",
              "      <td>0.008191</td>\n",
              "      <td>-0.015821</td>\n",
              "      <td>0.006771</td>\n",
              "      <td>0.026991</td>\n",
              "      <td>-0.000815</td>\n",
              "      <td>...</td>\n",
              "      <td>0.026667</td>\n",
              "      <td>0.012461</td>\n",
              "      <td>-0.007418</td>\n",
              "      <td>0.030414</td>\n",
              "      <td>0.023649</td>\n",
              "      <td>-0.013278</td>\n",
              "      <td>0.003556</td>\n",
              "      <td>0.013321</td>\n",
              "      <td>0.007101</td>\n",
              "      <td>-0.013111</td>\n",
              "      <td>0.007987</td>\n",
              "      <td>-0.004225</td>\n",
              "      <td>0.027463</td>\n",
              "      <td>0.015004</td>\n",
              "      <td>-0.002153</td>\n",
              "      <td>-0.005552</td>\n",
              "      <td>0.005090</td>\n",
              "      <td>0.017608</td>\n",
              "      <td>0.017084</td>\n",
              "      <td>0.039766</td>\n",
              "      <td>-0.009185</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-0.012141</td>\n",
              "      <td>0.026079</td>\n",
              "      <td>-0.002149</td>\n",
              "      <td>0.000329</td>\n",
              "      <td>0.021033</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.027164</td>\n",
              "      <td>0.001470</td>\n",
              "      <td>0.008876</td>\n",
              "      <td>0.022722</td>\n",
              "      <td>0.009519</td>\n",
              "      <td>-0.002954</td>\n",
              "      <td>0.013341</td>\n",
              "      <td>-0.005298</td>\n",
              "      <td>-0.000643</td>\n",
              "      <td>0.002313</td>\n",
              "      <td>-0.003058</td>\n",
              "      <td>0.038589</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2009-08-14</th>\n",
              "      <td>-0.022032</td>\n",
              "      <td>-0.016835</td>\n",
              "      <td>-0.002611</td>\n",
              "      <td>-0.009962</td>\n",
              "      <td>-0.006757</td>\n",
              "      <td>-0.042146</td>\n",
              "      <td>0.001206</td>\n",
              "      <td>-0.006220</td>\n",
              "      <td>-0.034699</td>\n",
              "      <td>-0.015002</td>\n",
              "      <td>-0.011395</td>\n",
              "      <td>-0.006847</td>\n",
              "      <td>-0.004480</td>\n",
              "      <td>0.048760</td>\n",
              "      <td>0.002326</td>\n",
              "      <td>0.001451</td>\n",
              "      <td>-0.008977</td>\n",
              "      <td>-0.010518</td>\n",
              "      <td>-0.002149</td>\n",
              "      <td>-0.025806</td>\n",
              "      <td>-0.017606</td>\n",
              "      <td>-0.006920</td>\n",
              "      <td>-0.006403</td>\n",
              "      <td>-0.010440</td>\n",
              "      <td>-0.020555</td>\n",
              "      <td>-0.024085</td>\n",
              "      <td>-0.003817</td>\n",
              "      <td>-0.013356</td>\n",
              "      <td>0.009394</td>\n",
              "      <td>-0.029825</td>\n",
              "      <td>0.002717</td>\n",
              "      <td>-0.008391</td>\n",
              "      <td>-0.035301</td>\n",
              "      <td>-0.000198</td>\n",
              "      <td>-0.010799</td>\n",
              "      <td>-0.012010</td>\n",
              "      <td>-0.012057</td>\n",
              "      <td>-0.013183</td>\n",
              "      <td>-0.011512</td>\n",
              "      <td>-0.008424</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.018069</td>\n",
              "      <td>-0.010989</td>\n",
              "      <td>-0.010962</td>\n",
              "      <td>-0.033058</td>\n",
              "      <td>-0.002200</td>\n",
              "      <td>-0.003309</td>\n",
              "      <td>-0.012757</td>\n",
              "      <td>-0.013452</td>\n",
              "      <td>-0.021152</td>\n",
              "      <td>-0.004088</td>\n",
              "      <td>-0.022979</td>\n",
              "      <td>-0.012023</td>\n",
              "      <td>0.035445</td>\n",
              "      <td>-0.005217</td>\n",
              "      <td>0.019417</td>\n",
              "      <td>0.001117</td>\n",
              "      <td>-0.031514</td>\n",
              "      <td>-0.024339</td>\n",
              "      <td>-0.007422</td>\n",
              "      <td>0.000403</td>\n",
              "      <td>-0.025106</td>\n",
              "      <td>0.000662</td>\n",
              "      <td>0.004916</td>\n",
              "      <td>-0.005545</td>\n",
              "      <td>-0.024768</td>\n",
              "      <td>-0.006413</td>\n",
              "      <td>-0.013883</td>\n",
              "      <td>-0.020339</td>\n",
              "      <td>-0.001730</td>\n",
              "      <td>-0.005869</td>\n",
              "      <td>-0.032991</td>\n",
              "      <td>-0.061096</td>\n",
              "      <td>-0.018858</td>\n",
              "      <td>-0.008889</td>\n",
              "      <td>-0.027476</td>\n",
              "      <td>-0.007891</td>\n",
              "      <td>-0.011258</td>\n",
              "      <td>-0.006924</td>\n",
              "      <td>-0.004601</td>\n",
              "      <td>0.005766</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2009-08-17</th>\n",
              "      <td>-0.020025</td>\n",
              "      <td>-0.054795</td>\n",
              "      <td>-0.001904</td>\n",
              "      <td>-0.043124</td>\n",
              "      <td>-0.009070</td>\n",
              "      <td>-0.013333</td>\n",
              "      <td>0.009031</td>\n",
              "      <td>-0.004868</td>\n",
              "      <td>-0.032848</td>\n",
              "      <td>-0.022846</td>\n",
              "      <td>-0.029507</td>\n",
              "      <td>-0.022214</td>\n",
              "      <td>-0.051065</td>\n",
              "      <td>-0.060678</td>\n",
              "      <td>-0.012761</td>\n",
              "      <td>-0.006760</td>\n",
              "      <td>-0.027174</td>\n",
              "      <td>-0.043280</td>\n",
              "      <td>0.004306</td>\n",
              "      <td>-0.039183</td>\n",
              "      <td>-0.068100</td>\n",
              "      <td>-0.029617</td>\n",
              "      <td>-0.016989</td>\n",
              "      <td>-0.018878</td>\n",
              "      <td>-0.035714</td>\n",
              "      <td>0.283317</td>\n",
              "      <td>-0.026820</td>\n",
              "      <td>-0.037555</td>\n",
              "      <td>-0.019079</td>\n",
              "      <td>-0.031646</td>\n",
              "      <td>-0.037940</td>\n",
              "      <td>-0.023846</td>\n",
              "      <td>-0.059950</td>\n",
              "      <td>-0.016620</td>\n",
              "      <td>-0.051965</td>\n",
              "      <td>-0.012871</td>\n",
              "      <td>-0.030151</td>\n",
              "      <td>-0.033533</td>\n",
              "      <td>0.028785</td>\n",
              "      <td>-0.000822</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.039678</td>\n",
              "      <td>-0.029778</td>\n",
              "      <td>-0.026448</td>\n",
              "      <td>-0.034188</td>\n",
              "      <td>-0.048512</td>\n",
              "      <td>-0.018814</td>\n",
              "      <td>-0.020818</td>\n",
              "      <td>0.003409</td>\n",
              "      <td>-0.020408</td>\n",
              "      <td>-0.027193</td>\n",
              "      <td>-0.036496</td>\n",
              "      <td>-0.075519</td>\n",
              "      <td>-0.025253</td>\n",
              "      <td>-0.016317</td>\n",
              "      <td>-0.040917</td>\n",
              "      <td>-0.027328</td>\n",
              "      <td>-0.045322</td>\n",
              "      <td>-0.017930</td>\n",
              "      <td>-0.033058</td>\n",
              "      <td>-0.004829</td>\n",
              "      <td>-0.016640</td>\n",
              "      <td>-0.001323</td>\n",
              "      <td>-0.024460</td>\n",
              "      <td>-0.051580</td>\n",
              "      <td>-0.040415</td>\n",
              "      <td>-0.010096</td>\n",
              "      <td>-0.015895</td>\n",
              "      <td>-0.042676</td>\n",
              "      <td>-0.004209</td>\n",
              "      <td>-0.027306</td>\n",
              "      <td>-0.033738</td>\n",
              "      <td>-0.074588</td>\n",
              "      <td>-0.020044</td>\n",
              "      <td>-0.012706</td>\n",
              "      <td>-0.021778</td>\n",
              "      <td>-0.024259</td>\n",
              "      <td>-0.003904</td>\n",
              "      <td>-0.038931</td>\n",
              "      <td>-0.012327</td>\n",
              "      <td>-0.059873</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2009-08-18</th>\n",
              "      <td>0.078544</td>\n",
              "      <td>0.007246</td>\n",
              "      <td>0.000715</td>\n",
              "      <td>0.027541</td>\n",
              "      <td>0.012586</td>\n",
              "      <td>0.018919</td>\n",
              "      <td>-0.009547</td>\n",
              "      <td>0.009783</td>\n",
              "      <td>0.016341</td>\n",
              "      <td>0.017048</td>\n",
              "      <td>0.019952</td>\n",
              "      <td>-0.000783</td>\n",
              "      <td>0.005655</td>\n",
              "      <td>0.021812</td>\n",
              "      <td>0.005288</td>\n",
              "      <td>-0.006806</td>\n",
              "      <td>0.021415</td>\n",
              "      <td>0.019048</td>\n",
              "      <td>0.002450</td>\n",
              "      <td>0.048248</td>\n",
              "      <td>0.010256</td>\n",
              "      <td>0.013465</td>\n",
              "      <td>-0.020858</td>\n",
              "      <td>0.009621</td>\n",
              "      <td>0.014128</td>\n",
              "      <td>-0.030000</td>\n",
              "      <td>0.021654</td>\n",
              "      <td>0.000907</td>\n",
              "      <td>0.007116</td>\n",
              "      <td>0.018674</td>\n",
              "      <td>0.002817</td>\n",
              "      <td>0.016548</td>\n",
              "      <td>0.021700</td>\n",
              "      <td>-0.001408</td>\n",
              "      <td>0.024873</td>\n",
              "      <td>0.022818</td>\n",
              "      <td>0.013077</td>\n",
              "      <td>0.009309</td>\n",
              "      <td>-0.002990</td>\n",
              "      <td>0.002743</td>\n",
              "      <td>...</td>\n",
              "      <td>0.028743</td>\n",
              "      <td>0.009162</td>\n",
              "      <td>0.009056</td>\n",
              "      <td>0.029077</td>\n",
              "      <td>0.005214</td>\n",
              "      <td>0.012181</td>\n",
              "      <td>0.008798</td>\n",
              "      <td>0.009883</td>\n",
              "      <td>0.017157</td>\n",
              "      <td>0.001582</td>\n",
              "      <td>0.005892</td>\n",
              "      <td>0.024390</td>\n",
              "      <td>0.002303</td>\n",
              "      <td>0.023697</td>\n",
              "      <td>0.017286</td>\n",
              "      <td>0.001720</td>\n",
              "      <td>0.010347</td>\n",
              "      <td>-0.009327</td>\n",
              "      <td>0.008140</td>\n",
              "      <td>0.006874</td>\n",
              "      <td>0.020548</td>\n",
              "      <td>-0.009272</td>\n",
              "      <td>0.015044</td>\n",
              "      <td>0.001470</td>\n",
              "      <td>0.037514</td>\n",
              "      <td>-0.004681</td>\n",
              "      <td>-0.024919</td>\n",
              "      <td>0.012048</td>\n",
              "      <td>-0.004227</td>\n",
              "      <td>0.015175</td>\n",
              "      <td>0.009023</td>\n",
              "      <td>0.045859</td>\n",
              "      <td>0.018212</td>\n",
              "      <td>-0.005299</td>\n",
              "      <td>0.015042</td>\n",
              "      <td>-0.000815</td>\n",
              "      <td>0.002613</td>\n",
              "      <td>0.010883</td>\n",
              "      <td>0.010400</td>\n",
              "      <td>0.027100</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2009-08-19</th>\n",
              "      <td>-0.006513</td>\n",
              "      <td>-0.014388</td>\n",
              "      <td>0.014296</td>\n",
              "      <td>0.003899</td>\n",
              "      <td>0.015819</td>\n",
              "      <td>0.014589</td>\n",
              "      <td>0.018675</td>\n",
              "      <td>0.007612</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.021073</td>\n",
              "      <td>0.008384</td>\n",
              "      <td>0.001960</td>\n",
              "      <td>-0.023036</td>\n",
              "      <td>-0.007800</td>\n",
              "      <td>0.004091</td>\n",
              "      <td>0.001958</td>\n",
              "      <td>0.000912</td>\n",
              "      <td>0.003115</td>\n",
              "      <td>0.013138</td>\n",
              "      <td>0.084932</td>\n",
              "      <td>0.015228</td>\n",
              "      <td>0.003100</td>\n",
              "      <td>-0.006086</td>\n",
              "      <td>0.005045</td>\n",
              "      <td>0.002259</td>\n",
              "      <td>0.045995</td>\n",
              "      <td>-0.015414</td>\n",
              "      <td>0.000907</td>\n",
              "      <td>0.027320</td>\n",
              "      <td>-0.004583</td>\n",
              "      <td>-0.011236</td>\n",
              "      <td>0.003101</td>\n",
              "      <td>-0.008106</td>\n",
              "      <td>0.006448</td>\n",
              "      <td>-0.000449</td>\n",
              "      <td>-0.002479</td>\n",
              "      <td>0.010716</td>\n",
              "      <td>-0.007267</td>\n",
              "      <td>-0.006213</td>\n",
              "      <td>0.001368</td>\n",
              "      <td>...</td>\n",
              "      <td>0.007567</td>\n",
              "      <td>0.005901</td>\n",
              "      <td>0.003590</td>\n",
              "      <td>0.022113</td>\n",
              "      <td>0.002882</td>\n",
              "      <td>-0.007577</td>\n",
              "      <td>0.002907</td>\n",
              "      <td>0.007951</td>\n",
              "      <td>0.008434</td>\n",
              "      <td>0.015798</td>\n",
              "      <td>0.023431</td>\n",
              "      <td>-0.004913</td>\n",
              "      <td>0.012636</td>\n",
              "      <td>0.044271</td>\n",
              "      <td>-0.008677</td>\n",
              "      <td>0.005152</td>\n",
              "      <td>-0.002410</td>\n",
              "      <td>0.007412</td>\n",
              "      <td>0.008478</td>\n",
              "      <td>-0.022490</td>\n",
              "      <td>0.024872</td>\n",
              "      <td>0.010695</td>\n",
              "      <td>0.003294</td>\n",
              "      <td>0.010274</td>\n",
              "      <td>-0.000444</td>\n",
              "      <td>0.010583</td>\n",
              "      <td>0.012778</td>\n",
              "      <td>0.017857</td>\n",
              "      <td>0.005993</td>\n",
              "      <td>0.010463</td>\n",
              "      <td>0.015941</td>\n",
              "      <td>-0.008504</td>\n",
              "      <td>0.025041</td>\n",
              "      <td>0.004566</td>\n",
              "      <td>0.007706</td>\n",
              "      <td>0.022639</td>\n",
              "      <td>0.018567</td>\n",
              "      <td>0.023325</td>\n",
              "      <td>0.002059</td>\n",
              "      <td>0.018470</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2009-08-20</th>\n",
              "      <td>0.002980</td>\n",
              "      <td>0.043796</td>\n",
              "      <td>-0.014329</td>\n",
              "      <td>0.010680</td>\n",
              "      <td>0.011123</td>\n",
              "      <td>0.039216</td>\n",
              "      <td>0.002365</td>\n",
              "      <td>-0.006181</td>\n",
              "      <td>0.011980</td>\n",
              "      <td>0.006098</td>\n",
              "      <td>0.010624</td>\n",
              "      <td>0.008607</td>\n",
              "      <td>0.004085</td>\n",
              "      <td>0.004137</td>\n",
              "      <td>0.005821</td>\n",
              "      <td>0.014656</td>\n",
              "      <td>0.015483</td>\n",
              "      <td>-0.010870</td>\n",
              "      <td>0.004222</td>\n",
              "      <td>0.212626</td>\n",
              "      <td>0.052500</td>\n",
              "      <td>0.010155</td>\n",
              "      <td>0.014697</td>\n",
              "      <td>0.001673</td>\n",
              "      <td>0.006011</td>\n",
              "      <td>-0.000758</td>\n",
              "      <td>0.001957</td>\n",
              "      <td>0.005888</td>\n",
              "      <td>0.009629</td>\n",
              "      <td>0.011971</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.009274</td>\n",
              "      <td>0.020432</td>\n",
              "      <td>0.002402</td>\n",
              "      <td>0.040018</td>\n",
              "      <td>0.020589</td>\n",
              "      <td>0.013133</td>\n",
              "      <td>-0.003378</td>\n",
              "      <td>0.019185</td>\n",
              "      <td>0.004644</td>\n",
              "      <td>...</td>\n",
              "      <td>0.011554</td>\n",
              "      <td>0.022563</td>\n",
              "      <td>0.008431</td>\n",
              "      <td>0.038462</td>\n",
              "      <td>0.022989</td>\n",
              "      <td>0.022457</td>\n",
              "      <td>0.009420</td>\n",
              "      <td>0.010922</td>\n",
              "      <td>0.009558</td>\n",
              "      <td>0.010368</td>\n",
              "      <td>0.017171</td>\n",
              "      <td>0.029244</td>\n",
              "      <td>-0.008508</td>\n",
              "      <td>0.006373</td>\n",
              "      <td>0.036105</td>\n",
              "      <td>0.009112</td>\n",
              "      <td>0.021739</td>\n",
              "      <td>0.001790</td>\n",
              "      <td>-0.002002</td>\n",
              "      <td>0.023829</td>\n",
              "      <td>0.026194</td>\n",
              "      <td>0.005291</td>\n",
              "      <td>0.036931</td>\n",
              "      <td>0.032930</td>\n",
              "      <td>0.062139</td>\n",
              "      <td>-0.001496</td>\n",
              "      <td>0.016355</td>\n",
              "      <td>0.022222</td>\n",
              "      <td>0.000745</td>\n",
              "      <td>0.007396</td>\n",
              "      <td>0.005358</td>\n",
              "      <td>0.010453</td>\n",
              "      <td>0.001879</td>\n",
              "      <td>0.006818</td>\n",
              "      <td>0.017059</td>\n",
              "      <td>0.008576</td>\n",
              "      <td>0.040614</td>\n",
              "      <td>-0.016949</td>\n",
              "      <td>0.009759</td>\n",
              "      <td>0.053756</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2009-08-21</th>\n",
              "      <td>0.008913</td>\n",
              "      <td>0.045455</td>\n",
              "      <td>0.002145</td>\n",
              "      <td>0.017291</td>\n",
              "      <td>0.002200</td>\n",
              "      <td>0.025157</td>\n",
              "      <td>0.002360</td>\n",
              "      <td>-0.024188</td>\n",
              "      <td>0.023053</td>\n",
              "      <td>0.016317</td>\n",
              "      <td>0.025137</td>\n",
              "      <td>0.028317</td>\n",
              "      <td>0.017197</td>\n",
              "      <td>0.009889</td>\n",
              "      <td>0.021991</td>\n",
              "      <td>0.009629</td>\n",
              "      <td>0.023318</td>\n",
              "      <td>0.043171</td>\n",
              "      <td>0.000901</td>\n",
              "      <td>0.017076</td>\n",
              "      <td>0.061758</td>\n",
              "      <td>0.040210</td>\n",
              "      <td>0.013881</td>\n",
              "      <td>0.025612</td>\n",
              "      <td>0.032114</td>\n",
              "      <td>0.009863</td>\n",
              "      <td>0.025391</td>\n",
              "      <td>0.034219</td>\n",
              "      <td>0.019528</td>\n",
              "      <td>0.020928</td>\n",
              "      <td>0.051136</td>\n",
              "      <td>0.017611</td>\n",
              "      <td>-0.001442</td>\n",
              "      <td>0.005792</td>\n",
              "      <td>0.022914</td>\n",
              "      <td>0.002783</td>\n",
              "      <td>0.010822</td>\n",
              "      <td>0.014407</td>\n",
              "      <td>0.007614</td>\n",
              "      <td>0.003535</td>\n",
              "      <td>...</td>\n",
              "      <td>0.031411</td>\n",
              "      <td>0.011474</td>\n",
              "      <td>0.016215</td>\n",
              "      <td>0.013889</td>\n",
              "      <td>0.009551</td>\n",
              "      <td>0.025478</td>\n",
              "      <td>0.017229</td>\n",
              "      <td>0.053721</td>\n",
              "      <td>0.007101</td>\n",
              "      <td>0.023602</td>\n",
              "      <td>0.029743</td>\n",
              "      <td>0.023616</td>\n",
              "      <td>0.017162</td>\n",
              "      <td>0.023128</td>\n",
              "      <td>0.014784</td>\n",
              "      <td>0.021445</td>\n",
              "      <td>0.025414</td>\n",
              "      <td>0.028186</td>\n",
              "      <td>0.024067</td>\n",
              "      <td>0.034109</td>\n",
              "      <td>-0.002628</td>\n",
              "      <td>0.017763</td>\n",
              "      <td>0.024139</td>\n",
              "      <td>0.016409</td>\n",
              "      <td>0.048057</td>\n",
              "      <td>0.011653</td>\n",
              "      <td>0.006897</td>\n",
              "      <td>0.024027</td>\n",
              "      <td>-0.006696</td>\n",
              "      <td>0.030103</td>\n",
              "      <td>0.033879</td>\n",
              "      <td>0.027586</td>\n",
              "      <td>0.027599</td>\n",
              "      <td>0.017306</td>\n",
              "      <td>0.023713</td>\n",
              "      <td>0.019577</td>\n",
              "      <td>-0.001229</td>\n",
              "      <td>0.020809</td>\n",
              "      <td>0.021363</td>\n",
              "      <td>0.036878</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2009-08-24</th>\n",
              "      <td>-0.001767</td>\n",
              "      <td>0.013378</td>\n",
              "      <td>-0.014031</td>\n",
              "      <td>-0.000944</td>\n",
              "      <td>-0.011526</td>\n",
              "      <td>0.069939</td>\n",
              "      <td>0.015303</td>\n",
              "      <td>0.002479</td>\n",
              "      <td>-0.003350</td>\n",
              "      <td>-0.006422</td>\n",
              "      <td>-0.009808</td>\n",
              "      <td>0.003772</td>\n",
              "      <td>0.015452</td>\n",
              "      <td>-0.019992</td>\n",
              "      <td>0.005663</td>\n",
              "      <td>0.001431</td>\n",
              "      <td>0.011394</td>\n",
              "      <td>-0.015801</td>\n",
              "      <td>-0.001200</td>\n",
              "      <td>0.030303</td>\n",
              "      <td>0.015660</td>\n",
              "      <td>0.008824</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-0.019544</td>\n",
              "      <td>0.008321</td>\n",
              "      <td>0.021788</td>\n",
              "      <td>0.007619</td>\n",
              "      <td>0.001741</td>\n",
              "      <td>0.004900</td>\n",
              "      <td>-0.019608</td>\n",
              "      <td>0.081081</td>\n",
              "      <td>-0.000752</td>\n",
              "      <td>-0.030318</td>\n",
              "      <td>-0.004170</td>\n",
              "      <td>-0.005495</td>\n",
              "      <td>-0.010059</td>\n",
              "      <td>-0.005882</td>\n",
              "      <td>0.006962</td>\n",
              "      <td>0.002309</td>\n",
              "      <td>0.007857</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.007752</td>\n",
              "      <td>-0.011780</td>\n",
              "      <td>-0.001995</td>\n",
              "      <td>0.033105</td>\n",
              "      <td>-0.025042</td>\n",
              "      <td>0.010066</td>\n",
              "      <td>-0.014820</td>\n",
              "      <td>0.015380</td>\n",
              "      <td>-0.015276</td>\n",
              "      <td>0.002506</td>\n",
              "      <td>0.022639</td>\n",
              "      <td>-0.014780</td>\n",
              "      <td>-0.009561</td>\n",
              "      <td>-0.009419</td>\n",
              "      <td>-0.009365</td>\n",
              "      <td>0.001105</td>\n",
              "      <td>-0.002305</td>\n",
              "      <td>-0.006178</td>\n",
              "      <td>-0.007051</td>\n",
              "      <td>0.017074</td>\n",
              "      <td>-0.013549</td>\n",
              "      <td>-0.005171</td>\n",
              "      <td>-0.012365</td>\n",
              "      <td>-0.022140</td>\n",
              "      <td>-0.001595</td>\n",
              "      <td>0.017278</td>\n",
              "      <td>0.005936</td>\n",
              "      <td>0.002235</td>\n",
              "      <td>0.003745</td>\n",
              "      <td>-0.002851</td>\n",
              "      <td>-0.018778</td>\n",
              "      <td>-0.025555</td>\n",
              "      <td>-0.001825</td>\n",
              "      <td>0.002219</td>\n",
              "      <td>-0.003955</td>\n",
              "      <td>0.019589</td>\n",
              "      <td>0.001846</td>\n",
              "      <td>0.012813</td>\n",
              "      <td>-0.024402</td>\n",
              "      <td>-0.035566</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2009-08-25</th>\n",
              "      <td>-0.006490</td>\n",
              "      <td>0.082508</td>\n",
              "      <td>0.010130</td>\n",
              "      <td>0.001890</td>\n",
              "      <td>0.006108</td>\n",
              "      <td>0.012615</td>\n",
              "      <td>-0.003478</td>\n",
              "      <td>-0.025786</td>\n",
              "      <td>-0.001833</td>\n",
              "      <td>0.012004</td>\n",
              "      <td>-0.022963</td>\n",
              "      <td>-0.005637</td>\n",
              "      <td>-0.019155</td>\n",
              "      <td>0.010824</td>\n",
              "      <td>0.003378</td>\n",
              "      <td>-0.009048</td>\n",
              "      <td>-0.028596</td>\n",
              "      <td>0.012997</td>\n",
              "      <td>-0.002704</td>\n",
              "      <td>0.003577</td>\n",
              "      <td>0.013216</td>\n",
              "      <td>0.008330</td>\n",
              "      <td>0.002976</td>\n",
              "      <td>-0.012182</td>\n",
              "      <td>-0.001794</td>\n",
              "      <td>0.011765</td>\n",
              "      <td>0.134216</td>\n",
              "      <td>0.009561</td>\n",
              "      <td>-0.009309</td>\n",
              "      <td>-0.016364</td>\n",
              "      <td>0.005000</td>\n",
              "      <td>0.001506</td>\n",
              "      <td>0.012903</td>\n",
              "      <td>-0.000399</td>\n",
              "      <td>0.023799</td>\n",
              "      <td>-0.008059</td>\n",
              "      <td>-0.003669</td>\n",
              "      <td>-0.003042</td>\n",
              "      <td>0.012984</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>...</td>\n",
              "      <td>0.036272</td>\n",
              "      <td>-0.004415</td>\n",
              "      <td>0.015988</td>\n",
              "      <td>0.028729</td>\n",
              "      <td>0.009132</td>\n",
              "      <td>0.006785</td>\n",
              "      <td>0.015043</td>\n",
              "      <td>0.014306</td>\n",
              "      <td>0.013126</td>\n",
              "      <td>0.010000</td>\n",
              "      <td>-0.000763</td>\n",
              "      <td>0.026345</td>\n",
              "      <td>-0.008518</td>\n",
              "      <td>-0.001902</td>\n",
              "      <td>0.009804</td>\n",
              "      <td>-0.002759</td>\n",
              "      <td>0.003466</td>\n",
              "      <td>0.014569</td>\n",
              "      <td>0.036292</td>\n",
              "      <td>-0.016787</td>\n",
              "      <td>0.020984</td>\n",
              "      <td>0.003249</td>\n",
              "      <td>-0.001565</td>\n",
              "      <td>0.000472</td>\n",
              "      <td>-0.011382</td>\n",
              "      <td>-0.001941</td>\n",
              "      <td>-0.006809</td>\n",
              "      <td>-0.003344</td>\n",
              "      <td>0.002239</td>\n",
              "      <td>-0.002144</td>\n",
              "      <td>0.003752</td>\n",
              "      <td>0.045563</td>\n",
              "      <td>-0.025078</td>\n",
              "      <td>-0.003690</td>\n",
              "      <td>-0.006807</td>\n",
              "      <td>-0.008560</td>\n",
              "      <td>0.006450</td>\n",
              "      <td>0.018976</td>\n",
              "      <td>0.000510</td>\n",
              "      <td>-0.000615</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2009-08-26</th>\n",
              "      <td>0.005344</td>\n",
              "      <td>0.088415</td>\n",
              "      <td>-0.006686</td>\n",
              "      <td>-0.011792</td>\n",
              "      <td>-0.001656</td>\n",
              "      <td>0.003398</td>\n",
              "      <td>0.003490</td>\n",
              "      <td>0.012328</td>\n",
              "      <td>-0.004897</td>\n",
              "      <td>0.009124</td>\n",
              "      <td>0.005530</td>\n",
              "      <td>-0.009448</td>\n",
              "      <td>-0.002008</td>\n",
              "      <td>-0.003707</td>\n",
              "      <td>0.006173</td>\n",
              "      <td>0.006728</td>\n",
              "      <td>0.016057</td>\n",
              "      <td>-0.008302</td>\n",
              "      <td>-0.000602</td>\n",
              "      <td>0.109703</td>\n",
              "      <td>0.013043</td>\n",
              "      <td>0.005783</td>\n",
              "      <td>-0.005935</td>\n",
              "      <td>0.014574</td>\n",
              "      <td>-0.000719</td>\n",
              "      <td>0.001453</td>\n",
              "      <td>0.006667</td>\n",
              "      <td>0.005166</td>\n",
              "      <td>0.006264</td>\n",
              "      <td>0.004621</td>\n",
              "      <td>0.009950</td>\n",
              "      <td>-0.008271</td>\n",
              "      <td>0.040666</td>\n",
              "      <td>0.014562</td>\n",
              "      <td>-0.017850</td>\n",
              "      <td>-0.002473</td>\n",
              "      <td>-0.002257</td>\n",
              "      <td>0.004993</td>\n",
              "      <td>-0.013645</td>\n",
              "      <td>-0.010753</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.006462</td>\n",
              "      <td>-0.009756</td>\n",
              "      <td>-0.006639</td>\n",
              "      <td>0.001074</td>\n",
              "      <td>0.008484</td>\n",
              "      <td>0.001053</td>\n",
              "      <td>0.017643</td>\n",
              "      <td>-0.014381</td>\n",
              "      <td>0.030624</td>\n",
              "      <td>0.005941</td>\n",
              "      <td>0.006112</td>\n",
              "      <td>0.018182</td>\n",
              "      <td>0.021191</td>\n",
              "      <td>0.000544</td>\n",
              "      <td>-0.012483</td>\n",
              "      <td>0.004981</td>\n",
              "      <td>0.021301</td>\n",
              "      <td>-0.001149</td>\n",
              "      <td>0.026646</td>\n",
              "      <td>-0.005045</td>\n",
              "      <td>0.030269</td>\n",
              "      <td>0.009715</td>\n",
              "      <td>-0.003918</td>\n",
              "      <td>0.010372</td>\n",
              "      <td>-0.009695</td>\n",
              "      <td>-0.012480</td>\n",
              "      <td>0.005484</td>\n",
              "      <td>0.003356</td>\n",
              "      <td>0.002482</td>\n",
              "      <td>0.005731</td>\n",
              "      <td>0.008972</td>\n",
              "      <td>-0.014188</td>\n",
              "      <td>0.008574</td>\n",
              "      <td>0.005926</td>\n",
              "      <td>0.001142</td>\n",
              "      <td>0.009593</td>\n",
              "      <td>-0.010681</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-0.004082</td>\n",
              "      <td>-0.007995</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2009-08-27</th>\n",
              "      <td>0.002363</td>\n",
              "      <td>-0.030812</td>\n",
              "      <td>0.008654</td>\n",
              "      <td>0.012411</td>\n",
              "      <td>0.012161</td>\n",
              "      <td>-0.011287</td>\n",
              "      <td>0.011594</td>\n",
              "      <td>0.001433</td>\n",
              "      <td>-0.001538</td>\n",
              "      <td>-0.001356</td>\n",
              "      <td>0.011457</td>\n",
              "      <td>-0.000382</td>\n",
              "      <td>0.013168</td>\n",
              "      <td>0.002894</td>\n",
              "      <td>0.002789</td>\n",
              "      <td>0.005728</td>\n",
              "      <td>-0.022827</td>\n",
              "      <td>-0.009893</td>\n",
              "      <td>-0.001808</td>\n",
              "      <td>0.269094</td>\n",
              "      <td>0.007511</td>\n",
              "      <td>-0.008624</td>\n",
              "      <td>-0.001194</td>\n",
              "      <td>-0.003867</td>\n",
              "      <td>-0.003957</td>\n",
              "      <td>-0.002177</td>\n",
              "      <td>-0.031457</td>\n",
              "      <td>0.009422</td>\n",
              "      <td>-0.007114</td>\n",
              "      <td>-0.001840</td>\n",
              "      <td>0.041872</td>\n",
              "      <td>-0.006823</td>\n",
              "      <td>0.001255</td>\n",
              "      <td>-0.016123</td>\n",
              "      <td>0.008030</td>\n",
              "      <td>-0.006374</td>\n",
              "      <td>0.003690</td>\n",
              "      <td>0.002484</td>\n",
              "      <td>0.004402</td>\n",
              "      <td>-0.001359</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.006504</td>\n",
              "      <td>0.012091</td>\n",
              "      <td>-0.000990</td>\n",
              "      <td>-0.005365</td>\n",
              "      <td>0.006169</td>\n",
              "      <td>0.003997</td>\n",
              "      <td>-0.006935</td>\n",
              "      <td>0.004770</td>\n",
              "      <td>0.002286</td>\n",
              "      <td>-0.005906</td>\n",
              "      <td>0.001519</td>\n",
              "      <td>-0.008053</td>\n",
              "      <td>0.005048</td>\n",
              "      <td>0.016594</td>\n",
              "      <td>0.014747</td>\n",
              "      <td>-0.013216</td>\n",
              "      <td>0.026494</td>\n",
              "      <td>-0.008434</td>\n",
              "      <td>0.007045</td>\n",
              "      <td>0.005460</td>\n",
              "      <td>0.021400</td>\n",
              "      <td>0.000641</td>\n",
              "      <td>0.013769</td>\n",
              "      <td>0.004666</td>\n",
              "      <td>0.037324</td>\n",
              "      <td>-0.007221</td>\n",
              "      <td>-0.005000</td>\n",
              "      <td>-0.012263</td>\n",
              "      <td>-0.010646</td>\n",
              "      <td>0.015670</td>\n",
              "      <td>0.014820</td>\n",
              "      <td>-0.014649</td>\n",
              "      <td>0.005313</td>\n",
              "      <td>-0.001473</td>\n",
              "      <td>-0.003993</td>\n",
              "      <td>-0.007032</td>\n",
              "      <td>-0.005861</td>\n",
              "      <td>0.013544</td>\n",
              "      <td>-0.003586</td>\n",
              "      <td>0.001240</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2009-08-28</th>\n",
              "      <td>0.011786</td>\n",
              "      <td>-0.020231</td>\n",
              "      <td>0.000715</td>\n",
              "      <td>0.003300</td>\n",
              "      <td>0.002185</td>\n",
              "      <td>-0.038813</td>\n",
              "      <td>-0.014900</td>\n",
              "      <td>-0.026109</td>\n",
              "      <td>-0.022489</td>\n",
              "      <td>0.003169</td>\n",
              "      <td>0.014499</td>\n",
              "      <td>-0.001145</td>\n",
              "      <td>-0.001805</td>\n",
              "      <td>-0.014015</td>\n",
              "      <td>0.001112</td>\n",
              "      <td>0.006645</td>\n",
              "      <td>0.000898</td>\n",
              "      <td>-0.006918</td>\n",
              "      <td>0.009360</td>\n",
              "      <td>0.050056</td>\n",
              "      <td>0.001065</td>\n",
              "      <td>0.009942</td>\n",
              "      <td>-0.009564</td>\n",
              "      <td>0.004437</td>\n",
              "      <td>0.006501</td>\n",
              "      <td>-0.018182</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.002970</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-0.001843</td>\n",
              "      <td>0.056738</td>\n",
              "      <td>0.000763</td>\n",
              "      <td>0.006897</td>\n",
              "      <td>-0.010592</td>\n",
              "      <td>0.004612</td>\n",
              "      <td>-0.003920</td>\n",
              "      <td>-0.018385</td>\n",
              "      <td>0.001377</td>\n",
              "      <td>-0.022538</td>\n",
              "      <td>0.013878</td>\n",
              "      <td>...</td>\n",
              "      <td>0.007092</td>\n",
              "      <td>0.001327</td>\n",
              "      <td>-0.004460</td>\n",
              "      <td>0.005394</td>\n",
              "      <td>0.008361</td>\n",
              "      <td>-0.006077</td>\n",
              "      <td>0.011173</td>\n",
              "      <td>-0.000279</td>\n",
              "      <td>0.027366</td>\n",
              "      <td>0.003465</td>\n",
              "      <td>-0.001516</td>\n",
              "      <td>-0.006354</td>\n",
              "      <td>0.016741</td>\n",
              "      <td>-0.000803</td>\n",
              "      <td>0.013841</td>\n",
              "      <td>-0.001116</td>\n",
              "      <td>0.001647</td>\n",
              "      <td>-0.014885</td>\n",
              "      <td>0.001105</td>\n",
              "      <td>-0.026765</td>\n",
              "      <td>-0.013494</td>\n",
              "      <td>-0.007692</td>\n",
              "      <td>0.005821</td>\n",
              "      <td>-0.015792</td>\n",
              "      <td>0.024381</td>\n",
              "      <td>0.000331</td>\n",
              "      <td>-0.013705</td>\n",
              "      <td>-0.015801</td>\n",
              "      <td>-0.002252</td>\n",
              "      <td>-0.006311</td>\n",
              "      <td>0.012413</td>\n",
              "      <td>-0.001565</td>\n",
              "      <td>0.004493</td>\n",
              "      <td>-0.001475</td>\n",
              "      <td>0.025773</td>\n",
              "      <td>-0.010526</td>\n",
              "      <td>-0.013962</td>\n",
              "      <td>0.005568</td>\n",
              "      <td>0.000514</td>\n",
              "      <td>0.039009</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2009-08-31</th>\n",
              "      <td>-0.005824</td>\n",
              "      <td>-0.047198</td>\n",
              "      <td>-0.019052</td>\n",
              "      <td>-0.010808</td>\n",
              "      <td>0.005450</td>\n",
              "      <td>-0.016627</td>\n",
              "      <td>-0.015125</td>\n",
              "      <td>-0.034888</td>\n",
              "      <td>-0.009770</td>\n",
              "      <td>-0.015343</td>\n",
              "      <td>0.007146</td>\n",
              "      <td>-0.005732</td>\n",
              "      <td>-0.024593</td>\n",
              "      <td>-0.020485</td>\n",
              "      <td>-0.021667</td>\n",
              "      <td>-0.013201</td>\n",
              "      <td>-0.017953</td>\n",
              "      <td>-0.002322</td>\n",
              "      <td>-0.001496</td>\n",
              "      <td>-0.097483</td>\n",
              "      <td>-0.030851</td>\n",
              "      <td>0.005332</td>\n",
              "      <td>0.006639</td>\n",
              "      <td>-0.025953</td>\n",
              "      <td>-0.005741</td>\n",
              "      <td>-0.007407</td>\n",
              "      <td>-0.022222</td>\n",
              "      <td>0.004230</td>\n",
              "      <td>0.010748</td>\n",
              "      <td>-0.006464</td>\n",
              "      <td>-0.024609</td>\n",
              "      <td>0.001526</td>\n",
              "      <td>-0.006382</td>\n",
              "      <td>0.002828</td>\n",
              "      <td>-0.005426</td>\n",
              "      <td>-0.014311</td>\n",
              "      <td>-0.018971</td>\n",
              "      <td>-0.033819</td>\n",
              "      <td>-0.016225</td>\n",
              "      <td>-0.007246</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.005417</td>\n",
              "      <td>-0.013699</td>\n",
              "      <td>-0.004729</td>\n",
              "      <td>-0.013948</td>\n",
              "      <td>0.008292</td>\n",
              "      <td>-0.004849</td>\n",
              "      <td>0.008287</td>\n",
              "      <td>0.055028</td>\n",
              "      <td>-0.021088</td>\n",
              "      <td>-0.005427</td>\n",
              "      <td>-0.013667</td>\n",
              "      <td>-0.002487</td>\n",
              "      <td>-0.012623</td>\n",
              "      <td>0.001875</td>\n",
              "      <td>-0.010922</td>\n",
              "      <td>0.000559</td>\n",
              "      <td>-0.014254</td>\n",
              "      <td>-0.013344</td>\n",
              "      <td>0.005885</td>\n",
              "      <td>-0.032682</td>\n",
              "      <td>-0.001800</td>\n",
              "      <td>-0.009044</td>\n",
              "      <td>-0.008488</td>\n",
              "      <td>0.008023</td>\n",
              "      <td>-0.028791</td>\n",
              "      <td>-0.004958</td>\n",
              "      <td>0.009727</td>\n",
              "      <td>-0.020642</td>\n",
              "      <td>-0.005016</td>\n",
              "      <td>-0.038814</td>\n",
              "      <td>-0.010819</td>\n",
              "      <td>-0.038140</td>\n",
              "      <td>-0.026835</td>\n",
              "      <td>-0.007386</td>\n",
              "      <td>-0.018425</td>\n",
              "      <td>-0.013733</td>\n",
              "      <td>-0.001888</td>\n",
              "      <td>-0.026578</td>\n",
              "      <td>-0.019013</td>\n",
              "      <td>-0.024434</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2009-09-01</th>\n",
              "      <td>0.006444</td>\n",
              "      <td>-0.117647</td>\n",
              "      <td>-0.017966</td>\n",
              "      <td>-0.017102</td>\n",
              "      <td>-0.005420</td>\n",
              "      <td>-0.037440</td>\n",
              "      <td>-0.002363</td>\n",
              "      <td>0.006088</td>\n",
              "      <td>-0.010185</td>\n",
              "      <td>-0.017415</td>\n",
              "      <td>-0.027938</td>\n",
              "      <td>-0.014604</td>\n",
              "      <td>-0.043567</td>\n",
              "      <td>-0.031157</td>\n",
              "      <td>0.000568</td>\n",
              "      <td>-0.011467</td>\n",
              "      <td>-0.030165</td>\n",
              "      <td>-0.060512</td>\n",
              "      <td>-0.009886</td>\n",
              "      <td>-0.205935</td>\n",
              "      <td>-0.052689</td>\n",
              "      <td>-0.057936</td>\n",
              "      <td>-0.012590</td>\n",
              "      <td>-0.045351</td>\n",
              "      <td>-0.040780</td>\n",
              "      <td>-0.036567</td>\n",
              "      <td>-0.083916</td>\n",
              "      <td>-0.041281</td>\n",
              "      <td>-0.010634</td>\n",
              "      <td>-0.018587</td>\n",
              "      <td>-0.032110</td>\n",
              "      <td>-0.010663</td>\n",
              "      <td>-0.055303</td>\n",
              "      <td>-0.013494</td>\n",
              "      <td>-0.059169</td>\n",
              "      <td>-0.017786</td>\n",
              "      <td>-0.025003</td>\n",
              "      <td>-0.015652</td>\n",
              "      <td>-0.024957</td>\n",
              "      <td>-0.013517</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.067538</td>\n",
              "      <td>-0.008513</td>\n",
              "      <td>-0.016504</td>\n",
              "      <td>-0.003264</td>\n",
              "      <td>-0.060855</td>\n",
              "      <td>-0.005085</td>\n",
              "      <td>-0.013014</td>\n",
              "      <td>-0.027270</td>\n",
              "      <td>-0.018141</td>\n",
              "      <td>-0.032242</td>\n",
              "      <td>-0.027714</td>\n",
              "      <td>-0.045228</td>\n",
              "      <td>-0.017232</td>\n",
              "      <td>-0.014435</td>\n",
              "      <td>-0.074189</td>\n",
              "      <td>-0.021776</td>\n",
              "      <td>-0.023915</td>\n",
              "      <td>0.000994</td>\n",
              "      <td>0.004753</td>\n",
              "      <td>-0.044499</td>\n",
              "      <td>-0.032095</td>\n",
              "      <td>-0.008475</td>\n",
              "      <td>-0.061479</td>\n",
              "      <td>-0.047753</td>\n",
              "      <td>-0.031028</td>\n",
              "      <td>-0.010131</td>\n",
              "      <td>-0.002294</td>\n",
              "      <td>-0.021077</td>\n",
              "      <td>0.002017</td>\n",
              "      <td>-0.018355</td>\n",
              "      <td>-0.041196</td>\n",
              "      <td>-0.030961</td>\n",
              "      <td>-0.029197</td>\n",
              "      <td>-0.003720</td>\n",
              "      <td>-0.026166</td>\n",
              "      <td>-0.010786</td>\n",
              "      <td>-0.021122</td>\n",
              "      <td>-0.022184</td>\n",
              "      <td>-0.015715</td>\n",
              "      <td>-0.070250</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2009-09-02</th>\n",
              "      <td>-0.024447</td>\n",
              "      <td>0.042105</td>\n",
              "      <td>-0.000989</td>\n",
              "      <td>-0.000967</td>\n",
              "      <td>-0.008719</td>\n",
              "      <td>-0.003764</td>\n",
              "      <td>-0.002368</td>\n",
              "      <td>0.003782</td>\n",
              "      <td>-0.003215</td>\n",
              "      <td>-0.006996</td>\n",
              "      <td>-0.016423</td>\n",
              "      <td>-0.003120</td>\n",
              "      <td>0.011436</td>\n",
              "      <td>0.002643</td>\n",
              "      <td>-0.014188</td>\n",
              "      <td>-0.009183</td>\n",
              "      <td>-0.004713</td>\n",
              "      <td>0.014038</td>\n",
              "      <td>-0.010590</td>\n",
              "      <td>0.054185</td>\n",
              "      <td>-0.015064</td>\n",
              "      <td>-0.003465</td>\n",
              "      <td>-0.003036</td>\n",
              "      <td>0.016627</td>\n",
              "      <td>0.015425</td>\n",
              "      <td>0.012393</td>\n",
              "      <td>-0.001908</td>\n",
              "      <td>-0.003954</td>\n",
              "      <td>-0.011196</td>\n",
              "      <td>0.002841</td>\n",
              "      <td>0.014218</td>\n",
              "      <td>0.006159</td>\n",
              "      <td>0.000829</td>\n",
              "      <td>0.002042</td>\n",
              "      <td>-0.008475</td>\n",
              "      <td>-0.003695</td>\n",
              "      <td>-0.012885</td>\n",
              "      <td>0.005204</td>\n",
              "      <td>0.035611</td>\n",
              "      <td>0.000548</td>\n",
              "      <td>...</td>\n",
              "      <td>0.000584</td>\n",
              "      <td>-0.009941</td>\n",
              "      <td>0.003305</td>\n",
              "      <td>0.005459</td>\n",
              "      <td>-0.027437</td>\n",
              "      <td>-0.003407</td>\n",
              "      <td>-0.000694</td>\n",
              "      <td>-0.005444</td>\n",
              "      <td>0.006928</td>\n",
              "      <td>-0.006151</td>\n",
              "      <td>-0.015835</td>\n",
              "      <td>-0.011190</td>\n",
              "      <td>-0.009615</td>\n",
              "      <td>-0.027665</td>\n",
              "      <td>-0.002609</td>\n",
              "      <td>-0.007420</td>\n",
              "      <td>0.005698</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-0.006914</td>\n",
              "      <td>0.018542</td>\n",
              "      <td>-0.015276</td>\n",
              "      <td>-0.005917</td>\n",
              "      <td>-0.002073</td>\n",
              "      <td>-0.004425</td>\n",
              "      <td>-0.017744</td>\n",
              "      <td>-0.005537</td>\n",
              "      <td>-0.012414</td>\n",
              "      <td>0.003589</td>\n",
              "      <td>-0.001006</td>\n",
              "      <td>0.006731</td>\n",
              "      <td>0.006084</td>\n",
              "      <td>0.004484</td>\n",
              "      <td>-0.023392</td>\n",
              "      <td>-0.008215</td>\n",
              "      <td>-0.014603</td>\n",
              "      <td>-0.003370</td>\n",
              "      <td>-0.003543</td>\n",
              "      <td>-0.013962</td>\n",
              "      <td>-0.010644</td>\n",
              "      <td>-0.009198</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2009-09-03</th>\n",
              "      <td>0.002983</td>\n",
              "      <td>0.040404</td>\n",
              "      <td>0.002970</td>\n",
              "      <td>0.008224</td>\n",
              "      <td>0.006047</td>\n",
              "      <td>-0.013854</td>\n",
              "      <td>0.001187</td>\n",
              "      <td>0.032404</td>\n",
              "      <td>0.015806</td>\n",
              "      <td>0.021606</td>\n",
              "      <td>0.016698</td>\n",
              "      <td>0.003912</td>\n",
              "      <td>0.013798</td>\n",
              "      <td>-0.008787</td>\n",
              "      <td>0.009211</td>\n",
              "      <td>0.000488</td>\n",
              "      <td>0.006629</td>\n",
              "      <td>0.004886</td>\n",
              "      <td>-0.003058</td>\n",
              "      <td>0.100319</td>\n",
              "      <td>0.025882</td>\n",
              "      <td>0.003911</td>\n",
              "      <td>0.001827</td>\n",
              "      <td>0.011098</td>\n",
              "      <td>0.014079</td>\n",
              "      <td>-0.001530</td>\n",
              "      <td>0.022945</td>\n",
              "      <td>0.014998</td>\n",
              "      <td>0.008152</td>\n",
              "      <td>0.013220</td>\n",
              "      <td>0.058411</td>\n",
              "      <td>0.001530</td>\n",
              "      <td>0.029826</td>\n",
              "      <td>-0.010595</td>\n",
              "      <td>0.031939</td>\n",
              "      <td>0.032641</td>\n",
              "      <td>0.004095</td>\n",
              "      <td>0.004602</td>\n",
              "      <td>0.003439</td>\n",
              "      <td>0.006847</td>\n",
              "      <td>...</td>\n",
              "      <td>0.029189</td>\n",
              "      <td>0.022821</td>\n",
              "      <td>0.001521</td>\n",
              "      <td>0.007600</td>\n",
              "      <td>0.013806</td>\n",
              "      <td>0.013462</td>\n",
              "      <td>0.011111</td>\n",
              "      <td>0.010947</td>\n",
              "      <td>0.038991</td>\n",
              "      <td>0.008252</td>\n",
              "      <td>0.010459</td>\n",
              "      <td>-0.000754</td>\n",
              "      <td>0.003998</td>\n",
              "      <td>0.002789</td>\n",
              "      <td>0.011211</td>\n",
              "      <td>0.003450</td>\n",
              "      <td>0.012465</td>\n",
              "      <td>0.000199</td>\n",
              "      <td>-0.007695</td>\n",
              "      <td>0.011854</td>\n",
              "      <td>0.012864</td>\n",
              "      <td>-0.000661</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.031111</td>\n",
              "      <td>0.018065</td>\n",
              "      <td>0.013835</td>\n",
              "      <td>0.019553</td>\n",
              "      <td>0.014303</td>\n",
              "      <td>0.016117</td>\n",
              "      <td>0.023774</td>\n",
              "      <td>0.018896</td>\n",
              "      <td>0.013951</td>\n",
              "      <td>-0.002281</td>\n",
              "      <td>0.005271</td>\n",
              "      <td>0.005335</td>\n",
              "      <td>0.001194</td>\n",
              "      <td>0.003878</td>\n",
              "      <td>0.010619</td>\n",
              "      <td>0.006455</td>\n",
              "      <td>0.006631</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2009-09-04</th>\n",
              "      <td>0.022606</td>\n",
              "      <td>0.038835</td>\n",
              "      <td>-0.010116</td>\n",
              "      <td>0.022553</td>\n",
              "      <td>0.007104</td>\n",
              "      <td>0.001277</td>\n",
              "      <td>0.012448</td>\n",
              "      <td>0.008029</td>\n",
              "      <td>0.017783</td>\n",
              "      <td>0.022989</td>\n",
              "      <td>0.031478</td>\n",
              "      <td>0.019875</td>\n",
              "      <td>0.022306</td>\n",
              "      <td>0.024823</td>\n",
              "      <td>0.001711</td>\n",
              "      <td>0.005851</td>\n",
              "      <td>0.016933</td>\n",
              "      <td>-0.017018</td>\n",
              "      <td>0.009816</td>\n",
              "      <td>-0.040915</td>\n",
              "      <td>-0.002294</td>\n",
              "      <td>0.008658</td>\n",
              "      <td>0.008511</td>\n",
              "      <td>0.009243</td>\n",
              "      <td>0.015345</td>\n",
              "      <td>0.002299</td>\n",
              "      <td>0.041121</td>\n",
              "      <td>0.012603</td>\n",
              "      <td>0.032345</td>\n",
              "      <td>0.023299</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.013751</td>\n",
              "      <td>0.026227</td>\n",
              "      <td>0.008237</td>\n",
              "      <td>0.003051</td>\n",
              "      <td>0.043463</td>\n",
              "      <td>0.005226</td>\n",
              "      <td>0.021472</td>\n",
              "      <td>0.011566</td>\n",
              "      <td>0.009521</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.005105</td>\n",
              "      <td>0.033467</td>\n",
              "      <td>0.018472</td>\n",
              "      <td>0.004310</td>\n",
              "      <td>0.024275</td>\n",
              "      <td>0.014759</td>\n",
              "      <td>-0.007555</td>\n",
              "      <td>0.018408</td>\n",
              "      <td>0.006623</td>\n",
              "      <td>0.036317</td>\n",
              "      <td>0.012739</td>\n",
              "      <td>0.014345</td>\n",
              "      <td>0.011945</td>\n",
              "      <td>0.010292</td>\n",
              "      <td>0.011086</td>\n",
              "      <td>0.012034</td>\n",
              "      <td>0.015109</td>\n",
              "      <td>0.008343</td>\n",
              "      <td>0.008863</td>\n",
              "      <td>0.015481</td>\n",
              "      <td>0.025402</td>\n",
              "      <td>0.001324</td>\n",
              "      <td>0.003739</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.029574</td>\n",
              "      <td>0.015976</td>\n",
              "      <td>0.010502</td>\n",
              "      <td>0.022327</td>\n",
              "      <td>-0.001239</td>\n",
              "      <td>-0.003628</td>\n",
              "      <td>0.009273</td>\n",
              "      <td>0.058613</td>\n",
              "      <td>0.017434</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.035377</td>\n",
              "      <td>0.013511</td>\n",
              "      <td>0.013522</td>\n",
              "      <td>0.025102</td>\n",
              "      <td>0.013896</td>\n",
              "      <td>0.021080</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2009-09-08</th>\n",
              "      <td>0.020942</td>\n",
              "      <td>0.012461</td>\n",
              "      <td>0.007228</td>\n",
              "      <td>0.015486</td>\n",
              "      <td>-0.005426</td>\n",
              "      <td>-0.003827</td>\n",
              "      <td>0.006440</td>\n",
              "      <td>-0.005431</td>\n",
              "      <td>0.014353</td>\n",
              "      <td>0.017079</td>\n",
              "      <td>-0.005750</td>\n",
              "      <td>0.004585</td>\n",
              "      <td>0.004623</td>\n",
              "      <td>-0.013408</td>\n",
              "      <td>-0.006834</td>\n",
              "      <td>-0.003878</td>\n",
              "      <td>0.021277</td>\n",
              "      <td>0.028030</td>\n",
              "      <td>-0.000304</td>\n",
              "      <td>-0.104803</td>\n",
              "      <td>0.058621</td>\n",
              "      <td>0.021459</td>\n",
              "      <td>-0.004822</td>\n",
              "      <td>-0.008586</td>\n",
              "      <td>0.031666</td>\n",
              "      <td>0.006116</td>\n",
              "      <td>0.007181</td>\n",
              "      <td>-0.000429</td>\n",
              "      <td>0.001741</td>\n",
              "      <td>0.017304</td>\n",
              "      <td>0.145695</td>\n",
              "      <td>0.018086</td>\n",
              "      <td>0.026654</td>\n",
              "      <td>0.003472</td>\n",
              "      <td>0.019557</td>\n",
              "      <td>0.027194</td>\n",
              "      <td>0.025739</td>\n",
              "      <td>0.002803</td>\n",
              "      <td>-0.042981</td>\n",
              "      <td>0.001078</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.000570</td>\n",
              "      <td>-0.006045</td>\n",
              "      <td>0.005466</td>\n",
              "      <td>0.049356</td>\n",
              "      <td>-0.021387</td>\n",
              "      <td>-0.002493</td>\n",
              "      <td>0.008304</td>\n",
              "      <td>-0.002924</td>\n",
              "      <td>0.003289</td>\n",
              "      <td>0.002468</td>\n",
              "      <td>0.021226</td>\n",
              "      <td>0.043171</td>\n",
              "      <td>0.014053</td>\n",
              "      <td>0.010738</td>\n",
              "      <td>0.029240</td>\n",
              "      <td>0.011325</td>\n",
              "      <td>0.025910</td>\n",
              "      <td>0.021868</td>\n",
              "      <td>0.004026</td>\n",
              "      <td>-0.002472</td>\n",
              "      <td>0.030965</td>\n",
              "      <td>0.005948</td>\n",
              "      <td>0.015315</td>\n",
              "      <td>0.002874</td>\n",
              "      <td>0.004160</td>\n",
              "      <td>0.011466</td>\n",
              "      <td>0.007682</td>\n",
              "      <td>0.032184</td>\n",
              "      <td>-0.005459</td>\n",
              "      <td>0.000728</td>\n",
              "      <td>-0.012128</td>\n",
              "      <td>0.015337</td>\n",
              "      <td>0.032865</td>\n",
              "      <td>-0.003745</td>\n",
              "      <td>0.042711</td>\n",
              "      <td>0.021172</td>\n",
              "      <td>0.000953</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.004744</td>\n",
              "      <td>-0.040000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2009-09-09</th>\n",
              "      <td>0.027920</td>\n",
              "      <td>0.046154</td>\n",
              "      <td>0.001237</td>\n",
              "      <td>-0.010166</td>\n",
              "      <td>0.012002</td>\n",
              "      <td>0.039693</td>\n",
              "      <td>0.009889</td>\n",
              "      <td>0.007281</td>\n",
              "      <td>0.008920</td>\n",
              "      <td>-0.000442</td>\n",
              "      <td>-0.001335</td>\n",
              "      <td>0.000761</td>\n",
              "      <td>0.050617</td>\n",
              "      <td>0.004384</td>\n",
              "      <td>-0.008601</td>\n",
              "      <td>0.000973</td>\n",
              "      <td>0.022645</td>\n",
              "      <td>0.016038</td>\n",
              "      <td>0.039806</td>\n",
              "      <td>0.084803</td>\n",
              "      <td>0.030402</td>\n",
              "      <td>0.005042</td>\n",
              "      <td>0.012114</td>\n",
              "      <td>0.027136</td>\n",
              "      <td>0.026509</td>\n",
              "      <td>0.013678</td>\n",
              "      <td>0.035651</td>\n",
              "      <td>-0.001717</td>\n",
              "      <td>-0.013901</td>\n",
              "      <td>0.016115</td>\n",
              "      <td>0.001927</td>\n",
              "      <td>0.031828</td>\n",
              "      <td>0.012065</td>\n",
              "      <td>0.000407</td>\n",
              "      <td>0.017903</td>\n",
              "      <td>-0.000335</td>\n",
              "      <td>0.016564</td>\n",
              "      <td>0.011738</td>\n",
              "      <td>0.019248</td>\n",
              "      <td>0.021803</td>\n",
              "      <td>...</td>\n",
              "      <td>0.017684</td>\n",
              "      <td>0.009123</td>\n",
              "      <td>0.024463</td>\n",
              "      <td>0.034765</td>\n",
              "      <td>0.036031</td>\n",
              "      <td>0.014372</td>\n",
              "      <td>-0.006177</td>\n",
              "      <td>0.018928</td>\n",
              "      <td>0.010929</td>\n",
              "      <td>0.017725</td>\n",
              "      <td>-0.017706</td>\n",
              "      <td>0.032108</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.005721</td>\n",
              "      <td>0.004616</td>\n",
              "      <td>-0.002240</td>\n",
              "      <td>-0.011284</td>\n",
              "      <td>0.028340</td>\n",
              "      <td>-0.002552</td>\n",
              "      <td>0.038001</td>\n",
              "      <td>0.006360</td>\n",
              "      <td>-0.001971</td>\n",
              "      <td>0.015491</td>\n",
              "      <td>0.025788</td>\n",
              "      <td>0.037285</td>\n",
              "      <td>0.011984</td>\n",
              "      <td>-0.014350</td>\n",
              "      <td>-0.010022</td>\n",
              "      <td>-0.005489</td>\n",
              "      <td>0.014556</td>\n",
              "      <td>0.003720</td>\n",
              "      <td>0.064004</td>\n",
              "      <td>0.009247</td>\n",
              "      <td>-0.006015</td>\n",
              "      <td>0.010923</td>\n",
              "      <td>-0.002112</td>\n",
              "      <td>0.011108</td>\n",
              "      <td>0.025057</td>\n",
              "      <td>-0.017314</td>\n",
              "      <td>0.006720</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2009-09-10</th>\n",
              "      <td>0.026053</td>\n",
              "      <td>0.123529</td>\n",
              "      <td>-0.022739</td>\n",
              "      <td>0.008403</td>\n",
              "      <td>0.004852</td>\n",
              "      <td>-0.008621</td>\n",
              "      <td>0.010945</td>\n",
              "      <td>0.011203</td>\n",
              "      <td>0.037195</td>\n",
              "      <td>0.003979</td>\n",
              "      <td>0.010690</td>\n",
              "      <td>-0.003421</td>\n",
              "      <td>0.003504</td>\n",
              "      <td>0.037975</td>\n",
              "      <td>-0.028918</td>\n",
              "      <td>-0.006806</td>\n",
              "      <td>0.002657</td>\n",
              "      <td>0.009471</td>\n",
              "      <td>0.003214</td>\n",
              "      <td>-0.026634</td>\n",
              "      <td>0.053741</td>\n",
              "      <td>0.012542</td>\n",
              "      <td>0.007780</td>\n",
              "      <td>0.017988</td>\n",
              "      <td>-0.001019</td>\n",
              "      <td>0.008246</td>\n",
              "      <td>0.051635</td>\n",
              "      <td>0.015484</td>\n",
              "      <td>-0.011894</td>\n",
              "      <td>-0.019383</td>\n",
              "      <td>0.034615</td>\n",
              "      <td>0.031564</td>\n",
              "      <td>0.000754</td>\n",
              "      <td>-0.002442</td>\n",
              "      <td>0.030151</td>\n",
              "      <td>0.020114</td>\n",
              "      <td>0.019577</td>\n",
              "      <td>0.024033</td>\n",
              "      <td>0.025396</td>\n",
              "      <td>-0.017387</td>\n",
              "      <td>...</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.021093</td>\n",
              "      <td>0.015678</td>\n",
              "      <td>-0.022727</td>\n",
              "      <td>-0.001140</td>\n",
              "      <td>0.011499</td>\n",
              "      <td>0.025552</td>\n",
              "      <td>-0.000523</td>\n",
              "      <td>0.011892</td>\n",
              "      <td>0.032898</td>\n",
              "      <td>0.018025</td>\n",
              "      <td>0.014863</td>\n",
              "      <td>0.034368</td>\n",
              "      <td>-0.023835</td>\n",
              "      <td>-0.002828</td>\n",
              "      <td>0.015152</td>\n",
              "      <td>0.012500</td>\n",
              "      <td>0.020997</td>\n",
              "      <td>0.008772</td>\n",
              "      <td>0.037008</td>\n",
              "      <td>0.015449</td>\n",
              "      <td>-0.005267</td>\n",
              "      <td>-0.006022</td>\n",
              "      <td>0.006518</td>\n",
              "      <td>0.008939</td>\n",
              "      <td>0.013122</td>\n",
              "      <td>0.006824</td>\n",
              "      <td>0.031496</td>\n",
              "      <td>-0.001756</td>\n",
              "      <td>0.005739</td>\n",
              "      <td>0.006301</td>\n",
              "      <td>0.017324</td>\n",
              "      <td>0.036109</td>\n",
              "      <td>0.001513</td>\n",
              "      <td>0.007563</td>\n",
              "      <td>0.002116</td>\n",
              "      <td>0.013810</td>\n",
              "      <td>0.057778</td>\n",
              "      <td>-0.002136</td>\n",
              "      <td>-0.014686</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2009-09-11</th>\n",
              "      <td>0.007023</td>\n",
              "      <td>0.002618</td>\n",
              "      <td>-0.035913</td>\n",
              "      <td>-0.002315</td>\n",
              "      <td>0.005901</td>\n",
              "      <td>-0.008696</td>\n",
              "      <td>-0.001140</td>\n",
              "      <td>0.016083</td>\n",
              "      <td>0.018519</td>\n",
              "      <td>-0.034346</td>\n",
              "      <td>0.000441</td>\n",
              "      <td>0.002288</td>\n",
              "      <td>-0.002968</td>\n",
              "      <td>0.017241</td>\n",
              "      <td>0.004169</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000883</td>\n",
              "      <td>0.014073</td>\n",
              "      <td>0.003495</td>\n",
              "      <td>-0.008173</td>\n",
              "      <td>-0.022000</td>\n",
              "      <td>0.004955</td>\n",
              "      <td>-0.005344</td>\n",
              "      <td>0.014357</td>\n",
              "      <td>-0.008503</td>\n",
              "      <td>0.012639</td>\n",
              "      <td>-0.014730</td>\n",
              "      <td>-0.010589</td>\n",
              "      <td>0.016496</td>\n",
              "      <td>-0.008985</td>\n",
              "      <td>0.055762</td>\n",
              "      <td>0.011822</td>\n",
              "      <td>-0.020657</td>\n",
              "      <td>-0.008362</td>\n",
              "      <td>-0.024390</td>\n",
              "      <td>0.013474</td>\n",
              "      <td>0.008229</td>\n",
              "      <td>0.015376</td>\n",
              "      <td>-0.002752</td>\n",
              "      <td>-0.015550</td>\n",
              "      <td>...</td>\n",
              "      <td>0.001682</td>\n",
              "      <td>-0.015599</td>\n",
              "      <td>0.044408</td>\n",
              "      <td>0.027300</td>\n",
              "      <td>0.006279</td>\n",
              "      <td>0.000609</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.004188</td>\n",
              "      <td>0.003205</td>\n",
              "      <td>-0.018267</td>\n",
              "      <td>0.010008</td>\n",
              "      <td>-0.002044</td>\n",
              "      <td>0.031083</td>\n",
              "      <td>-0.003330</td>\n",
              "      <td>-0.005672</td>\n",
              "      <td>-0.002764</td>\n",
              "      <td>0.005368</td>\n",
              "      <td>0.002754</td>\n",
              "      <td>-0.003261</td>\n",
              "      <td>0.006523</td>\n",
              "      <td>-0.018672</td>\n",
              "      <td>-0.003971</td>\n",
              "      <td>0.003231</td>\n",
              "      <td>-0.015264</td>\n",
              "      <td>-0.021112</td>\n",
              "      <td>0.011531</td>\n",
              "      <td>0.010845</td>\n",
              "      <td>0.030534</td>\n",
              "      <td>-0.006032</td>\n",
              "      <td>0.016405</td>\n",
              "      <td>0.007735</td>\n",
              "      <td>0.037843</td>\n",
              "      <td>-0.013524</td>\n",
              "      <td>0.000755</td>\n",
              "      <td>-0.014477</td>\n",
              "      <td>-0.009407</td>\n",
              "      <td>-0.003406</td>\n",
              "      <td>-0.021534</td>\n",
              "      <td>-0.003745</td>\n",
              "      <td>-0.002710</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2009-09-14</th>\n",
              "      <td>0.001609</td>\n",
              "      <td>0.023499</td>\n",
              "      <td>0.013379</td>\n",
              "      <td>0.008817</td>\n",
              "      <td>0.003733</td>\n",
              "      <td>0.021303</td>\n",
              "      <td>0.010839</td>\n",
              "      <td>0.002814</td>\n",
              "      <td>0.015584</td>\n",
              "      <td>0.010488</td>\n",
              "      <td>-0.012775</td>\n",
              "      <td>-0.000381</td>\n",
              "      <td>-0.003677</td>\n",
              "      <td>-0.011162</td>\n",
              "      <td>0.007711</td>\n",
              "      <td>0.016642</td>\n",
              "      <td>0.045013</td>\n",
              "      <td>0.022359</td>\n",
              "      <td>-0.005225</td>\n",
              "      <td>0.094948</td>\n",
              "      <td>0.037832</td>\n",
              "      <td>0.018899</td>\n",
              "      <td>0.013134</td>\n",
              "      <td>0.006532</td>\n",
              "      <td>0.010635</td>\n",
              "      <td>0.007342</td>\n",
              "      <td>-0.013289</td>\n",
              "      <td>0.002568</td>\n",
              "      <td>0.004825</td>\n",
              "      <td>-0.015413</td>\n",
              "      <td>0.007042</td>\n",
              "      <td>-0.004811</td>\n",
              "      <td>0.002617</td>\n",
              "      <td>0.011518</td>\n",
              "      <td>0.045833</td>\n",
              "      <td>-0.017834</td>\n",
              "      <td>-0.008044</td>\n",
              "      <td>0.011690</td>\n",
              "      <td>0.001698</td>\n",
              "      <td>0.010076</td>\n",
              "      <td>...</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.003426</td>\n",
              "      <td>0.006821</td>\n",
              "      <td>0.063976</td>\n",
              "      <td>0.005105</td>\n",
              "      <td>-0.006898</td>\n",
              "      <td>0.008081</td>\n",
              "      <td>0.008603</td>\n",
              "      <td>0.013845</td>\n",
              "      <td>0.024809</td>\n",
              "      <td>0.007622</td>\n",
              "      <td>0.038908</td>\n",
              "      <td>-0.009356</td>\n",
              "      <td>0.027283</td>\n",
              "      <td>0.015330</td>\n",
              "      <td>-0.006098</td>\n",
              "      <td>0.002136</td>\n",
              "      <td>-0.003845</td>\n",
              "      <td>0.004726</td>\n",
              "      <td>0.003431</td>\n",
              "      <td>0.003876</td>\n",
              "      <td>0.009967</td>\n",
              "      <td>0.016908</td>\n",
              "      <td>0.017849</td>\n",
              "      <td>0.016561</td>\n",
              "      <td>0.013741</td>\n",
              "      <td>0.008494</td>\n",
              "      <td>0.005291</td>\n",
              "      <td>-0.006574</td>\n",
              "      <td>0.009825</td>\n",
              "      <td>0.061769</td>\n",
              "      <td>0.071331</td>\n",
              "      <td>0.017137</td>\n",
              "      <td>0.009057</td>\n",
              "      <td>0.003808</td>\n",
              "      <td>0.000194</td>\n",
              "      <td>0.004039</td>\n",
              "      <td>-0.001074</td>\n",
              "      <td>0.001611</td>\n",
              "      <td>0.029212</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2009-09-15</th>\n",
              "      <td>0.008034</td>\n",
              "      <td>0.066327</td>\n",
              "      <td>-0.016309</td>\n",
              "      <td>0.008280</td>\n",
              "      <td>-0.008502</td>\n",
              "      <td>0.015951</td>\n",
              "      <td>-0.005079</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.012219</td>\n",
              "      <td>-0.004513</td>\n",
              "      <td>0.017849</td>\n",
              "      <td>0.007613</td>\n",
              "      <td>0.024780</td>\n",
              "      <td>-0.017977</td>\n",
              "      <td>0.013537</td>\n",
              "      <td>0.011074</td>\n",
              "      <td>-0.005068</td>\n",
              "      <td>-0.003771</td>\n",
              "      <td>-0.017800</td>\n",
              "      <td>-0.056283</td>\n",
              "      <td>0.047291</td>\n",
              "      <td>0.011290</td>\n",
              "      <td>-0.002946</td>\n",
              "      <td>-0.001622</td>\n",
              "      <td>0.016972</td>\n",
              "      <td>-0.008017</td>\n",
              "      <td>0.040404</td>\n",
              "      <td>-0.003843</td>\n",
              "      <td>-0.008293</td>\n",
              "      <td>0.003683</td>\n",
              "      <td>0.027972</td>\n",
              "      <td>0.008287</td>\n",
              "      <td>0.005682</td>\n",
              "      <td>-0.012403</td>\n",
              "      <td>0.002789</td>\n",
              "      <td>0.018818</td>\n",
              "      <td>-0.003697</td>\n",
              "      <td>-0.008666</td>\n",
              "      <td>-0.017800</td>\n",
              "      <td>-0.007010</td>\n",
              "      <td>...</td>\n",
              "      <td>0.002798</td>\n",
              "      <td>0.013231</td>\n",
              "      <td>0.001581</td>\n",
              "      <td>-0.023127</td>\n",
              "      <td>0.009029</td>\n",
              "      <td>-0.004290</td>\n",
              "      <td>0.004008</td>\n",
              "      <td>-0.006720</td>\n",
              "      <td>-0.003151</td>\n",
              "      <td>0.034916</td>\n",
              "      <td>-0.010590</td>\n",
              "      <td>0.021025</td>\n",
              "      <td>0.008395</td>\n",
              "      <td>0.002168</td>\n",
              "      <td>0.005618</td>\n",
              "      <td>-0.002231</td>\n",
              "      <td>0.004262</td>\n",
              "      <td>-0.013971</td>\n",
              "      <td>-0.005427</td>\n",
              "      <td>0.008739</td>\n",
              "      <td>0.034749</td>\n",
              "      <td>0.009868</td>\n",
              "      <td>0.014648</td>\n",
              "      <td>0.023535</td>\n",
              "      <td>0.021216</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-0.018174</td>\n",
              "      <td>0.023158</td>\n",
              "      <td>-0.008908</td>\n",
              "      <td>-0.015983</td>\n",
              "      <td>-0.005508</td>\n",
              "      <td>0.048713</td>\n",
              "      <td>0.019181</td>\n",
              "      <td>0.015707</td>\n",
              "      <td>0.001084</td>\n",
              "      <td>-0.007169</td>\n",
              "      <td>0.006498</td>\n",
              "      <td>0.043525</td>\n",
              "      <td>0.004826</td>\n",
              "      <td>0.107591</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2009-09-16</th>\n",
              "      <td>0.011158</td>\n",
              "      <td>-0.004785</td>\n",
              "      <td>-0.006316</td>\n",
              "      <td>0.038321</td>\n",
              "      <td>0.009646</td>\n",
              "      <td>0.078502</td>\n",
              "      <td>-0.007941</td>\n",
              "      <td>0.017888</td>\n",
              "      <td>-0.063728</td>\n",
              "      <td>-0.031278</td>\n",
              "      <td>0.008768</td>\n",
              "      <td>0.017000</td>\n",
              "      <td>0.045275</td>\n",
              "      <td>0.024691</td>\n",
              "      <td>0.005807</td>\n",
              "      <td>0.009048</td>\n",
              "      <td>0.018676</td>\n",
              "      <td>0.034065</td>\n",
              "      <td>0.006536</td>\n",
              "      <td>0.039182</td>\n",
              "      <td>0.088429</td>\n",
              "      <td>0.015949</td>\n",
              "      <td>0.018913</td>\n",
              "      <td>0.026544</td>\n",
              "      <td>0.011682</td>\n",
              "      <td>-0.005878</td>\n",
              "      <td>-0.003236</td>\n",
              "      <td>0.033005</td>\n",
              "      <td>0.014525</td>\n",
              "      <td>0.002752</td>\n",
              "      <td>-0.032313</td>\n",
              "      <td>0.007534</td>\n",
              "      <td>0.008551</td>\n",
              "      <td>0.020589</td>\n",
              "      <td>0.042114</td>\n",
              "      <td>0.009073</td>\n",
              "      <td>0.085577</td>\n",
              "      <td>0.015629</td>\n",
              "      <td>0.031931</td>\n",
              "      <td>0.020635</td>\n",
              "      <td>...</td>\n",
              "      <td>0.041295</td>\n",
              "      <td>-0.006318</td>\n",
              "      <td>-0.001578</td>\n",
              "      <td>0.037879</td>\n",
              "      <td>0.029083</td>\n",
              "      <td>0.010669</td>\n",
              "      <td>0.012641</td>\n",
              "      <td>0.001301</td>\n",
              "      <td>0.011591</td>\n",
              "      <td>0.017994</td>\n",
              "      <td>0.019113</td>\n",
              "      <td>0.062420</td>\n",
              "      <td>0.032258</td>\n",
              "      <td>0.005949</td>\n",
              "      <td>0.016061</td>\n",
              "      <td>-0.019005</td>\n",
              "      <td>0.016446</td>\n",
              "      <td>0.021812</td>\n",
              "      <td>0.016370</td>\n",
              "      <td>0.025235</td>\n",
              "      <td>0.011194</td>\n",
              "      <td>0.002606</td>\n",
              "      <td>0.020289</td>\n",
              "      <td>0.028855</td>\n",
              "      <td>0.056390</td>\n",
              "      <td>0.021565</td>\n",
              "      <td>0.001354</td>\n",
              "      <td>0.005144</td>\n",
              "      <td>0.002054</td>\n",
              "      <td>0.024011</td>\n",
              "      <td>0.012461</td>\n",
              "      <td>-0.049087</td>\n",
              "      <td>0.038403</td>\n",
              "      <td>0.013255</td>\n",
              "      <td>-0.024905</td>\n",
              "      <td>0.012295</td>\n",
              "      <td>0.006456</td>\n",
              "      <td>0.001545</td>\n",
              "      <td>0.011740</td>\n",
              "      <td>0.065554</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2009-09-17</th>\n",
              "      <td>-0.005255</td>\n",
              "      <td>0.170673</td>\n",
              "      <td>-0.001854</td>\n",
              "      <td>0.014938</td>\n",
              "      <td>-0.009023</td>\n",
              "      <td>0.030235</td>\n",
              "      <td>-0.007433</td>\n",
              "      <td>-0.005169</td>\n",
              "      <td>-0.015292</td>\n",
              "      <td>-0.007019</td>\n",
              "      <td>-0.023468</td>\n",
              "      <td>-0.001486</td>\n",
              "      <td>0.015094</td>\n",
              "      <td>-0.021188</td>\n",
              "      <td>-0.007506</td>\n",
              "      <td>-0.006135</td>\n",
              "      <td>-0.042500</td>\n",
              "      <td>-0.008053</td>\n",
              "      <td>0.006494</td>\n",
              "      <td>-0.022022</td>\n",
              "      <td>-0.043215</td>\n",
              "      <td>0.001177</td>\n",
              "      <td>-0.012181</td>\n",
              "      <td>-0.012665</td>\n",
              "      <td>-0.014517</td>\n",
              "      <td>-0.001478</td>\n",
              "      <td>-0.017857</td>\n",
              "      <td>0.016598</td>\n",
              "      <td>0.007809</td>\n",
              "      <td>-0.026532</td>\n",
              "      <td>-0.003515</td>\n",
              "      <td>0.012916</td>\n",
              "      <td>0.001514</td>\n",
              "      <td>0.013920</td>\n",
              "      <td>-0.012962</td>\n",
              "      <td>0.025369</td>\n",
              "      <td>-0.002867</td>\n",
              "      <td>0.002869</td>\n",
              "      <td>-0.006899</td>\n",
              "      <td>-0.015430</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.017685</td>\n",
              "      <td>-0.013565</td>\n",
              "      <td>-0.006098</td>\n",
              "      <td>-0.001825</td>\n",
              "      <td>-0.016304</td>\n",
              "      <td>0.009338</td>\n",
              "      <td>-0.003942</td>\n",
              "      <td>-0.006237</td>\n",
              "      <td>-0.003125</td>\n",
              "      <td>0.009722</td>\n",
              "      <td>0.066017</td>\n",
              "      <td>0.004846</td>\n",
              "      <td>0.008065</td>\n",
              "      <td>0.020161</td>\n",
              "      <td>-0.008935</td>\n",
              "      <td>-0.029630</td>\n",
              "      <td>-0.016180</td>\n",
              "      <td>0.014231</td>\n",
              "      <td>-0.008590</td>\n",
              "      <td>-0.019104</td>\n",
              "      <td>-0.007045</td>\n",
              "      <td>-0.001949</td>\n",
              "      <td>-0.003824</td>\n",
              "      <td>-0.021034</td>\n",
              "      <td>-0.006673</td>\n",
              "      <td>-0.011610</td>\n",
              "      <td>-0.004058</td>\n",
              "      <td>-0.013306</td>\n",
              "      <td>-0.001538</td>\n",
              "      <td>0.014483</td>\n",
              "      <td>-0.029402</td>\n",
              "      <td>0.004053</td>\n",
              "      <td>-0.003674</td>\n",
              "      <td>-0.003634</td>\n",
              "      <td>-0.024431</td>\n",
              "      <td>-0.007133</td>\n",
              "      <td>-0.006414</td>\n",
              "      <td>-0.006684</td>\n",
              "      <td>0.005274</td>\n",
              "      <td>-0.053691</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2009-09-18</th>\n",
              "      <td>-0.004226</td>\n",
              "      <td>-0.028747</td>\n",
              "      <td>0.014858</td>\n",
              "      <td>0.002165</td>\n",
              "      <td>0.009106</td>\n",
              "      <td>-0.036957</td>\n",
              "      <td>-0.008641</td>\n",
              "      <td>-0.011431</td>\n",
              "      <td>0.003350</td>\n",
              "      <td>-0.007069</td>\n",
              "      <td>0.013796</td>\n",
              "      <td>0.002976</td>\n",
              "      <td>0.003556</td>\n",
              "      <td>-0.000849</td>\n",
              "      <td>0.004072</td>\n",
              "      <td>0.013770</td>\n",
              "      <td>0.002611</td>\n",
              "      <td>0.001476</td>\n",
              "      <td>0.020821</td>\n",
              "      <td>0.012282</td>\n",
              "      <td>0.012647</td>\n",
              "      <td>0.025872</td>\n",
              "      <td>-0.008221</td>\n",
              "      <td>0.003207</td>\n",
              "      <td>-0.002678</td>\n",
              "      <td>0.012583</td>\n",
              "      <td>-0.009917</td>\n",
              "      <td>0.010204</td>\n",
              "      <td>-0.012484</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.005291</td>\n",
              "      <td>-0.004698</td>\n",
              "      <td>0.017234</td>\n",
              "      <td>0.004775</td>\n",
              "      <td>0.003862</td>\n",
              "      <td>0.025681</td>\n",
              "      <td>-0.001769</td>\n",
              "      <td>0.002341</td>\n",
              "      <td>-0.001474</td>\n",
              "      <td>-0.001621</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.001091</td>\n",
              "      <td>0.000859</td>\n",
              "      <td>-0.001136</td>\n",
              "      <td>-0.000914</td>\n",
              "      <td>0.013812</td>\n",
              "      <td>0.004626</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-0.009153</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-0.006565</td>\n",
              "      <td>-0.014075</td>\n",
              "      <td>0.002712</td>\n",
              "      <td>-0.012500</td>\n",
              "      <td>-0.010540</td>\n",
              "      <td>0.010055</td>\n",
              "      <td>0.002349</td>\n",
              "      <td>-0.001592</td>\n",
              "      <td>-0.004857</td>\n",
              "      <td>0.005415</td>\n",
              "      <td>-0.003371</td>\n",
              "      <td>-0.010135</td>\n",
              "      <td>-0.005859</td>\n",
              "      <td>0.003455</td>\n",
              "      <td>-0.010295</td>\n",
              "      <td>0.017324</td>\n",
              "      <td>0.002593</td>\n",
              "      <td>0.023993</td>\n",
              "      <td>-0.010373</td>\n",
              "      <td>0.003080</td>\n",
              "      <td>0.004079</td>\n",
              "      <td>0.024657</td>\n",
              "      <td>-0.000425</td>\n",
              "      <td>-0.011308</td>\n",
              "      <td>-0.005835</td>\n",
              "      <td>0.026181</td>\n",
              "      <td>0.002136</td>\n",
              "      <td>0.002152</td>\n",
              "      <td>-0.003106</td>\n",
              "      <td>0.015740</td>\n",
              "      <td>0.007092</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2009-09-21</th>\n",
              "      <td>0.015915</td>\n",
              "      <td>0.088795</td>\n",
              "      <td>0.021176</td>\n",
              "      <td>-0.005184</td>\n",
              "      <td>0.008493</td>\n",
              "      <td>0.047404</td>\n",
              "      <td>0.012202</td>\n",
              "      <td>0.005957</td>\n",
              "      <td>-0.003035</td>\n",
              "      <td>-0.002848</td>\n",
              "      <td>-0.009219</td>\n",
              "      <td>-0.005193</td>\n",
              "      <td>-0.012885</td>\n",
              "      <td>0.022515</td>\n",
              "      <td>-0.009849</td>\n",
              "      <td>-0.003747</td>\n",
              "      <td>0.016493</td>\n",
              "      <td>-0.011054</td>\n",
              "      <td>-0.010342</td>\n",
              "      <td>0.212673</td>\n",
              "      <td>-0.030330</td>\n",
              "      <td>-0.006496</td>\n",
              "      <td>0.002960</td>\n",
              "      <td>0.023442</td>\n",
              "      <td>0.007049</td>\n",
              "      <td>0.025585</td>\n",
              "      <td>0.021703</td>\n",
              "      <td>-0.011313</td>\n",
              "      <td>0.017001</td>\n",
              "      <td>-0.029135</td>\n",
              "      <td>0.019298</td>\n",
              "      <td>-0.002697</td>\n",
              "      <td>-0.021549</td>\n",
              "      <td>0.024752</td>\n",
              "      <td>-0.014621</td>\n",
              "      <td>-0.006718</td>\n",
              "      <td>0.003101</td>\n",
              "      <td>-0.008563</td>\n",
              "      <td>0.007168</td>\n",
              "      <td>-0.004871</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.013654</td>\n",
              "      <td>-0.013740</td>\n",
              "      <td>-0.004322</td>\n",
              "      <td>-0.013724</td>\n",
              "      <td>-0.014169</td>\n",
              "      <td>-0.002402</td>\n",
              "      <td>-0.005937</td>\n",
              "      <td>-0.002639</td>\n",
              "      <td>-0.006270</td>\n",
              "      <td>-0.010132</td>\n",
              "      <td>-0.003569</td>\n",
              "      <td>-0.021040</td>\n",
              "      <td>-0.001519</td>\n",
              "      <td>0.014913</td>\n",
              "      <td>-0.004806</td>\n",
              "      <td>-0.002929</td>\n",
              "      <td>-0.018597</td>\n",
              "      <td>0.017715</td>\n",
              "      <td>0.001077</td>\n",
              "      <td>0.015032</td>\n",
              "      <td>-0.005119</td>\n",
              "      <td>-0.005239</td>\n",
              "      <td>-0.010329</td>\n",
              "      <td>-0.007237</td>\n",
              "      <td>-0.027281</td>\n",
              "      <td>-0.009586</td>\n",
              "      <td>-0.025641</td>\n",
              "      <td>0.002096</td>\n",
              "      <td>0.015865</td>\n",
              "      <td>-0.003385</td>\n",
              "      <td>-0.028876</td>\n",
              "      <td>-0.007014</td>\n",
              "      <td>-0.013426</td>\n",
              "      <td>0.000734</td>\n",
              "      <td>0.003882</td>\n",
              "      <td>-0.006007</td>\n",
              "      <td>0.005521</td>\n",
              "      <td>-0.004154</td>\n",
              "      <td>-0.026860</td>\n",
              "      <td>-0.011150</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>...</th>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019-06-25</th>\n",
              "      <td>-0.008633</td>\n",
              "      <td>-0.017660</td>\n",
              "      <td>0.014245</td>\n",
              "      <td>-0.015158</td>\n",
              "      <td>0.009100</td>\n",
              "      <td>0.015365</td>\n",
              "      <td>-0.005451</td>\n",
              "      <td>-0.006502</td>\n",
              "      <td>-0.039684</td>\n",
              "      <td>-0.023206</td>\n",
              "      <td>-0.007611</td>\n",
              "      <td>-0.013352</td>\n",
              "      <td>-0.000372</td>\n",
              "      <td>-0.031691</td>\n",
              "      <td>-0.004161</td>\n",
              "      <td>-0.005764</td>\n",
              "      <td>0.001212</td>\n",
              "      <td>-0.001272</td>\n",
              "      <td>0.253608</td>\n",
              "      <td>-0.011065</td>\n",
              "      <td>-0.009783</td>\n",
              "      <td>0.001133</td>\n",
              "      <td>-0.008968</td>\n",
              "      <td>-0.011811</td>\n",
              "      <td>-0.003235</td>\n",
              "      <td>-0.021761</td>\n",
              "      <td>-0.007690</td>\n",
              "      <td>-0.005676</td>\n",
              "      <td>-0.014412</td>\n",
              "      <td>-0.008268</td>\n",
              "      <td>-0.013671</td>\n",
              "      <td>-0.003301</td>\n",
              "      <td>0.005360</td>\n",
              "      <td>-0.002110</td>\n",
              "      <td>-0.027198</td>\n",
              "      <td>-0.017432</td>\n",
              "      <td>-0.018616</td>\n",
              "      <td>-0.024530</td>\n",
              "      <td>-0.018415</td>\n",
              "      <td>-0.001398</td>\n",
              "      <td>...</td>\n",
              "      <td>0.003433</td>\n",
              "      <td>-0.005321</td>\n",
              "      <td>-0.025973</td>\n",
              "      <td>-0.007638</td>\n",
              "      <td>-0.005007</td>\n",
              "      <td>-0.008911</td>\n",
              "      <td>-0.014783</td>\n",
              "      <td>-0.006461</td>\n",
              "      <td>-0.027775</td>\n",
              "      <td>-0.029586</td>\n",
              "      <td>0.010767</td>\n",
              "      <td>-0.016017</td>\n",
              "      <td>-0.007969</td>\n",
              "      <td>-0.004806</td>\n",
              "      <td>-0.011233</td>\n",
              "      <td>-0.004509</td>\n",
              "      <td>0.005293</td>\n",
              "      <td>-0.005320</td>\n",
              "      <td>0.019249</td>\n",
              "      <td>-0.018267</td>\n",
              "      <td>0.001726</td>\n",
              "      <td>-0.003753</td>\n",
              "      <td>-0.009159</td>\n",
              "      <td>-0.002623</td>\n",
              "      <td>-0.017844</td>\n",
              "      <td>0.002826</td>\n",
              "      <td>-0.004702</td>\n",
              "      <td>-0.013260</td>\n",
              "      <td>-0.004697</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-0.010453</td>\n",
              "      <td>-0.025078</td>\n",
              "      <td>-0.006260</td>\n",
              "      <td>-0.004570</td>\n",
              "      <td>-0.024310</td>\n",
              "      <td>-0.008837</td>\n",
              "      <td>0.003821</td>\n",
              "      <td>-0.001736</td>\n",
              "      <td>-0.003163</td>\n",
              "      <td>-0.002947</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019-06-26</th>\n",
              "      <td>-0.005114</td>\n",
              "      <td>0.006421</td>\n",
              "      <td>-0.029579</td>\n",
              "      <td>0.021629</td>\n",
              "      <td>-0.005933</td>\n",
              "      <td>-0.021162</td>\n",
              "      <td>-0.015251</td>\n",
              "      <td>-0.008599</td>\n",
              "      <td>0.002604</td>\n",
              "      <td>0.005350</td>\n",
              "      <td>0.001979</td>\n",
              "      <td>-0.016312</td>\n",
              "      <td>0.007142</td>\n",
              "      <td>-0.004168</td>\n",
              "      <td>-0.024158</td>\n",
              "      <td>-0.020736</td>\n",
              "      <td>-0.019976</td>\n",
              "      <td>-0.012921</td>\n",
              "      <td>0.009666</td>\n",
              "      <td>-0.008913</td>\n",
              "      <td>-0.020549</td>\n",
              "      <td>-0.030752</td>\n",
              "      <td>-0.018213</td>\n",
              "      <td>0.010281</td>\n",
              "      <td>0.020209</td>\n",
              "      <td>-0.028766</td>\n",
              "      <td>-0.000484</td>\n",
              "      <td>-0.020864</td>\n",
              "      <td>0.001518</td>\n",
              "      <td>0.038113</td>\n",
              "      <td>0.036729</td>\n",
              "      <td>0.003084</td>\n",
              "      <td>0.018262</td>\n",
              "      <td>-0.006886</td>\n",
              "      <td>0.016817</td>\n",
              "      <td>-0.023765</td>\n",
              "      <td>0.010414</td>\n",
              "      <td>0.011351</td>\n",
              "      <td>-0.022232</td>\n",
              "      <td>-0.017375</td>\n",
              "      <td>...</td>\n",
              "      <td>0.001866</td>\n",
              "      <td>-0.003186</td>\n",
              "      <td>0.029239</td>\n",
              "      <td>0.015161</td>\n",
              "      <td>-0.001161</td>\n",
              "      <td>-0.009766</td>\n",
              "      <td>-0.001284</td>\n",
              "      <td>-0.022983</td>\n",
              "      <td>0.003395</td>\n",
              "      <td>-0.016599</td>\n",
              "      <td>0.040505</td>\n",
              "      <td>-0.022382</td>\n",
              "      <td>-0.010630</td>\n",
              "      <td>-0.013822</td>\n",
              "      <td>-0.014710</td>\n",
              "      <td>-0.017422</td>\n",
              "      <td>0.002048</td>\n",
              "      <td>-0.000994</td>\n",
              "      <td>-0.010765</td>\n",
              "      <td>-0.019020</td>\n",
              "      <td>0.073099</td>\n",
              "      <td>-0.018955</td>\n",
              "      <td>-0.026771</td>\n",
              "      <td>-0.007451</td>\n",
              "      <td>0.015552</td>\n",
              "      <td>-0.028387</td>\n",
              "      <td>-0.015719</td>\n",
              "      <td>0.026502</td>\n",
              "      <td>-0.005083</td>\n",
              "      <td>-0.017051</td>\n",
              "      <td>-0.004304</td>\n",
              "      <td>0.019334</td>\n",
              "      <td>0.029158</td>\n",
              "      <td>-0.025250</td>\n",
              "      <td>0.038971</td>\n",
              "      <td>0.004327</td>\n",
              "      <td>-0.004844</td>\n",
              "      <td>0.015648</td>\n",
              "      <td>-0.001722</td>\n",
              "      <td>0.008866</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019-06-27</th>\n",
              "      <td>0.014587</td>\n",
              "      <td>0.022010</td>\n",
              "      <td>0.011872</td>\n",
              "      <td>-0.000300</td>\n",
              "      <td>0.022082</td>\n",
              "      <td>0.013155</td>\n",
              "      <td>0.008832</td>\n",
              "      <td>-0.001691</td>\n",
              "      <td>0.015621</td>\n",
              "      <td>0.017769</td>\n",
              "      <td>0.001728</td>\n",
              "      <td>0.007309</td>\n",
              "      <td>0.014182</td>\n",
              "      <td>0.017048</td>\n",
              "      <td>-0.001071</td>\n",
              "      <td>-0.006831</td>\n",
              "      <td>0.013589</td>\n",
              "      <td>0.005715</td>\n",
              "      <td>0.012256</td>\n",
              "      <td>0.015117</td>\n",
              "      <td>0.003228</td>\n",
              "      <td>0.015669</td>\n",
              "      <td>0.015479</td>\n",
              "      <td>0.010304</td>\n",
              "      <td>0.005205</td>\n",
              "      <td>0.006976</td>\n",
              "      <td>0.019383</td>\n",
              "      <td>0.006533</td>\n",
              "      <td>0.006143</td>\n",
              "      <td>0.025470</td>\n",
              "      <td>0.027406</td>\n",
              "      <td>0.004896</td>\n",
              "      <td>0.014259</td>\n",
              "      <td>0.004640</td>\n",
              "      <td>-0.014265</td>\n",
              "      <td>0.000243</td>\n",
              "      <td>0.003399</td>\n",
              "      <td>0.011023</td>\n",
              "      <td>0.012839</td>\n",
              "      <td>0.014093</td>\n",
              "      <td>...</td>\n",
              "      <td>0.012419</td>\n",
              "      <td>0.001085</td>\n",
              "      <td>0.017305</td>\n",
              "      <td>0.010722</td>\n",
              "      <td>0.007169</td>\n",
              "      <td>0.009471</td>\n",
              "      <td>0.000994</td>\n",
              "      <td>0.006127</td>\n",
              "      <td>0.011669</td>\n",
              "      <td>0.008267</td>\n",
              "      <td>-0.011786</td>\n",
              "      <td>0.008966</td>\n",
              "      <td>0.007779</td>\n",
              "      <td>0.005178</td>\n",
              "      <td>0.014486</td>\n",
              "      <td>0.004433</td>\n",
              "      <td>0.006568</td>\n",
              "      <td>0.011466</td>\n",
              "      <td>0.040855</td>\n",
              "      <td>0.004812</td>\n",
              "      <td>0.021789</td>\n",
              "      <td>-0.003000</td>\n",
              "      <td>0.006908</td>\n",
              "      <td>0.010598</td>\n",
              "      <td>0.018391</td>\n",
              "      <td>0.014769</td>\n",
              "      <td>0.010908</td>\n",
              "      <td>0.001455</td>\n",
              "      <td>-0.000547</td>\n",
              "      <td>0.004082</td>\n",
              "      <td>0.020432</td>\n",
              "      <td>0.022184</td>\n",
              "      <td>0.010143</td>\n",
              "      <td>-0.002860</td>\n",
              "      <td>0.034522</td>\n",
              "      <td>-0.010183</td>\n",
              "      <td>0.001912</td>\n",
              "      <td>0.007989</td>\n",
              "      <td>0.003996</td>\n",
              "      <td>0.013970</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019-06-28</th>\n",
              "      <td>0.020266</td>\n",
              "      <td>0.014357</td>\n",
              "      <td>0.016017</td>\n",
              "      <td>-0.009112</td>\n",
              "      <td>-0.004321</td>\n",
              "      <td>0.021810</td>\n",
              "      <td>0.004917</td>\n",
              "      <td>0.009672</td>\n",
              "      <td>0.004843</td>\n",
              "      <td>0.000266</td>\n",
              "      <td>0.005669</td>\n",
              "      <td>0.008048</td>\n",
              "      <td>0.020612</td>\n",
              "      <td>-0.014221</td>\n",
              "      <td>0.006162</td>\n",
              "      <td>0.001261</td>\n",
              "      <td>0.013406</td>\n",
              "      <td>0.004766</td>\n",
              "      <td>0.008554</td>\n",
              "      <td>0.004336</td>\n",
              "      <td>0.007842</td>\n",
              "      <td>0.019356</td>\n",
              "      <td>0.019199</td>\n",
              "      <td>0.009066</td>\n",
              "      <td>0.012802</td>\n",
              "      <td>0.013891</td>\n",
              "      <td>0.012676</td>\n",
              "      <td>0.015478</td>\n",
              "      <td>0.038617</td>\n",
              "      <td>0.004923</td>\n",
              "      <td>-0.012036</td>\n",
              "      <td>0.029232</td>\n",
              "      <td>0.008018</td>\n",
              "      <td>0.001413</td>\n",
              "      <td>0.007830</td>\n",
              "      <td>-0.006801</td>\n",
              "      <td>-0.005593</td>\n",
              "      <td>0.019664</td>\n",
              "      <td>-0.000744</td>\n",
              "      <td>0.002134</td>\n",
              "      <td>...</td>\n",
              "      <td>0.019933</td>\n",
              "      <td>0.018674</td>\n",
              "      <td>0.015438</td>\n",
              "      <td>0.005001</td>\n",
              "      <td>0.008080</td>\n",
              "      <td>0.009537</td>\n",
              "      <td>0.013549</td>\n",
              "      <td>0.023380</td>\n",
              "      <td>0.007497</td>\n",
              "      <td>0.020499</td>\n",
              "      <td>0.019998</td>\n",
              "      <td>0.006506</td>\n",
              "      <td>0.009021</td>\n",
              "      <td>0.026879</td>\n",
              "      <td>-0.004080</td>\n",
              "      <td>-0.002118</td>\n",
              "      <td>0.039008</td>\n",
              "      <td>0.008292</td>\n",
              "      <td>0.002751</td>\n",
              "      <td>-0.003496</td>\n",
              "      <td>0.067340</td>\n",
              "      <td>0.003491</td>\n",
              "      <td>-0.001225</td>\n",
              "      <td>0.022285</td>\n",
              "      <td>0.000351</td>\n",
              "      <td>0.013707</td>\n",
              "      <td>-0.004057</td>\n",
              "      <td>0.018155</td>\n",
              "      <td>0.003560</td>\n",
              "      <td>0.010671</td>\n",
              "      <td>0.014247</td>\n",
              "      <td>0.000323</td>\n",
              "      <td>0.027181</td>\n",
              "      <td>0.003543</td>\n",
              "      <td>-0.002208</td>\n",
              "      <td>0.010683</td>\n",
              "      <td>0.012667</td>\n",
              "      <td>0.002264</td>\n",
              "      <td>0.000995</td>\n",
              "      <td>0.021778</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019-07-01</th>\n",
              "      <td>0.017045</td>\n",
              "      <td>0.008000</td>\n",
              "      <td>0.015895</td>\n",
              "      <td>0.018341</td>\n",
              "      <td>0.003871</td>\n",
              "      <td>0.017390</td>\n",
              "      <td>0.004535</td>\n",
              "      <td>0.011365</td>\n",
              "      <td>0.021449</td>\n",
              "      <td>0.018871</td>\n",
              "      <td>0.014706</td>\n",
              "      <td>0.006411</td>\n",
              "      <td>0.018768</td>\n",
              "      <td>0.039227</td>\n",
              "      <td>0.001331</td>\n",
              "      <td>0.001374</td>\n",
              "      <td>0.000601</td>\n",
              "      <td>0.018427</td>\n",
              "      <td>0.000538</td>\n",
              "      <td>0.010511</td>\n",
              "      <td>-0.003591</td>\n",
              "      <td>0.024535</td>\n",
              "      <td>0.021121</td>\n",
              "      <td>0.002995</td>\n",
              "      <td>-0.001136</td>\n",
              "      <td>-0.007380</td>\n",
              "      <td>-0.003129</td>\n",
              "      <td>0.014357</td>\n",
              "      <td>0.002290</td>\n",
              "      <td>0.017145</td>\n",
              "      <td>0.027330</td>\n",
              "      <td>0.013981</td>\n",
              "      <td>-0.001307</td>\n",
              "      <td>0.011233</td>\n",
              "      <td>0.004023</td>\n",
              "      <td>-0.010516</td>\n",
              "      <td>0.015082</td>\n",
              "      <td>0.016063</td>\n",
              "      <td>0.001807</td>\n",
              "      <td>0.011218</td>\n",
              "      <td>...</td>\n",
              "      <td>0.025857</td>\n",
              "      <td>0.014133</td>\n",
              "      <td>-0.002905</td>\n",
              "      <td>0.012591</td>\n",
              "      <td>0.011641</td>\n",
              "      <td>0.008756</td>\n",
              "      <td>0.002247</td>\n",
              "      <td>0.025711</td>\n",
              "      <td>0.011219</td>\n",
              "      <td>0.021091</td>\n",
              "      <td>-0.015826</td>\n",
              "      <td>0.001892</td>\n",
              "      <td>0.010184</td>\n",
              "      <td>-0.008398</td>\n",
              "      <td>-0.006437</td>\n",
              "      <td>-0.008137</td>\n",
              "      <td>0.022191</td>\n",
              "      <td>0.018305</td>\n",
              "      <td>-0.000366</td>\n",
              "      <td>-0.014488</td>\n",
              "      <td>0.044164</td>\n",
              "      <td>-0.002879</td>\n",
              "      <td>0.002576</td>\n",
              "      <td>0.007908</td>\n",
              "      <td>0.022619</td>\n",
              "      <td>0.012530</td>\n",
              "      <td>-0.000693</td>\n",
              "      <td>0.000713</td>\n",
              "      <td>0.001182</td>\n",
              "      <td>0.004525</td>\n",
              "      <td>0.002278</td>\n",
              "      <td>0.058553</td>\n",
              "      <td>0.012136</td>\n",
              "      <td>-0.001009</td>\n",
              "      <td>0.027402</td>\n",
              "      <td>-0.000913</td>\n",
              "      <td>-0.000685</td>\n",
              "      <td>0.023440</td>\n",
              "      <td>-0.010662</td>\n",
              "      <td>0.007612</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019-07-02</th>\n",
              "      <td>-0.002243</td>\n",
              "      <td>-0.020757</td>\n",
              "      <td>0.020436</td>\n",
              "      <td>0.005855</td>\n",
              "      <td>-0.001519</td>\n",
              "      <td>-0.013320</td>\n",
              "      <td>0.005465</td>\n",
              "      <td>0.009258</td>\n",
              "      <td>0.001395</td>\n",
              "      <td>-0.012957</td>\n",
              "      <td>0.002174</td>\n",
              "      <td>-0.026624</td>\n",
              "      <td>0.025567</td>\n",
              "      <td>0.004785</td>\n",
              "      <td>0.009174</td>\n",
              "      <td>0.012004</td>\n",
              "      <td>0.010216</td>\n",
              "      <td>0.006987</td>\n",
              "      <td>0.012058</td>\n",
              "      <td>-0.000929</td>\n",
              "      <td>0.015819</td>\n",
              "      <td>-0.001560</td>\n",
              "      <td>0.009951</td>\n",
              "      <td>0.000995</td>\n",
              "      <td>-0.006541</td>\n",
              "      <td>-0.002871</td>\n",
              "      <td>-0.009732</td>\n",
              "      <td>0.001163</td>\n",
              "      <td>0.021328</td>\n",
              "      <td>-0.022329</td>\n",
              "      <td>0.001282</td>\n",
              "      <td>-0.009662</td>\n",
              "      <td>-0.020511</td>\n",
              "      <td>0.001556</td>\n",
              "      <td>0.001865</td>\n",
              "      <td>0.016461</td>\n",
              "      <td>0.006305</td>\n",
              "      <td>-0.007304</td>\n",
              "      <td>-0.007286</td>\n",
              "      <td>0.004006</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.012603</td>\n",
              "      <td>-0.001574</td>\n",
              "      <td>-0.009420</td>\n",
              "      <td>-0.018615</td>\n",
              "      <td>-0.001509</td>\n",
              "      <td>0.004721</td>\n",
              "      <td>0.007704</td>\n",
              "      <td>0.001146</td>\n",
              "      <td>-0.018227</td>\n",
              "      <td>0.003607</td>\n",
              "      <td>-0.042122</td>\n",
              "      <td>0.014477</td>\n",
              "      <td>0.011974</td>\n",
              "      <td>-0.012703</td>\n",
              "      <td>0.016934</td>\n",
              "      <td>0.025861</td>\n",
              "      <td>0.001365</td>\n",
              "      <td>-0.009034</td>\n",
              "      <td>0.005672</td>\n",
              "      <td>0.005766</td>\n",
              "      <td>-0.026586</td>\n",
              "      <td>0.013473</td>\n",
              "      <td>0.029728</td>\n",
              "      <td>-0.009754</td>\n",
              "      <td>-0.005083</td>\n",
              "      <td>0.006239</td>\n",
              "      <td>0.005204</td>\n",
              "      <td>0.004989</td>\n",
              "      <td>0.008812</td>\n",
              "      <td>0.009009</td>\n",
              "      <td>0.004545</td>\n",
              "      <td>0.013105</td>\n",
              "      <td>-0.024813</td>\n",
              "      <td>0.012115</td>\n",
              "      <td>-0.029322</td>\n",
              "      <td>-0.010972</td>\n",
              "      <td>-0.002229</td>\n",
              "      <td>-0.016556</td>\n",
              "      <td>0.012878</td>\n",
              "      <td>-0.031945</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019-07-03</th>\n",
              "      <td>0.015739</td>\n",
              "      <td>0.016521</td>\n",
              "      <td>0.005257</td>\n",
              "      <td>0.008287</td>\n",
              "      <td>0.024924</td>\n",
              "      <td>-0.000612</td>\n",
              "      <td>0.008153</td>\n",
              "      <td>0.012566</td>\n",
              "      <td>0.014300</td>\n",
              "      <td>-0.002995</td>\n",
              "      <td>0.009159</td>\n",
              "      <td>0.013151</td>\n",
              "      <td>0.002732</td>\n",
              "      <td>0.011170</td>\n",
              "      <td>0.008169</td>\n",
              "      <td>0.010732</td>\n",
              "      <td>0.019631</td>\n",
              "      <td>0.011386</td>\n",
              "      <td>0.000413</td>\n",
              "      <td>0.019334</td>\n",
              "      <td>0.016164</td>\n",
              "      <td>0.010292</td>\n",
              "      <td>0.011845</td>\n",
              "      <td>0.010191</td>\n",
              "      <td>0.023902</td>\n",
              "      <td>0.015135</td>\n",
              "      <td>0.011888</td>\n",
              "      <td>0.013169</td>\n",
              "      <td>-0.005445</td>\n",
              "      <td>0.000224</td>\n",
              "      <td>-0.001601</td>\n",
              "      <td>0.007564</td>\n",
              "      <td>0.006572</td>\n",
              "      <td>0.010394</td>\n",
              "      <td>0.012344</td>\n",
              "      <td>0.022078</td>\n",
              "      <td>0.002425</td>\n",
              "      <td>0.013263</td>\n",
              "      <td>0.007554</td>\n",
              "      <td>0.013045</td>\n",
              "      <td>...</td>\n",
              "      <td>0.014544</td>\n",
              "      <td>0.003329</td>\n",
              "      <td>0.011765</td>\n",
              "      <td>0.008498</td>\n",
              "      <td>0.006046</td>\n",
              "      <td>0.007881</td>\n",
              "      <td>0.009071</td>\n",
              "      <td>-0.006581</td>\n",
              "      <td>0.014068</td>\n",
              "      <td>0.017968</td>\n",
              "      <td>0.015786</td>\n",
              "      <td>0.005429</td>\n",
              "      <td>0.015153</td>\n",
              "      <td>0.020776</td>\n",
              "      <td>0.020996</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000954</td>\n",
              "      <td>0.020626</td>\n",
              "      <td>0.004185</td>\n",
              "      <td>-0.003079</td>\n",
              "      <td>-0.008070</td>\n",
              "      <td>0.010445</td>\n",
              "      <td>0.013069</td>\n",
              "      <td>0.009208</td>\n",
              "      <td>0.009597</td>\n",
              "      <td>0.003023</td>\n",
              "      <td>0.011390</td>\n",
              "      <td>0.006738</td>\n",
              "      <td>0.006484</td>\n",
              "      <td>0.004464</td>\n",
              "      <td>0.012443</td>\n",
              "      <td>0.003083</td>\n",
              "      <td>0.003074</td>\n",
              "      <td>0.009310</td>\n",
              "      <td>-0.010240</td>\n",
              "      <td>0.009509</td>\n",
              "      <td>0.002234</td>\n",
              "      <td>0.023569</td>\n",
              "      <td>0.000721</td>\n",
              "      <td>0.011594</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019-07-05</th>\n",
              "      <td>-0.013672</td>\n",
              "      <td>-0.007973</td>\n",
              "      <td>-0.000062</td>\n",
              "      <td>-0.000881</td>\n",
              "      <td>0.004338</td>\n",
              "      <td>0.000536</td>\n",
              "      <td>-0.002579</td>\n",
              "      <td>0.002199</td>\n",
              "      <td>-0.005626</td>\n",
              "      <td>-0.002739</td>\n",
              "      <td>0.001672</td>\n",
              "      <td>0.004571</td>\n",
              "      <td>0.009809</td>\n",
              "      <td>0.001337</td>\n",
              "      <td>-0.000915</td>\n",
              "      <td>-0.003353</td>\n",
              "      <td>-0.009335</td>\n",
              "      <td>-0.000704</td>\n",
              "      <td>-0.011320</td>\n",
              "      <td>-0.004012</td>\n",
              "      <td>-0.008923</td>\n",
              "      <td>0.001637</td>\n",
              "      <td>-0.008862</td>\n",
              "      <td>0.005167</td>\n",
              "      <td>-0.014398</td>\n",
              "      <td>-0.006218</td>\n",
              "      <td>0.003603</td>\n",
              "      <td>-0.001338</td>\n",
              "      <td>-0.022872</td>\n",
              "      <td>-0.015447</td>\n",
              "      <td>0.009939</td>\n",
              "      <td>-0.008922</td>\n",
              "      <td>0.003541</td>\n",
              "      <td>-0.013999</td>\n",
              "      <td>0.015531</td>\n",
              "      <td>-0.005377</td>\n",
              "      <td>0.002017</td>\n",
              "      <td>0.000860</td>\n",
              "      <td>0.004526</td>\n",
              "      <td>-0.004545</td>\n",
              "      <td>...</td>\n",
              "      <td>0.003511</td>\n",
              "      <td>-0.010303</td>\n",
              "      <td>-0.007558</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.008075</td>\n",
              "      <td>-0.003459</td>\n",
              "      <td>-0.001187</td>\n",
              "      <td>0.004105</td>\n",
              "      <td>-0.001478</td>\n",
              "      <td>0.006739</td>\n",
              "      <td>-0.001727</td>\n",
              "      <td>0.000309</td>\n",
              "      <td>0.001244</td>\n",
              "      <td>-0.026847</td>\n",
              "      <td>-0.010211</td>\n",
              "      <td>0.003129</td>\n",
              "      <td>0.002861</td>\n",
              "      <td>-0.006541</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.003053</td>\n",
              "      <td>0.012098</td>\n",
              "      <td>-0.001292</td>\n",
              "      <td>-0.012314</td>\n",
              "      <td>0.002334</td>\n",
              "      <td>-0.010737</td>\n",
              "      <td>0.000511</td>\n",
              "      <td>-0.006228</td>\n",
              "      <td>-0.001409</td>\n",
              "      <td>-0.003042</td>\n",
              "      <td>0.004938</td>\n",
              "      <td>-0.008939</td>\n",
              "      <td>-0.004274</td>\n",
              "      <td>0.006639</td>\n",
              "      <td>-0.000329</td>\n",
              "      <td>-0.002414</td>\n",
              "      <td>-0.004055</td>\n",
              "      <td>-0.008916</td>\n",
              "      <td>-0.001096</td>\n",
              "      <td>-0.006668</td>\n",
              "      <td>0.018514</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019-07-08</th>\n",
              "      <td>-0.025215</td>\n",
              "      <td>0.010201</td>\n",
              "      <td>-0.015129</td>\n",
              "      <td>-0.020614</td>\n",
              "      <td>-0.001591</td>\n",
              "      <td>-0.014113</td>\n",
              "      <td>-0.003878</td>\n",
              "      <td>-0.005643</td>\n",
              "      <td>-0.003487</td>\n",
              "      <td>-0.009126</td>\n",
              "      <td>-0.002384</td>\n",
              "      <td>-0.004671</td>\n",
              "      <td>-0.010388</td>\n",
              "      <td>-0.013703</td>\n",
              "      <td>0.000262</td>\n",
              "      <td>0.001009</td>\n",
              "      <td>0.001767</td>\n",
              "      <td>-0.002816</td>\n",
              "      <td>-0.016340</td>\n",
              "      <td>0.006409</td>\n",
              "      <td>0.005481</td>\n",
              "      <td>0.003269</td>\n",
              "      <td>-0.002429</td>\n",
              "      <td>-0.006242</td>\n",
              "      <td>-0.004538</td>\n",
              "      <td>-0.003842</td>\n",
              "      <td>0.009521</td>\n",
              "      <td>-0.001053</td>\n",
              "      <td>-0.038373</td>\n",
              "      <td>-0.012051</td>\n",
              "      <td>0.017143</td>\n",
              "      <td>-0.005379</td>\n",
              "      <td>-0.016760</td>\n",
              "      <td>-0.019899</td>\n",
              "      <td>-0.007848</td>\n",
              "      <td>-0.000431</td>\n",
              "      <td>0.004843</td>\n",
              "      <td>-0.007541</td>\n",
              "      <td>0.002394</td>\n",
              "      <td>-0.005631</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.006122</td>\n",
              "      <td>-0.002588</td>\n",
              "      <td>-0.004882</td>\n",
              "      <td>-0.007523</td>\n",
              "      <td>-0.010805</td>\n",
              "      <td>-0.012600</td>\n",
              "      <td>-0.002660</td>\n",
              "      <td>-0.015275</td>\n",
              "      <td>0.006264</td>\n",
              "      <td>0.000956</td>\n",
              "      <td>-0.005807</td>\n",
              "      <td>0.002159</td>\n",
              "      <td>-0.007776</td>\n",
              "      <td>-0.008916</td>\n",
              "      <td>0.004442</td>\n",
              "      <td>-0.007106</td>\n",
              "      <td>0.001630</td>\n",
              "      <td>-0.013985</td>\n",
              "      <td>0.004349</td>\n",
              "      <td>-0.004672</td>\n",
              "      <td>0.027824</td>\n",
              "      <td>0.003176</td>\n",
              "      <td>0.012349</td>\n",
              "      <td>-0.005080</td>\n",
              "      <td>-0.000899</td>\n",
              "      <td>-0.005974</td>\n",
              "      <td>0.003520</td>\n",
              "      <td>0.003175</td>\n",
              "      <td>0.006641</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-0.006764</td>\n",
              "      <td>0.001882</td>\n",
              "      <td>-0.036191</td>\n",
              "      <td>0.002636</td>\n",
              "      <td>-0.001556</td>\n",
              "      <td>0.004597</td>\n",
              "      <td>-0.002768</td>\n",
              "      <td>-0.021405</td>\n",
              "      <td>-0.001724</td>\n",
              "      <td>-0.019260</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019-07-09</th>\n",
              "      <td>-0.005282</td>\n",
              "      <td>-0.013158</td>\n",
              "      <td>-0.017005</td>\n",
              "      <td>0.006099</td>\n",
              "      <td>0.004554</td>\n",
              "      <td>-0.001862</td>\n",
              "      <td>0.002123</td>\n",
              "      <td>0.004099</td>\n",
              "      <td>0.004226</td>\n",
              "      <td>0.013056</td>\n",
              "      <td>-0.001673</td>\n",
              "      <td>-0.003230</td>\n",
              "      <td>0.008861</td>\n",
              "      <td>0.008713</td>\n",
              "      <td>0.001831</td>\n",
              "      <td>0.004817</td>\n",
              "      <td>-0.005291</td>\n",
              "      <td>-0.002118</td>\n",
              "      <td>0.009094</td>\n",
              "      <td>0.010189</td>\n",
              "      <td>0.011291</td>\n",
              "      <td>0.001810</td>\n",
              "      <td>0.004316</td>\n",
              "      <td>0.002094</td>\n",
              "      <td>0.006126</td>\n",
              "      <td>0.011644</td>\n",
              "      <td>-0.015306</td>\n",
              "      <td>0.002683</td>\n",
              "      <td>0.003352</td>\n",
              "      <td>0.011968</td>\n",
              "      <td>0.034644</td>\n",
              "      <td>-0.002539</td>\n",
              "      <td>0.009981</td>\n",
              "      <td>-0.003567</td>\n",
              "      <td>0.008451</td>\n",
              "      <td>0.011295</td>\n",
              "      <td>0.018429</td>\n",
              "      <td>-0.005819</td>\n",
              "      <td>-0.002037</td>\n",
              "      <td>0.000408</td>\n",
              "      <td>...</td>\n",
              "      <td>0.004693</td>\n",
              "      <td>0.000059</td>\n",
              "      <td>-0.001864</td>\n",
              "      <td>-0.003866</td>\n",
              "      <td>0.004520</td>\n",
              "      <td>-0.003668</td>\n",
              "      <td>0.008741</td>\n",
              "      <td>0.005753</td>\n",
              "      <td>-0.018108</td>\n",
              "      <td>-0.004777</td>\n",
              "      <td>0.010811</td>\n",
              "      <td>0.005232</td>\n",
              "      <td>0.008533</td>\n",
              "      <td>0.009675</td>\n",
              "      <td>0.003994</td>\n",
              "      <td>-0.015360</td>\n",
              "      <td>-0.021562</td>\n",
              "      <td>-0.000737</td>\n",
              "      <td>0.001263</td>\n",
              "      <td>-0.012019</td>\n",
              "      <td>0.032284</td>\n",
              "      <td>0.004807</td>\n",
              "      <td>0.009852</td>\n",
              "      <td>0.006383</td>\n",
              "      <td>-0.011970</td>\n",
              "      <td>0.002979</td>\n",
              "      <td>0.001027</td>\n",
              "      <td>0.010549</td>\n",
              "      <td>0.001426</td>\n",
              "      <td>0.014742</td>\n",
              "      <td>-0.005297</td>\n",
              "      <td>0.005035</td>\n",
              "      <td>0.002632</td>\n",
              "      <td>0.000657</td>\n",
              "      <td>0.012118</td>\n",
              "      <td>-0.000654</td>\n",
              "      <td>-0.001214</td>\n",
              "      <td>0.008132</td>\n",
              "      <td>0.003998</td>\n",
              "      <td>0.013460</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019-07-10</th>\n",
              "      <td>-0.001089</td>\n",
              "      <td>0.017674</td>\n",
              "      <td>0.005981</td>\n",
              "      <td>0.009889</td>\n",
              "      <td>0.012127</td>\n",
              "      <td>-0.005791</td>\n",
              "      <td>0.001295</td>\n",
              "      <td>0.003245</td>\n",
              "      <td>0.009139</td>\n",
              "      <td>0.006355</td>\n",
              "      <td>0.000718</td>\n",
              "      <td>0.006115</td>\n",
              "      <td>-0.000473</td>\n",
              "      <td>0.008112</td>\n",
              "      <td>0.000522</td>\n",
              "      <td>0.004906</td>\n",
              "      <td>-0.004137</td>\n",
              "      <td>-0.000354</td>\n",
              "      <td>0.001502</td>\n",
              "      <td>0.003782</td>\n",
              "      <td>0.007700</td>\n",
              "      <td>-0.006053</td>\n",
              "      <td>0.001102</td>\n",
              "      <td>0.004548</td>\n",
              "      <td>-0.001841</td>\n",
              "      <td>0.040812</td>\n",
              "      <td>-0.011776</td>\n",
              "      <td>-0.003822</td>\n",
              "      <td>-0.010738</td>\n",
              "      <td>0.017057</td>\n",
              "      <td>0.019306</td>\n",
              "      <td>-0.008742</td>\n",
              "      <td>0.001555</td>\n",
              "      <td>0.003745</td>\n",
              "      <td>-0.012470</td>\n",
              "      <td>0.001041</td>\n",
              "      <td>0.014641</td>\n",
              "      <td>0.013690</td>\n",
              "      <td>0.013232</td>\n",
              "      <td>0.006476</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.048759</td>\n",
              "      <td>-0.000177</td>\n",
              "      <td>-0.001081</td>\n",
              "      <td>-0.007077</td>\n",
              "      <td>-0.003000</td>\n",
              "      <td>0.000460</td>\n",
              "      <td>0.008890</td>\n",
              "      <td>-0.010934</td>\n",
              "      <td>0.000922</td>\n",
              "      <td>0.000960</td>\n",
              "      <td>0.014138</td>\n",
              "      <td>0.004440</td>\n",
              "      <td>0.006391</td>\n",
              "      <td>0.001681</td>\n",
              "      <td>0.006820</td>\n",
              "      <td>0.010459</td>\n",
              "      <td>-0.032155</td>\n",
              "      <td>0.001290</td>\n",
              "      <td>0.001261</td>\n",
              "      <td>0.008818</td>\n",
              "      <td>0.049728</td>\n",
              "      <td>0.005018</td>\n",
              "      <td>0.007201</td>\n",
              "      <td>-0.014165</td>\n",
              "      <td>-0.005042</td>\n",
              "      <td>0.001844</td>\n",
              "      <td>0.006666</td>\n",
              "      <td>0.002784</td>\n",
              "      <td>0.000890</td>\n",
              "      <td>-0.004843</td>\n",
              "      <td>0.000761</td>\n",
              "      <td>-0.025350</td>\n",
              "      <td>-0.000875</td>\n",
              "      <td>0.004598</td>\n",
              "      <td>0.001283</td>\n",
              "      <td>0.014131</td>\n",
              "      <td>-0.004864</td>\n",
              "      <td>-0.013074</td>\n",
              "      <td>0.004435</td>\n",
              "      <td>-0.014152</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019-07-11</th>\n",
              "      <td>-0.022216</td>\n",
              "      <td>0.002742</td>\n",
              "      <td>-0.000895</td>\n",
              "      <td>-0.007282</td>\n",
              "      <td>0.013774</td>\n",
              "      <td>0.040186</td>\n",
              "      <td>0.004585</td>\n",
              "      <td>0.015440</td>\n",
              "      <td>0.002020</td>\n",
              "      <td>-0.000789</td>\n",
              "      <td>-0.001675</td>\n",
              "      <td>0.004072</td>\n",
              "      <td>0.000203</td>\n",
              "      <td>0.003416</td>\n",
              "      <td>0.000391</td>\n",
              "      <td>0.001331</td>\n",
              "      <td>-0.001780</td>\n",
              "      <td>-0.002654</td>\n",
              "      <td>-0.004379</td>\n",
              "      <td>-0.004486</td>\n",
              "      <td>-0.014136</td>\n",
              "      <td>0.000818</td>\n",
              "      <td>0.005723</td>\n",
              "      <td>0.006852</td>\n",
              "      <td>0.001277</td>\n",
              "      <td>-0.014164</td>\n",
              "      <td>0.005879</td>\n",
              "      <td>-0.010646</td>\n",
              "      <td>-0.023157</td>\n",
              "      <td>0.012522</td>\n",
              "      <td>-0.021604</td>\n",
              "      <td>0.000112</td>\n",
              "      <td>0.005100</td>\n",
              "      <td>-0.023427</td>\n",
              "      <td>0.014121</td>\n",
              "      <td>-0.010731</td>\n",
              "      <td>-0.008099</td>\n",
              "      <td>0.008351</td>\n",
              "      <td>0.055432</td>\n",
              "      <td>-0.005979</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.006446</td>\n",
              "      <td>0.012856</td>\n",
              "      <td>0.016827</td>\n",
              "      <td>0.006514</td>\n",
              "      <td>0.005453</td>\n",
              "      <td>0.006823</td>\n",
              "      <td>0.007975</td>\n",
              "      <td>-0.010542</td>\n",
              "      <td>0.011861</td>\n",
              "      <td>0.013747</td>\n",
              "      <td>0.012244</td>\n",
              "      <td>-0.012346</td>\n",
              "      <td>-0.001279</td>\n",
              "      <td>-0.015384</td>\n",
              "      <td>-0.020040</td>\n",
              "      <td>-0.001404</td>\n",
              "      <td>-0.002005</td>\n",
              "      <td>-0.001933</td>\n",
              "      <td>0.000900</td>\n",
              "      <td>0.023047</td>\n",
              "      <td>0.004071</td>\n",
              "      <td>-0.000116</td>\n",
              "      <td>-0.017874</td>\n",
              "      <td>-0.000214</td>\n",
              "      <td>0.003871</td>\n",
              "      <td>0.003527</td>\n",
              "      <td>-0.004584</td>\n",
              "      <td>-0.003817</td>\n",
              "      <td>0.008272</td>\n",
              "      <td>-0.006813</td>\n",
              "      <td>-0.019004</td>\n",
              "      <td>0.002378</td>\n",
              "      <td>-0.038010</td>\n",
              "      <td>0.000327</td>\n",
              "      <td>0.007516</td>\n",
              "      <td>0.000774</td>\n",
              "      <td>-0.009077</td>\n",
              "      <td>-0.015784</td>\n",
              "      <td>0.004686</td>\n",
              "      <td>0.012367</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019-07-12</th>\n",
              "      <td>-0.001255</td>\n",
              "      <td>0.022789</td>\n",
              "      <td>0.014652</td>\n",
              "      <td>0.007683</td>\n",
              "      <td>-0.007511</td>\n",
              "      <td>-0.012778</td>\n",
              "      <td>-0.017905</td>\n",
              "      <td>0.007911</td>\n",
              "      <td>0.005917</td>\n",
              "      <td>0.020014</td>\n",
              "      <td>0.004553</td>\n",
              "      <td>-0.000484</td>\n",
              "      <td>0.011016</td>\n",
              "      <td>0.004962</td>\n",
              "      <td>-0.006781</td>\n",
              "      <td>-0.007424</td>\n",
              "      <td>0.007134</td>\n",
              "      <td>0.009404</td>\n",
              "      <td>-0.000723</td>\n",
              "      <td>0.014239</td>\n",
              "      <td>0.002519</td>\n",
              "      <td>0.013533</td>\n",
              "      <td>0.004924</td>\n",
              "      <td>0.002066</td>\n",
              "      <td>0.029045</td>\n",
              "      <td>0.004671</td>\n",
              "      <td>0.014690</td>\n",
              "      <td>0.007368</td>\n",
              "      <td>-0.005515</td>\n",
              "      <td>0.027164</td>\n",
              "      <td>0.004537</td>\n",
              "      <td>0.015738</td>\n",
              "      <td>-0.013788</td>\n",
              "      <td>-0.017247</td>\n",
              "      <td>0.004820</td>\n",
              "      <td>-0.001338</td>\n",
              "      <td>0.004962</td>\n",
              "      <td>0.004638</td>\n",
              "      <td>0.021719</td>\n",
              "      <td>0.004231</td>\n",
              "      <td>...</td>\n",
              "      <td>0.012975</td>\n",
              "      <td>0.013392</td>\n",
              "      <td>0.024969</td>\n",
              "      <td>0.038148</td>\n",
              "      <td>0.002431</td>\n",
              "      <td>0.018121</td>\n",
              "      <td>-0.002268</td>\n",
              "      <td>-0.002072</td>\n",
              "      <td>0.011494</td>\n",
              "      <td>-0.000315</td>\n",
              "      <td>0.003832</td>\n",
              "      <td>0.001852</td>\n",
              "      <td>0.004849</td>\n",
              "      <td>-0.001250</td>\n",
              "      <td>-0.004608</td>\n",
              "      <td>0.004743</td>\n",
              "      <td>0.032142</td>\n",
              "      <td>0.001291</td>\n",
              "      <td>0.002157</td>\n",
              "      <td>0.019633</td>\n",
              "      <td>0.019167</td>\n",
              "      <td>-0.007548</td>\n",
              "      <td>-0.004931</td>\n",
              "      <td>0.004505</td>\n",
              "      <td>0.026572</td>\n",
              "      <td>0.000611</td>\n",
              "      <td>0.005629</td>\n",
              "      <td>0.004876</td>\n",
              "      <td>0.005999</td>\n",
              "      <td>0.004410</td>\n",
              "      <td>-0.010461</td>\n",
              "      <td>0.024799</td>\n",
              "      <td>0.017298</td>\n",
              "      <td>-0.006374</td>\n",
              "      <td>0.016446</td>\n",
              "      <td>0.000773</td>\n",
              "      <td>0.002818</td>\n",
              "      <td>0.012887</td>\n",
              "      <td>-0.004036</td>\n",
              "      <td>0.011780</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019-07-15</th>\n",
              "      <td>-0.015352</td>\n",
              "      <td>-0.005051</td>\n",
              "      <td>0.002144</td>\n",
              "      <td>0.009395</td>\n",
              "      <td>0.000890</td>\n",
              "      <td>-0.008032</td>\n",
              "      <td>-0.001311</td>\n",
              "      <td>-0.004536</td>\n",
              "      <td>-0.002133</td>\n",
              "      <td>0.007057</td>\n",
              "      <td>-0.004294</td>\n",
              "      <td>-0.000727</td>\n",
              "      <td>0.002807</td>\n",
              "      <td>-0.002756</td>\n",
              "      <td>0.001707</td>\n",
              "      <td>0.010382</td>\n",
              "      <td>0.004132</td>\n",
              "      <td>-0.005625</td>\n",
              "      <td>0.001387</td>\n",
              "      <td>-0.000533</td>\n",
              "      <td>-0.002126</td>\n",
              "      <td>0.005646</td>\n",
              "      <td>0.004247</td>\n",
              "      <td>0.012248</td>\n",
              "      <td>-0.002891</td>\n",
              "      <td>0.001374</td>\n",
              "      <td>-0.013699</td>\n",
              "      <td>0.004619</td>\n",
              "      <td>0.018374</td>\n",
              "      <td>-0.004945</td>\n",
              "      <td>0.035531</td>\n",
              "      <td>-0.000220</td>\n",
              "      <td>-0.008388</td>\n",
              "      <td>0.006803</td>\n",
              "      <td>-0.005663</td>\n",
              "      <td>0.008230</td>\n",
              "      <td>0.004968</td>\n",
              "      <td>-0.006407</td>\n",
              "      <td>-0.011692</td>\n",
              "      <td>0.000305</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.010674</td>\n",
              "      <td>-0.007814</td>\n",
              "      <td>-0.001133</td>\n",
              "      <td>-0.011735</td>\n",
              "      <td>-0.008955</td>\n",
              "      <td>-0.003664</td>\n",
              "      <td>0.001331</td>\n",
              "      <td>0.002818</td>\n",
              "      <td>-0.004950</td>\n",
              "      <td>0.000946</td>\n",
              "      <td>-0.005011</td>\n",
              "      <td>-0.001232</td>\n",
              "      <td>0.006328</td>\n",
              "      <td>0.003299</td>\n",
              "      <td>-0.007523</td>\n",
              "      <td>0.006819</td>\n",
              "      <td>-0.011400</td>\n",
              "      <td>-0.002349</td>\n",
              "      <td>0.002691</td>\n",
              "      <td>-0.006772</td>\n",
              "      <td>-0.011935</td>\n",
              "      <td>0.010296</td>\n",
              "      <td>-0.004012</td>\n",
              "      <td>-0.013666</td>\n",
              "      <td>-0.017211</td>\n",
              "      <td>0.006364</td>\n",
              "      <td>0.001018</td>\n",
              "      <td>-0.001733</td>\n",
              "      <td>0.003332</td>\n",
              "      <td>0.013171</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.028979</td>\n",
              "      <td>-0.044568</td>\n",
              "      <td>0.006250</td>\n",
              "      <td>0.011176</td>\n",
              "      <td>-0.007085</td>\n",
              "      <td>0.002810</td>\n",
              "      <td>-0.010178</td>\n",
              "      <td>0.007924</td>\n",
              "      <td>-0.021777</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019-07-16</th>\n",
              "      <td>-0.008505</td>\n",
              "      <td>0.018214</td>\n",
              "      <td>0.017871</td>\n",
              "      <td>-0.003460</td>\n",
              "      <td>-0.010341</td>\n",
              "      <td>-0.026211</td>\n",
              "      <td>-0.007756</td>\n",
              "      <td>-0.005478</td>\n",
              "      <td>-0.009911</td>\n",
              "      <td>-0.013331</td>\n",
              "      <td>-0.022041</td>\n",
              "      <td>-0.004909</td>\n",
              "      <td>0.004866</td>\n",
              "      <td>-0.015543</td>\n",
              "      <td>-0.000786</td>\n",
              "      <td>-0.007513</td>\n",
              "      <td>0.008230</td>\n",
              "      <td>-0.008132</td>\n",
              "      <td>-0.010959</td>\n",
              "      <td>-0.003734</td>\n",
              "      <td>-0.003293</td>\n",
              "      <td>-0.001426</td>\n",
              "      <td>-0.000325</td>\n",
              "      <td>-0.001198</td>\n",
              "      <td>0.008699</td>\n",
              "      <td>-0.011361</td>\n",
              "      <td>0.032355</td>\n",
              "      <td>0.004407</td>\n",
              "      <td>-0.001788</td>\n",
              "      <td>-0.005834</td>\n",
              "      <td>-0.015702</td>\n",
              "      <td>0.003517</td>\n",
              "      <td>-0.014663</td>\n",
              "      <td>0.007665</td>\n",
              "      <td>0.004020</td>\n",
              "      <td>-0.006597</td>\n",
              "      <td>-0.005487</td>\n",
              "      <td>-0.005595</td>\n",
              "      <td>-0.004693</td>\n",
              "      <td>-0.002283</td>\n",
              "      <td>...</td>\n",
              "      <td>0.007090</td>\n",
              "      <td>0.014245</td>\n",
              "      <td>-0.001701</td>\n",
              "      <td>0.021152</td>\n",
              "      <td>-0.001506</td>\n",
              "      <td>-0.000300</td>\n",
              "      <td>-0.006978</td>\n",
              "      <td>-0.002588</td>\n",
              "      <td>-0.001470</td>\n",
              "      <td>-0.000630</td>\n",
              "      <td>-0.001319</td>\n",
              "      <td>-0.000463</td>\n",
              "      <td>-0.015834</td>\n",
              "      <td>-0.001191</td>\n",
              "      <td>-0.006268</td>\n",
              "      <td>-0.002952</td>\n",
              "      <td>0.017860</td>\n",
              "      <td>-0.008356</td>\n",
              "      <td>-0.001431</td>\n",
              "      <td>-0.000723</td>\n",
              "      <td>-0.057650</td>\n",
              "      <td>-0.002432</td>\n",
              "      <td>0.002843</td>\n",
              "      <td>-0.030093</td>\n",
              "      <td>0.032453</td>\n",
              "      <td>-0.000911</td>\n",
              "      <td>0.001186</td>\n",
              "      <td>-0.020833</td>\n",
              "      <td>-0.001923</td>\n",
              "      <td>-0.011555</td>\n",
              "      <td>0.007831</td>\n",
              "      <td>0.011396</td>\n",
              "      <td>-0.034657</td>\n",
              "      <td>-0.002942</td>\n",
              "      <td>-0.003547</td>\n",
              "      <td>-0.014920</td>\n",
              "      <td>-0.010860</td>\n",
              "      <td>0.008569</td>\n",
              "      <td>-0.003484</td>\n",
              "      <td>0.002645</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019-07-17</th>\n",
              "      <td>-0.005147</td>\n",
              "      <td>-0.028152</td>\n",
              "      <td>-0.025284</td>\n",
              "      <td>-0.005623</td>\n",
              "      <td>-0.039775</td>\n",
              "      <td>0.024867</td>\n",
              "      <td>0.031265</td>\n",
              "      <td>-0.002265</td>\n",
              "      <td>0.012071</td>\n",
              "      <td>-0.013165</td>\n",
              "      <td>-0.012494</td>\n",
              "      <td>0.007247</td>\n",
              "      <td>-0.000066</td>\n",
              "      <td>0.003567</td>\n",
              "      <td>0.006690</td>\n",
              "      <td>0.005677</td>\n",
              "      <td>0.020991</td>\n",
              "      <td>-0.008376</td>\n",
              "      <td>-0.010958</td>\n",
              "      <td>-0.011779</td>\n",
              "      <td>-0.008939</td>\n",
              "      <td>-0.003213</td>\n",
              "      <td>-0.002603</td>\n",
              "      <td>0.005518</td>\n",
              "      <td>-0.005613</td>\n",
              "      <td>0.010104</td>\n",
              "      <td>-0.024920</td>\n",
              "      <td>-0.018216</td>\n",
              "      <td>0.004804</td>\n",
              "      <td>0.004564</td>\n",
              "      <td>-0.007386</td>\n",
              "      <td>-0.022125</td>\n",
              "      <td>-0.027129</td>\n",
              "      <td>-0.002310</td>\n",
              "      <td>-0.016016</td>\n",
              "      <td>-0.002723</td>\n",
              "      <td>-0.008891</td>\n",
              "      <td>-0.000191</td>\n",
              "      <td>-0.002357</td>\n",
              "      <td>-0.011748</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.008571</td>\n",
              "      <td>-0.060520</td>\n",
              "      <td>-0.032005</td>\n",
              "      <td>-0.044335</td>\n",
              "      <td>0.022247</td>\n",
              "      <td>-0.023200</td>\n",
              "      <td>-0.000892</td>\n",
              "      <td>-0.000371</td>\n",
              "      <td>-0.021175</td>\n",
              "      <td>-0.021129</td>\n",
              "      <td>-0.011526</td>\n",
              "      <td>-0.006789</td>\n",
              "      <td>-0.002666</td>\n",
              "      <td>0.005563</td>\n",
              "      <td>0.006308</td>\n",
              "      <td>-0.003310</td>\n",
              "      <td>-0.024869</td>\n",
              "      <td>-0.009311</td>\n",
              "      <td>-0.023114</td>\n",
              "      <td>-0.007409</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.008823</td>\n",
              "      <td>-0.001772</td>\n",
              "      <td>-0.002009</td>\n",
              "      <td>0.004240</td>\n",
              "      <td>-0.012456</td>\n",
              "      <td>0.000169</td>\n",
              "      <td>-0.017021</td>\n",
              "      <td>-0.001401</td>\n",
              "      <td>-0.006819</td>\n",
              "      <td>-0.017094</td>\n",
              "      <td>-0.024760</td>\n",
              "      <td>-0.034349</td>\n",
              "      <td>0.004590</td>\n",
              "      <td>-0.002649</td>\n",
              "      <td>-0.005927</td>\n",
              "      <td>0.008146</td>\n",
              "      <td>-0.012744</td>\n",
              "      <td>0.002062</td>\n",
              "      <td>-0.013410</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019-07-18</th>\n",
              "      <td>0.007760</td>\n",
              "      <td>0.014484</td>\n",
              "      <td>0.001459</td>\n",
              "      <td>0.011360</td>\n",
              "      <td>0.015212</td>\n",
              "      <td>0.010421</td>\n",
              "      <td>0.023321</td>\n",
              "      <td>0.005211</td>\n",
              "      <td>0.002230</td>\n",
              "      <td>0.018167</td>\n",
              "      <td>-0.003721</td>\n",
              "      <td>0.014390</td>\n",
              "      <td>0.048162</td>\n",
              "      <td>0.004428</td>\n",
              "      <td>0.005473</td>\n",
              "      <td>0.008081</td>\n",
              "      <td>-0.006853</td>\n",
              "      <td>0.008807</td>\n",
              "      <td>-0.002524</td>\n",
              "      <td>0.004154</td>\n",
              "      <td>0.000588</td>\n",
              "      <td>0.002507</td>\n",
              "      <td>0.001088</td>\n",
              "      <td>-0.003937</td>\n",
              "      <td>0.004956</td>\n",
              "      <td>-0.001902</td>\n",
              "      <td>0.009094</td>\n",
              "      <td>0.002526</td>\n",
              "      <td>-0.001215</td>\n",
              "      <td>0.042190</td>\n",
              "      <td>-0.017857</td>\n",
              "      <td>-0.004256</td>\n",
              "      <td>0.030357</td>\n",
              "      <td>0.014007</td>\n",
              "      <td>0.010783</td>\n",
              "      <td>-0.000383</td>\n",
              "      <td>-0.007093</td>\n",
              "      <td>-0.010205</td>\n",
              "      <td>-0.000394</td>\n",
              "      <td>0.011682</td>\n",
              "      <td>...</td>\n",
              "      <td>0.003396</td>\n",
              "      <td>0.058949</td>\n",
              "      <td>0.005576</td>\n",
              "      <td>-0.078941</td>\n",
              "      <td>0.017890</td>\n",
              "      <td>0.009224</td>\n",
              "      <td>0.007703</td>\n",
              "      <td>0.003782</td>\n",
              "      <td>0.008329</td>\n",
              "      <td>-0.014820</td>\n",
              "      <td>0.001336</td>\n",
              "      <td>0.000155</td>\n",
              "      <td>-0.009956</td>\n",
              "      <td>0.005363</td>\n",
              "      <td>0.004373</td>\n",
              "      <td>-0.000175</td>\n",
              "      <td>-0.016294</td>\n",
              "      <td>0.009398</td>\n",
              "      <td>0.005503</td>\n",
              "      <td>0.001215</td>\n",
              "      <td>0.026996</td>\n",
              "      <td>0.010932</td>\n",
              "      <td>0.004142</td>\n",
              "      <td>0.013420</td>\n",
              "      <td>0.007909</td>\n",
              "      <td>0.013690</td>\n",
              "      <td>-0.001861</td>\n",
              "      <td>-0.005772</td>\n",
              "      <td>0.001052</td>\n",
              "      <td>0.005885</td>\n",
              "      <td>-0.007905</td>\n",
              "      <td>-0.005887</td>\n",
              "      <td>-0.013666</td>\n",
              "      <td>0.010607</td>\n",
              "      <td>0.016184</td>\n",
              "      <td>-0.008479</td>\n",
              "      <td>0.001230</td>\n",
              "      <td>0.009753</td>\n",
              "      <td>0.011542</td>\n",
              "      <td>0.014706</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019-07-19</th>\n",
              "      <td>-0.020391</td>\n",
              "      <td>-0.019631</td>\n",
              "      <td>-0.006143</td>\n",
              "      <td>-0.014928</td>\n",
              "      <td>-0.014292</td>\n",
              "      <td>-0.008753</td>\n",
              "      <td>-0.003077</td>\n",
              "      <td>-0.004568</td>\n",
              "      <td>-0.010352</td>\n",
              "      <td>-0.001983</td>\n",
              "      <td>0.002241</td>\n",
              "      <td>-0.007808</td>\n",
              "      <td>-0.040759</td>\n",
              "      <td>-0.017809</td>\n",
              "      <td>-0.015293</td>\n",
              "      <td>-0.016032</td>\n",
              "      <td>-0.017826</td>\n",
              "      <td>-0.020132</td>\n",
              "      <td>0.006850</td>\n",
              "      <td>0.006115</td>\n",
              "      <td>-0.027631</td>\n",
              "      <td>-0.007323</td>\n",
              "      <td>-0.002607</td>\n",
              "      <td>-0.000599</td>\n",
              "      <td>0.020137</td>\n",
              "      <td>-0.007623</td>\n",
              "      <td>-0.013518</td>\n",
              "      <td>-0.017345</td>\n",
              "      <td>-0.019958</td>\n",
              "      <td>-0.007474</td>\n",
              "      <td>-0.014848</td>\n",
              "      <td>-0.002137</td>\n",
              "      <td>0.005139</td>\n",
              "      <td>-0.006405</td>\n",
              "      <td>-0.009461</td>\n",
              "      <td>-0.014857</td>\n",
              "      <td>-0.006765</td>\n",
              "      <td>0.002602</td>\n",
              "      <td>-0.008044</td>\n",
              "      <td>-0.010784</td>\n",
              "      <td>...</td>\n",
              "      <td>0.004923</td>\n",
              "      <td>0.006026</td>\n",
              "      <td>0.004961</td>\n",
              "      <td>-0.017587</td>\n",
              "      <td>-0.003443</td>\n",
              "      <td>0.008302</td>\n",
              "      <td>-0.007146</td>\n",
              "      <td>-0.018913</td>\n",
              "      <td>0.002065</td>\n",
              "      <td>-0.002943</td>\n",
              "      <td>0.003518</td>\n",
              "      <td>-0.017397</td>\n",
              "      <td>-0.002747</td>\n",
              "      <td>-0.022236</td>\n",
              "      <td>-0.028737</td>\n",
              "      <td>-0.010837</td>\n",
              "      <td>0.007490</td>\n",
              "      <td>-0.005074</td>\n",
              "      <td>-0.006932</td>\n",
              "      <td>-0.005305</td>\n",
              "      <td>-0.007943</td>\n",
              "      <td>-0.017530</td>\n",
              "      <td>-0.021214</td>\n",
              "      <td>0.004635</td>\n",
              "      <td>-0.014563</td>\n",
              "      <td>-0.009206</td>\n",
              "      <td>-0.010003</td>\n",
              "      <td>0.000363</td>\n",
              "      <td>-0.007183</td>\n",
              "      <td>-0.005363</td>\n",
              "      <td>-0.000398</td>\n",
              "      <td>-0.003257</td>\n",
              "      <td>0.006724</td>\n",
              "      <td>-0.018731</td>\n",
              "      <td>-0.001307</td>\n",
              "      <td>0.002004</td>\n",
              "      <td>-0.005789</td>\n",
              "      <td>-0.025852</td>\n",
              "      <td>-0.004688</td>\n",
              "      <td>0.012297</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019-07-22</th>\n",
              "      <td>0.005677</td>\n",
              "      <td>-0.005461</td>\n",
              "      <td>0.012553</td>\n",
              "      <td>0.022854</td>\n",
              "      <td>-0.005496</td>\n",
              "      <td>0.013437</td>\n",
              "      <td>0.006629</td>\n",
              "      <td>0.002630</td>\n",
              "      <td>0.005475</td>\n",
              "      <td>0.016670</td>\n",
              "      <td>0.003230</td>\n",
              "      <td>0.004085</td>\n",
              "      <td>0.007786</td>\n",
              "      <td>0.006202</td>\n",
              "      <td>0.003948</td>\n",
              "      <td>-0.001786</td>\n",
              "      <td>-0.009368</td>\n",
              "      <td>0.001091</td>\n",
              "      <td>-0.003248</td>\n",
              "      <td>-0.001073</td>\n",
              "      <td>-0.003426</td>\n",
              "      <td>0.003418</td>\n",
              "      <td>-0.006100</td>\n",
              "      <td>-0.009467</td>\n",
              "      <td>-0.017322</td>\n",
              "      <td>-0.023968</td>\n",
              "      <td>-0.009765</td>\n",
              "      <td>-0.001972</td>\n",
              "      <td>0.012583</td>\n",
              "      <td>0.061075</td>\n",
              "      <td>0.010458</td>\n",
              "      <td>-0.001127</td>\n",
              "      <td>-0.004772</td>\n",
              "      <td>-0.014014</td>\n",
              "      <td>-0.005554</td>\n",
              "      <td>0.005546</td>\n",
              "      <td>0.010746</td>\n",
              "      <td>0.016338</td>\n",
              "      <td>-0.001125</td>\n",
              "      <td>-0.003908</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.015309</td>\n",
              "      <td>-0.009812</td>\n",
              "      <td>0.006776</td>\n",
              "      <td>-0.007312</td>\n",
              "      <td>0.006000</td>\n",
              "      <td>0.004230</td>\n",
              "      <td>0.007420</td>\n",
              "      <td>-0.004744</td>\n",
              "      <td>-0.005725</td>\n",
              "      <td>-0.015415</td>\n",
              "      <td>0.008340</td>\n",
              "      <td>-0.014543</td>\n",
              "      <td>0.008076</td>\n",
              "      <td>-0.000287</td>\n",
              "      <td>0.005529</td>\n",
              "      <td>-0.019261</td>\n",
              "      <td>0.005575</td>\n",
              "      <td>0.010715</td>\n",
              "      <td>-0.009184</td>\n",
              "      <td>-0.005577</td>\n",
              "      <td>0.054327</td>\n",
              "      <td>-0.000348</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.009666</td>\n",
              "      <td>0.001080</td>\n",
              "      <td>-0.001225</td>\n",
              "      <td>0.002911</td>\n",
              "      <td>0.001814</td>\n",
              "      <td>-0.009441</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.001993</td>\n",
              "      <td>-0.006238</td>\n",
              "      <td>0.004250</td>\n",
              "      <td>-0.000987</td>\n",
              "      <td>0.012430</td>\n",
              "      <td>0.001067</td>\n",
              "      <td>-0.007764</td>\n",
              "      <td>-0.007582</td>\n",
              "      <td>0.006665</td>\n",
              "      <td>-0.018872</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019-07-23</th>\n",
              "      <td>0.011579</td>\n",
              "      <td>0.025320</td>\n",
              "      <td>-0.007930</td>\n",
              "      <td>0.007818</td>\n",
              "      <td>0.008936</td>\n",
              "      <td>0.002652</td>\n",
              "      <td>0.007608</td>\n",
              "      <td>0.000103</td>\n",
              "      <td>-0.002171</td>\n",
              "      <td>0.018775</td>\n",
              "      <td>0.003962</td>\n",
              "      <td>0.004607</td>\n",
              "      <td>0.015320</td>\n",
              "      <td>-0.003639</td>\n",
              "      <td>-0.000655</td>\n",
              "      <td>-0.006819</td>\n",
              "      <td>-0.013002</td>\n",
              "      <td>0.002361</td>\n",
              "      <td>-0.004550</td>\n",
              "      <td>0.007337</td>\n",
              "      <td>0.005865</td>\n",
              "      <td>0.008607</td>\n",
              "      <td>0.007671</td>\n",
              "      <td>0.006533</td>\n",
              "      <td>0.019131</td>\n",
              "      <td>-0.005502</td>\n",
              "      <td>0.035470</td>\n",
              "      <td>0.002964</td>\n",
              "      <td>0.000818</td>\n",
              "      <td>0.005914</td>\n",
              "      <td>0.019482</td>\n",
              "      <td>0.013430</td>\n",
              "      <td>0.024201</td>\n",
              "      <td>0.000682</td>\n",
              "      <td>0.008514</td>\n",
              "      <td>0.000484</td>\n",
              "      <td>0.004462</td>\n",
              "      <td>0.008227</td>\n",
              "      <td>0.002684</td>\n",
              "      <td>0.002839</td>\n",
              "      <td>...</td>\n",
              "      <td>0.018035</td>\n",
              "      <td>-0.002074</td>\n",
              "      <td>0.012114</td>\n",
              "      <td>0.031750</td>\n",
              "      <td>0.012651</td>\n",
              "      <td>0.014968</td>\n",
              "      <td>0.001828</td>\n",
              "      <td>0.005977</td>\n",
              "      <td>0.016467</td>\n",
              "      <td>0.000999</td>\n",
              "      <td>0.005035</td>\n",
              "      <td>0.010908</td>\n",
              "      <td>-0.000926</td>\n",
              "      <td>0.006664</td>\n",
              "      <td>0.011443</td>\n",
              "      <td>-0.000360</td>\n",
              "      <td>0.021751</td>\n",
              "      <td>0.012036</td>\n",
              "      <td>0.013163</td>\n",
              "      <td>0.005398</td>\n",
              "      <td>0.012114</td>\n",
              "      <td>-0.006027</td>\n",
              "      <td>0.008067</td>\n",
              "      <td>0.015448</td>\n",
              "      <td>-0.039636</td>\n",
              "      <td>0.005111</td>\n",
              "      <td>0.000512</td>\n",
              "      <td>-0.011224</td>\n",
              "      <td>-0.006502</td>\n",
              "      <td>0.012745</td>\n",
              "      <td>0.009149</td>\n",
              "      <td>0.033331</td>\n",
              "      <td>0.014712</td>\n",
              "      <td>-0.004942</td>\n",
              "      <td>0.024556</td>\n",
              "      <td>0.003996</td>\n",
              "      <td>0.004980</td>\n",
              "      <td>0.020276</td>\n",
              "      <td>-0.003178</td>\n",
              "      <td>-0.053062</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019-07-24</th>\n",
              "      <td>-0.004436</td>\n",
              "      <td>0.025588</td>\n",
              "      <td>0.005455</td>\n",
              "      <td>-0.000814</td>\n",
              "      <td>0.012586</td>\n",
              "      <td>0.042581</td>\n",
              "      <td>-0.001690</td>\n",
              "      <td>0.000051</td>\n",
              "      <td>0.007763</td>\n",
              "      <td>0.039360</td>\n",
              "      <td>0.000740</td>\n",
              "      <td>-0.004169</td>\n",
              "      <td>0.014573</td>\n",
              "      <td>0.022210</td>\n",
              "      <td>0.002624</td>\n",
              "      <td>0.001126</td>\n",
              "      <td>0.002395</td>\n",
              "      <td>-0.023011</td>\n",
              "      <td>-0.005621</td>\n",
              "      <td>0.019542</td>\n",
              "      <td>-0.002614</td>\n",
              "      <td>0.011556</td>\n",
              "      <td>0.004568</td>\n",
              "      <td>0.002644</td>\n",
              "      <td>0.012738</td>\n",
              "      <td>0.008060</td>\n",
              "      <td>0.007220</td>\n",
              "      <td>0.005615</td>\n",
              "      <td>-0.011844</td>\n",
              "      <td>0.021752</td>\n",
              "      <td>0.018513</td>\n",
              "      <td>0.002004</td>\n",
              "      <td>0.016719</td>\n",
              "      <td>-0.001364</td>\n",
              "      <td>0.015939</td>\n",
              "      <td>-0.009720</td>\n",
              "      <td>0.003169</td>\n",
              "      <td>0.008019</td>\n",
              "      <td>-0.045210</td>\n",
              "      <td>0.006074</td>\n",
              "      <td>...</td>\n",
              "      <td>0.003054</td>\n",
              "      <td>0.006639</td>\n",
              "      <td>0.086634</td>\n",
              "      <td>0.039143</td>\n",
              "      <td>0.009995</td>\n",
              "      <td>-0.005113</td>\n",
              "      <td>0.013433</td>\n",
              "      <td>0.006393</td>\n",
              "      <td>0.012009</td>\n",
              "      <td>0.023627</td>\n",
              "      <td>0.016579</td>\n",
              "      <td>0.003332</td>\n",
              "      <td>0.005099</td>\n",
              "      <td>-0.010842</td>\n",
              "      <td>-0.002645</td>\n",
              "      <td>0.008832</td>\n",
              "      <td>0.014053</td>\n",
              "      <td>-0.000503</td>\n",
              "      <td>0.010064</td>\n",
              "      <td>0.016875</td>\n",
              "      <td>0.024652</td>\n",
              "      <td>0.000466</td>\n",
              "      <td>-0.007525</td>\n",
              "      <td>0.026570</td>\n",
              "      <td>0.028778</td>\n",
              "      <td>0.002746</td>\n",
              "      <td>-0.011861</td>\n",
              "      <td>-0.015013</td>\n",
              "      <td>-0.000807</td>\n",
              "      <td>0.010649</td>\n",
              "      <td>0.006701</td>\n",
              "      <td>0.018876</td>\n",
              "      <td>0.002979</td>\n",
              "      <td>0.000828</td>\n",
              "      <td>0.038158</td>\n",
              "      <td>-0.000133</td>\n",
              "      <td>0.001593</td>\n",
              "      <td>0.010657</td>\n",
              "      <td>-0.002303</td>\n",
              "      <td>0.015877</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019-07-25</th>\n",
              "      <td>0.003880</td>\n",
              "      <td>-0.084421</td>\n",
              "      <td>-0.053438</td>\n",
              "      <td>-0.007907</td>\n",
              "      <td>-0.011048</td>\n",
              "      <td>-0.013517</td>\n",
              "      <td>-0.006660</td>\n",
              "      <td>0.002571</td>\n",
              "      <td>-0.004963</td>\n",
              "      <td>-0.019737</td>\n",
              "      <td>0.002711</td>\n",
              "      <td>-0.000897</td>\n",
              "      <td>-0.004449</td>\n",
              "      <td>-0.020690</td>\n",
              "      <td>-0.002355</td>\n",
              "      <td>-0.005959</td>\n",
              "      <td>0.001792</td>\n",
              "      <td>-0.002782</td>\n",
              "      <td>-0.005777</td>\n",
              "      <td>-0.005402</td>\n",
              "      <td>0.000806</td>\n",
              "      <td>-0.003866</td>\n",
              "      <td>-0.005630</td>\n",
              "      <td>-0.008631</td>\n",
              "      <td>-0.012181</td>\n",
              "      <td>-0.269879</td>\n",
              "      <td>-0.026079</td>\n",
              "      <td>-0.000392</td>\n",
              "      <td>-0.024304</td>\n",
              "      <td>-0.025316</td>\n",
              "      <td>-0.012899</td>\n",
              "      <td>-0.008335</td>\n",
              "      <td>-0.024446</td>\n",
              "      <td>-0.009444</td>\n",
              "      <td>-0.029650</td>\n",
              "      <td>0.003076</td>\n",
              "      <td>-0.013490</td>\n",
              "      <td>-0.007955</td>\n",
              "      <td>0.017445</td>\n",
              "      <td>0.004912</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.009440</td>\n",
              "      <td>-0.006653</td>\n",
              "      <td>0.033744</td>\n",
              "      <td>0.008766</td>\n",
              "      <td>-0.000530</td>\n",
              "      <td>0.015717</td>\n",
              "      <td>-0.009491</td>\n",
              "      <td>-0.095060</td>\n",
              "      <td>0.000112</td>\n",
              "      <td>0.002276</td>\n",
              "      <td>-0.031679</td>\n",
              "      <td>-0.004745</td>\n",
              "      <td>-0.004566</td>\n",
              "      <td>-0.021807</td>\n",
              "      <td>-0.005745</td>\n",
              "      <td>0.006968</td>\n",
              "      <td>-0.017426</td>\n",
              "      <td>-0.001144</td>\n",
              "      <td>-0.007971</td>\n",
              "      <td>-0.019098</td>\n",
              "      <td>-0.006799</td>\n",
              "      <td>0.000699</td>\n",
              "      <td>-0.005536</td>\n",
              "      <td>-0.007514</td>\n",
              "      <td>0.002866</td>\n",
              "      <td>-0.002688</td>\n",
              "      <td>0.007945</td>\n",
              "      <td>-0.021561</td>\n",
              "      <td>0.001974</td>\n",
              "      <td>-0.001916</td>\n",
              "      <td>-0.018403</td>\n",
              "      <td>-0.021224</td>\n",
              "      <td>-0.041386</td>\n",
              "      <td>-0.004466</td>\n",
              "      <td>-0.034402</td>\n",
              "      <td>-0.005706</td>\n",
              "      <td>-0.013251</td>\n",
              "      <td>-0.015674</td>\n",
              "      <td>0.002042</td>\n",
              "      <td>0.017008</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019-07-26</th>\n",
              "      <td>-0.005011</td>\n",
              "      <td>-0.013625</td>\n",
              "      <td>0.017263</td>\n",
              "      <td>0.003478</td>\n",
              "      <td>0.002211</td>\n",
              "      <td>0.001653</td>\n",
              "      <td>-0.002841</td>\n",
              "      <td>0.010053</td>\n",
              "      <td>0.008227</td>\n",
              "      <td>-0.003110</td>\n",
              "      <td>-0.002212</td>\n",
              "      <td>0.013229</td>\n",
              "      <td>0.014236</td>\n",
              "      <td>-0.011358</td>\n",
              "      <td>0.004459</td>\n",
              "      <td>-0.001357</td>\n",
              "      <td>0.001789</td>\n",
              "      <td>0.002232</td>\n",
              "      <td>0.005811</td>\n",
              "      <td>0.003329</td>\n",
              "      <td>0.003827</td>\n",
              "      <td>0.009351</td>\n",
              "      <td>0.005226</td>\n",
              "      <td>0.014752</td>\n",
              "      <td>-0.000402</td>\n",
              "      <td>-0.010254</td>\n",
              "      <td>0.016599</td>\n",
              "      <td>0.008722</td>\n",
              "      <td>-0.028806</td>\n",
              "      <td>-0.001574</td>\n",
              "      <td>0.010395</td>\n",
              "      <td>0.000560</td>\n",
              "      <td>0.007978</td>\n",
              "      <td>0.007064</td>\n",
              "      <td>0.020143</td>\n",
              "      <td>-0.004041</td>\n",
              "      <td>-0.015589</td>\n",
              "      <td>-0.000422</td>\n",
              "      <td>0.020514</td>\n",
              "      <td>-0.011609</td>\n",
              "      <td>...</td>\n",
              "      <td>0.013833</td>\n",
              "      <td>0.005889</td>\n",
              "      <td>0.019704</td>\n",
              "      <td>-0.001018</td>\n",
              "      <td>0.014498</td>\n",
              "      <td>-0.005353</td>\n",
              "      <td>0.011565</td>\n",
              "      <td>-0.002725</td>\n",
              "      <td>-0.008171</td>\n",
              "      <td>0.004541</td>\n",
              "      <td>0.010420</td>\n",
              "      <td>0.005244</td>\n",
              "      <td>0.003382</td>\n",
              "      <td>-0.016100</td>\n",
              "      <td>-0.006816</td>\n",
              "      <td>0.012775</td>\n",
              "      <td>0.001676</td>\n",
              "      <td>-0.002841</td>\n",
              "      <td>0.005296</td>\n",
              "      <td>0.015800</td>\n",
              "      <td>-0.008250</td>\n",
              "      <td>0.009317</td>\n",
              "      <td>0.006051</td>\n",
              "      <td>0.025237</td>\n",
              "      <td>0.013266</td>\n",
              "      <td>0.012865</td>\n",
              "      <td>0.015250</td>\n",
              "      <td>-0.045213</td>\n",
              "      <td>0.007164</td>\n",
              "      <td>0.011036</td>\n",
              "      <td>0.045473</td>\n",
              "      <td>0.011168</td>\n",
              "      <td>-0.003718</td>\n",
              "      <td>0.005316</td>\n",
              "      <td>-0.053480</td>\n",
              "      <td>-0.001601</td>\n",
              "      <td>0.003044</td>\n",
              "      <td>-0.003185</td>\n",
              "      <td>0.010010</td>\n",
              "      <td>0.020565</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019-07-29</th>\n",
              "      <td>0.012518</td>\n",
              "      <td>-0.016062</td>\n",
              "      <td>0.002752</td>\n",
              "      <td>0.009339</td>\n",
              "      <td>0.012889</td>\n",
              "      <td>0.011993</td>\n",
              "      <td>0.009117</td>\n",
              "      <td>0.002133</td>\n",
              "      <td>-0.013011</td>\n",
              "      <td>-0.004844</td>\n",
              "      <td>0.007637</td>\n",
              "      <td>-0.008035</td>\n",
              "      <td>-0.008309</td>\n",
              "      <td>-0.031073</td>\n",
              "      <td>0.003395</td>\n",
              "      <td>0.008835</td>\n",
              "      <td>0.007143</td>\n",
              "      <td>-0.017257</td>\n",
              "      <td>-0.000062</td>\n",
              "      <td>-0.013794</td>\n",
              "      <td>0.008226</td>\n",
              "      <td>-0.008740</td>\n",
              "      <td>-0.003574</td>\n",
              "      <td>-0.004766</td>\n",
              "      <td>-0.019979</td>\n",
              "      <td>-0.014031</td>\n",
              "      <td>-0.014633</td>\n",
              "      <td>-0.010881</td>\n",
              "      <td>-0.019803</td>\n",
              "      <td>-0.001380</td>\n",
              "      <td>-0.015873</td>\n",
              "      <td>-0.008177</td>\n",
              "      <td>-0.037793</td>\n",
              "      <td>0.004220</td>\n",
              "      <td>-0.001276</td>\n",
              "      <td>0.004790</td>\n",
              "      <td>-0.015748</td>\n",
              "      <td>-0.011682</td>\n",
              "      <td>-0.005534</td>\n",
              "      <td>0.006285</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.014554</td>\n",
              "      <td>0.018768</td>\n",
              "      <td>-0.015177</td>\n",
              "      <td>0.010814</td>\n",
              "      <td>-0.005577</td>\n",
              "      <td>0.000664</td>\n",
              "      <td>-0.002613</td>\n",
              "      <td>-0.009026</td>\n",
              "      <td>-0.003160</td>\n",
              "      <td>0.000323</td>\n",
              "      <td>-0.003358</td>\n",
              "      <td>0.004900</td>\n",
              "      <td>-0.004802</td>\n",
              "      <td>-0.003596</td>\n",
              "      <td>0.007758</td>\n",
              "      <td>0.005081</td>\n",
              "      <td>-0.010316</td>\n",
              "      <td>0.006938</td>\n",
              "      <td>0.001272</td>\n",
              "      <td>0.009911</td>\n",
              "      <td>-0.012566</td>\n",
              "      <td>0.009693</td>\n",
              "      <td>0.006977</td>\n",
              "      <td>-0.020718</td>\n",
              "      <td>0.000470</td>\n",
              "      <td>0.000904</td>\n",
              "      <td>-0.004557</td>\n",
              "      <td>-0.013530</td>\n",
              "      <td>-0.006668</td>\n",
              "      <td>0.003322</td>\n",
              "      <td>-0.014117</td>\n",
              "      <td>-0.008320</td>\n",
              "      <td>-0.004147</td>\n",
              "      <td>0.007767</td>\n",
              "      <td>-0.001828</td>\n",
              "      <td>0.007085</td>\n",
              "      <td>0.006248</td>\n",
              "      <td>-0.014232</td>\n",
              "      <td>0.000702</td>\n",
              "      <td>-0.011293</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019-07-30</th>\n",
              "      <td>-0.003126</td>\n",
              "      <td>-0.000979</td>\n",
              "      <td>-0.008102</td>\n",
              "      <td>-0.004292</td>\n",
              "      <td>0.017081</td>\n",
              "      <td>0.011960</td>\n",
              "      <td>-0.002710</td>\n",
              "      <td>-0.008614</td>\n",
              "      <td>-0.011653</td>\n",
              "      <td>-0.002063</td>\n",
              "      <td>0.001222</td>\n",
              "      <td>-0.017331</td>\n",
              "      <td>0.001396</td>\n",
              "      <td>-0.015236</td>\n",
              "      <td>-0.008328</td>\n",
              "      <td>-0.011339</td>\n",
              "      <td>0.005319</td>\n",
              "      <td>-0.001511</td>\n",
              "      <td>-0.000621</td>\n",
              "      <td>-0.002833</td>\n",
              "      <td>-0.004378</td>\n",
              "      <td>0.010492</td>\n",
              "      <td>-0.002065</td>\n",
              "      <td>0.006106</td>\n",
              "      <td>0.006978</td>\n",
              "      <td>0.036725</td>\n",
              "      <td>0.000625</td>\n",
              "      <td>0.000196</td>\n",
              "      <td>0.018601</td>\n",
              "      <td>0.001184</td>\n",
              "      <td>0.011649</td>\n",
              "      <td>0.024845</td>\n",
              "      <td>0.001506</td>\n",
              "      <td>0.002101</td>\n",
              "      <td>-0.008069</td>\n",
              "      <td>0.014983</td>\n",
              "      <td>-0.007279</td>\n",
              "      <td>-0.013576</td>\n",
              "      <td>0.004425</td>\n",
              "      <td>-0.013361</td>\n",
              "      <td>...</td>\n",
              "      <td>0.009231</td>\n",
              "      <td>0.010141</td>\n",
              "      <td>0.008926</td>\n",
              "      <td>0.007442</td>\n",
              "      <td>0.001402</td>\n",
              "      <td>-0.003095</td>\n",
              "      <td>-0.009170</td>\n",
              "      <td>-0.006434</td>\n",
              "      <td>-0.001925</td>\n",
              "      <td>-0.000646</td>\n",
              "      <td>0.009024</td>\n",
              "      <td>0.004247</td>\n",
              "      <td>-0.007470</td>\n",
              "      <td>0.019912</td>\n",
              "      <td>0.002221</td>\n",
              "      <td>-0.012899</td>\n",
              "      <td>0.094520</td>\n",
              "      <td>-0.026558</td>\n",
              "      <td>0.005080</td>\n",
              "      <td>-0.004430</td>\n",
              "      <td>0.014339</td>\n",
              "      <td>-0.009600</td>\n",
              "      <td>0.002867</td>\n",
              "      <td>0.005656</td>\n",
              "      <td>0.011677</td>\n",
              "      <td>-0.009380</td>\n",
              "      <td>0.000424</td>\n",
              "      <td>0.009278</td>\n",
              "      <td>-0.001880</td>\n",
              "      <td>-0.011353</td>\n",
              "      <td>0.009675</td>\n",
              "      <td>-0.019238</td>\n",
              "      <td>0.063086</td>\n",
              "      <td>-0.006396</td>\n",
              "      <td>-0.008574</td>\n",
              "      <td>0.000133</td>\n",
              "      <td>0.005322</td>\n",
              "      <td>-0.034178</td>\n",
              "      <td>-0.007537</td>\n",
              "      <td>0.018589</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019-07-31</th>\n",
              "      <td>-0.010549</td>\n",
              "      <td>-0.006536</td>\n",
              "      <td>-0.007642</td>\n",
              "      <td>0.020404</td>\n",
              "      <td>-0.017696</td>\n",
              "      <td>-0.002399</td>\n",
              "      <td>-0.013702</td>\n",
              "      <td>-0.015691</td>\n",
              "      <td>-0.015742</td>\n",
              "      <td>-0.028935</td>\n",
              "      <td>0.003175</td>\n",
              "      <td>0.009212</td>\n",
              "      <td>-0.005388</td>\n",
              "      <td>-0.025703</td>\n",
              "      <td>-0.006823</td>\n",
              "      <td>-0.010334</td>\n",
              "      <td>-0.012934</td>\n",
              "      <td>-0.004539</td>\n",
              "      <td>-0.002300</td>\n",
              "      <td>-0.005859</td>\n",
              "      <td>-0.009794</td>\n",
              "      <td>-0.010907</td>\n",
              "      <td>-0.015031</td>\n",
              "      <td>0.048792</td>\n",
              "      <td>-0.008696</td>\n",
              "      <td>0.028684</td>\n",
              "      <td>-0.010155</td>\n",
              "      <td>0.054699</td>\n",
              "      <td>-0.010135</td>\n",
              "      <td>-0.026809</td>\n",
              "      <td>-0.100974</td>\n",
              "      <td>-0.012562</td>\n",
              "      <td>-0.011453</td>\n",
              "      <td>0.057410</td>\n",
              "      <td>-0.020338</td>\n",
              "      <td>0.014234</td>\n",
              "      <td>-0.016723</td>\n",
              "      <td>-0.022522</td>\n",
              "      <td>-0.016787</td>\n",
              "      <td>-0.018056</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.025915</td>\n",
              "      <td>0.003625</td>\n",
              "      <td>-0.002838</td>\n",
              "      <td>-0.026164</td>\n",
              "      <td>0.000175</td>\n",
              "      <td>-0.012565</td>\n",
              "      <td>-0.019446</td>\n",
              "      <td>-0.012868</td>\n",
              "      <td>-0.008734</td>\n",
              "      <td>-0.019703</td>\n",
              "      <td>0.005485</td>\n",
              "      <td>-0.002976</td>\n",
              "      <td>-0.013275</td>\n",
              "      <td>-0.017223</td>\n",
              "      <td>-0.006056</td>\n",
              "      <td>-0.024016</td>\n",
              "      <td>-0.001802</td>\n",
              "      <td>-0.012938</td>\n",
              "      <td>-0.016426</td>\n",
              "      <td>-0.016873</td>\n",
              "      <td>-0.047712</td>\n",
              "      <td>-0.013847</td>\n",
              "      <td>-0.009887</td>\n",
              "      <td>-0.002916</td>\n",
              "      <td>-0.034959</td>\n",
              "      <td>-0.011494</td>\n",
              "      <td>-0.008559</td>\n",
              "      <td>-0.015188</td>\n",
              "      <td>-0.014976</td>\n",
              "      <td>0.004785</td>\n",
              "      <td>-0.026064</td>\n",
              "      <td>-0.040852</td>\n",
              "      <td>-0.007638</td>\n",
              "      <td>-0.016174</td>\n",
              "      <td>-0.044332</td>\n",
              "      <td>-0.013139</td>\n",
              "      <td>-0.039174</td>\n",
              "      <td>-0.020744</td>\n",
              "      <td>-0.006358</td>\n",
              "      <td>-0.009015</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019-08-01</th>\n",
              "      <td>-0.002881</td>\n",
              "      <td>-0.021711</td>\n",
              "      <td>-0.004580</td>\n",
              "      <td>-0.021639</td>\n",
              "      <td>0.052209</td>\n",
              "      <td>-0.264539</td>\n",
              "      <td>-0.011711</td>\n",
              "      <td>0.008204</td>\n",
              "      <td>-0.001405</td>\n",
              "      <td>-0.025541</td>\n",
              "      <td>0.001704</td>\n",
              "      <td>-0.013332</td>\n",
              "      <td>-0.005608</td>\n",
              "      <td>-0.017289</td>\n",
              "      <td>0.012551</td>\n",
              "      <td>0.011474</td>\n",
              "      <td>0.030375</td>\n",
              "      <td>-0.006269</td>\n",
              "      <td>0.002555</td>\n",
              "      <td>-0.022861</td>\n",
              "      <td>0.000404</td>\n",
              "      <td>-0.014203</td>\n",
              "      <td>-0.005087</td>\n",
              "      <td>0.022467</td>\n",
              "      <td>-0.046190</td>\n",
              "      <td>-0.032189</td>\n",
              "      <td>-0.003472</td>\n",
              "      <td>-0.023464</td>\n",
              "      <td>0.014300</td>\n",
              "      <td>-0.018230</td>\n",
              "      <td>-0.019376</td>\n",
              "      <td>-0.014396</td>\n",
              "      <td>-0.035576</td>\n",
              "      <td>-0.003109</td>\n",
              "      <td>-0.034046</td>\n",
              "      <td>-0.000992</td>\n",
              "      <td>-0.006139</td>\n",
              "      <td>-0.009403</td>\n",
              "      <td>-0.005635</td>\n",
              "      <td>0.003804</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.063850</td>\n",
              "      <td>-0.027452</td>\n",
              "      <td>-0.020842</td>\n",
              "      <td>-0.044804</td>\n",
              "      <td>-0.025547</td>\n",
              "      <td>-0.013174</td>\n",
              "      <td>0.006573</td>\n",
              "      <td>0.011246</td>\n",
              "      <td>-0.046001</td>\n",
              "      <td>-0.014168</td>\n",
              "      <td>-0.010674</td>\n",
              "      <td>-0.012412</td>\n",
              "      <td>0.008101</td>\n",
              "      <td>0.076041</td>\n",
              "      <td>0.005647</td>\n",
              "      <td>-0.000181</td>\n",
              "      <td>-0.022176</td>\n",
              "      <td>0.005699</td>\n",
              "      <td>-0.007708</td>\n",
              "      <td>-0.009956</td>\n",
              "      <td>0.030061</td>\n",
              "      <td>0.020126</td>\n",
              "      <td>0.006978</td>\n",
              "      <td>-0.027784</td>\n",
              "      <td>-0.038218</td>\n",
              "      <td>0.004200</td>\n",
              "      <td>-0.006410</td>\n",
              "      <td>0.035714</td>\n",
              "      <td>-0.009104</td>\n",
              "      <td>0.004286</td>\n",
              "      <td>-0.014955</td>\n",
              "      <td>-0.054970</td>\n",
              "      <td>-0.068088</td>\n",
              "      <td>0.019292</td>\n",
              "      <td>-0.006589</td>\n",
              "      <td>-0.025551</td>\n",
              "      <td>-0.020018</td>\n",
              "      <td>-0.014330</td>\n",
              "      <td>0.039282</td>\n",
              "      <td>-0.047260</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019-08-02</th>\n",
              "      <td>-0.016327</td>\n",
              "      <td>-0.013114</td>\n",
              "      <td>-0.027809</td>\n",
              "      <td>-0.021158</td>\n",
              "      <td>-0.013740</td>\n",
              "      <td>-0.020745</td>\n",
              "      <td>-0.003020</td>\n",
              "      <td>-0.005923</td>\n",
              "      <td>-0.015849</td>\n",
              "      <td>-0.015551</td>\n",
              "      <td>-0.026245</td>\n",
              "      <td>-0.000183</td>\n",
              "      <td>-0.001794</td>\n",
              "      <td>-0.037206</td>\n",
              "      <td>-0.011743</td>\n",
              "      <td>-0.001248</td>\n",
              "      <td>-0.027168</td>\n",
              "      <td>0.004206</td>\n",
              "      <td>0.000684</td>\n",
              "      <td>-0.006946</td>\n",
              "      <td>0.013519</td>\n",
              "      <td>-0.005996</td>\n",
              "      <td>0.001223</td>\n",
              "      <td>-0.019865</td>\n",
              "      <td>-0.013077</td>\n",
              "      <td>-0.014678</td>\n",
              "      <td>0.002059</td>\n",
              "      <td>-0.003528</td>\n",
              "      <td>-0.022365</td>\n",
              "      <td>-0.018981</td>\n",
              "      <td>-0.014066</td>\n",
              "      <td>-0.020607</td>\n",
              "      <td>-0.019536</td>\n",
              "      <td>0.006559</td>\n",
              "      <td>-0.030733</td>\n",
              "      <td>0.019204</td>\n",
              "      <td>-0.017291</td>\n",
              "      <td>-0.029124</td>\n",
              "      <td>-0.008124</td>\n",
              "      <td>0.005632</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.007355</td>\n",
              "      <td>-0.008514</td>\n",
              "      <td>0.001881</td>\n",
              "      <td>-0.029782</td>\n",
              "      <td>-0.004669</td>\n",
              "      <td>-0.007812</td>\n",
              "      <td>-0.009767</td>\n",
              "      <td>-0.020052</td>\n",
              "      <td>-0.007077</td>\n",
              "      <td>-0.004679</td>\n",
              "      <td>-0.026972</td>\n",
              "      <td>-0.000159</td>\n",
              "      <td>-0.015648</td>\n",
              "      <td>-0.005020</td>\n",
              "      <td>0.017142</td>\n",
              "      <td>0.005972</td>\n",
              "      <td>-0.008175</td>\n",
              "      <td>-0.010578</td>\n",
              "      <td>-0.007213</td>\n",
              "      <td>-0.003938</td>\n",
              "      <td>-0.020177</td>\n",
              "      <td>-0.007112</td>\n",
              "      <td>0.012664</td>\n",
              "      <td>0.007950</td>\n",
              "      <td>-0.031018</td>\n",
              "      <td>-0.003367</td>\n",
              "      <td>0.004129</td>\n",
              "      <td>-0.019984</td>\n",
              "      <td>0.000184</td>\n",
              "      <td>0.034614</td>\n",
              "      <td>0.002797</td>\n",
              "      <td>-0.026196</td>\n",
              "      <td>-0.012071</td>\n",
              "      <td>-0.015471</td>\n",
              "      <td>-0.028920</td>\n",
              "      <td>-0.009799</td>\n",
              "      <td>-0.010682</td>\n",
              "      <td>-0.033502</td>\n",
              "      <td>0.003506</td>\n",
              "      <td>-0.009082</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019-08-05</th>\n",
              "      <td>-0.032609</td>\n",
              "      <td>-0.031346</td>\n",
              "      <td>-0.017972</td>\n",
              "      <td>-0.052348</td>\n",
              "      <td>-0.019239</td>\n",
              "      <td>0.019490</td>\n",
              "      <td>-0.030995</td>\n",
              "      <td>-0.038651</td>\n",
              "      <td>-0.045453</td>\n",
              "      <td>-0.044817</td>\n",
              "      <td>-0.057150</td>\n",
              "      <td>-0.027516</td>\n",
              "      <td>-0.023305</td>\n",
              "      <td>-0.028357</td>\n",
              "      <td>-0.009110</td>\n",
              "      <td>-0.007724</td>\n",
              "      <td>-0.030303</td>\n",
              "      <td>-0.022273</td>\n",
              "      <td>-0.002422</td>\n",
              "      <td>-0.027977</td>\n",
              "      <td>-0.028668</td>\n",
              "      <td>-0.026467</td>\n",
              "      <td>-0.040298</td>\n",
              "      <td>-0.048800</td>\n",
              "      <td>-0.047612</td>\n",
              "      <td>-0.055221</td>\n",
              "      <td>-0.027659</td>\n",
              "      <td>-0.026122</td>\n",
              "      <td>-0.039523</td>\n",
              "      <td>-0.043954</td>\n",
              "      <td>-0.049253</td>\n",
              "      <td>-0.027977</td>\n",
              "      <td>-0.026238</td>\n",
              "      <td>-0.030552</td>\n",
              "      <td>-0.035846</td>\n",
              "      <td>-0.007286</td>\n",
              "      <td>-0.031872</td>\n",
              "      <td>-0.026619</td>\n",
              "      <td>-0.023919</td>\n",
              "      <td>-0.040777</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.033681</td>\n",
              "      <td>-0.038497</td>\n",
              "      <td>-0.020051</td>\n",
              "      <td>-0.033510</td>\n",
              "      <td>-0.042937</td>\n",
              "      <td>-0.038682</td>\n",
              "      <td>-0.048247</td>\n",
              "      <td>-0.040237</td>\n",
              "      <td>-0.028026</td>\n",
              "      <td>-0.016118</td>\n",
              "      <td>-0.066404</td>\n",
              "      <td>-0.028799</td>\n",
              "      <td>-0.043777</td>\n",
              "      <td>-0.015864</td>\n",
              "      <td>-0.013947</td>\n",
              "      <td>-0.006656</td>\n",
              "      <td>-0.037756</td>\n",
              "      <td>-0.024866</td>\n",
              "      <td>-0.033718</td>\n",
              "      <td>-0.030748</td>\n",
              "      <td>-0.030153</td>\n",
              "      <td>0.005430</td>\n",
              "      <td>0.000944</td>\n",
              "      <td>-0.027286</td>\n",
              "      <td>-0.017849</td>\n",
              "      <td>-0.034139</td>\n",
              "      <td>-0.025358</td>\n",
              "      <td>-0.049180</td>\n",
              "      <td>-0.032703</td>\n",
              "      <td>-0.035289</td>\n",
              "      <td>-0.025100</td>\n",
              "      <td>-0.071846</td>\n",
              "      <td>-0.037085</td>\n",
              "      <td>-0.003176</td>\n",
              "      <td>-0.028780</td>\n",
              "      <td>-0.020488</td>\n",
              "      <td>-0.024626</td>\n",
              "      <td>-0.040549</td>\n",
              "      <td>-0.019429</td>\n",
              "      <td>-0.032197</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2019-08-06</th>\n",
              "      <td>0.027331</td>\n",
              "      <td>-0.002462</td>\n",
              "      <td>0.017323</td>\n",
              "      <td>0.018930</td>\n",
              "      <td>-0.051747</td>\n",
              "      <td>-0.019801</td>\n",
              "      <td>0.020443</td>\n",
              "      <td>0.017569</td>\n",
              "      <td>0.020866</td>\n",
              "      <td>0.015330</td>\n",
              "      <td>-0.009529</td>\n",
              "      <td>0.022786</td>\n",
              "      <td>0.008874</td>\n",
              "      <td>0.000697</td>\n",
              "      <td>-0.000666</td>\n",
              "      <td>0.012706</td>\n",
              "      <td>-0.037990</td>\n",
              "      <td>0.013045</td>\n",
              "      <td>-0.007097</td>\n",
              "      <td>0.029729</td>\n",
              "      <td>0.025825</td>\n",
              "      <td>0.013778</td>\n",
              "      <td>0.024407</td>\n",
              "      <td>0.022735</td>\n",
              "      <td>0.000612</td>\n",
              "      <td>0.000372</td>\n",
              "      <td>0.015442</td>\n",
              "      <td>0.020534</td>\n",
              "      <td>0.013809</td>\n",
              "      <td>0.019138</td>\n",
              "      <td>0.031083</td>\n",
              "      <td>0.019743</td>\n",
              "      <td>0.028470</td>\n",
              "      <td>0.016309</td>\n",
              "      <td>0.021617</td>\n",
              "      <td>0.014259</td>\n",
              "      <td>0.012860</td>\n",
              "      <td>0.043071</td>\n",
              "      <td>0.026162</td>\n",
              "      <td>0.022592</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.001394</td>\n",
              "      <td>0.008931</td>\n",
              "      <td>0.001306</td>\n",
              "      <td>0.009087</td>\n",
              "      <td>0.009614</td>\n",
              "      <td>0.024254</td>\n",
              "      <td>0.021438</td>\n",
              "      <td>0.009137</td>\n",
              "      <td>0.014666</td>\n",
              "      <td>0.012287</td>\n",
              "      <td>0.013988</td>\n",
              "      <td>-0.002785</td>\n",
              "      <td>0.020270</td>\n",
              "      <td>0.007861</td>\n",
              "      <td>0.013113</td>\n",
              "      <td>-0.003079</td>\n",
              "      <td>0.008980</td>\n",
              "      <td>0.025941</td>\n",
              "      <td>-0.008097</td>\n",
              "      <td>0.008086</td>\n",
              "      <td>0.015735</td>\n",
              "      <td>0.009882</td>\n",
              "      <td>0.006719</td>\n",
              "      <td>0.017094</td>\n",
              "      <td>0.023656</td>\n",
              "      <td>0.028827</td>\n",
              "      <td>0.020480</td>\n",
              "      <td>-0.010513</td>\n",
              "      <td>0.013675</td>\n",
              "      <td>0.015677</td>\n",
              "      <td>-0.004495</td>\n",
              "      <td>0.006931</td>\n",
              "      <td>-0.021594</td>\n",
              "      <td>0.013416</td>\n",
              "      <td>-0.009190</td>\n",
              "      <td>0.009676</td>\n",
              "      <td>0.002525</td>\n",
              "      <td>-0.001704</td>\n",
              "      <td>0.008517</td>\n",
              "      <td>0.020398</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>2515 rows × 450 columns</p>\n",
              "</div>"
            ],
            "text/plain": [
              "                   A       AAL       AAP  ...       XRX       YUM      ZION\n",
              "Date                                      ...                              \n",
              "2009-08-10  0.004439 -0.045902 -0.019243  ...  0.034362 -0.000981  0.051298\n",
              "2009-08-11  0.002525 -0.051546 -0.018060  ... -0.034347 -0.038310 -0.083133\n",
              "2009-08-12  0.020151  0.047101  0.008856  ...  0.008163  0.002043 -0.012484\n",
              "2009-08-13  0.008642  0.027682 -0.051767  ...  0.002313 -0.003058  0.038589\n",
              "2009-08-14 -0.022032 -0.016835 -0.002611  ... -0.006924 -0.004601  0.005766\n",
              "2009-08-17 -0.020025 -0.054795 -0.001904  ... -0.038931 -0.012327 -0.059873\n",
              "2009-08-18  0.078544  0.007246  0.000715  ...  0.010883  0.010400  0.027100\n",
              "2009-08-19 -0.006513 -0.014388  0.014296  ...  0.023325  0.002059  0.018470\n",
              "2009-08-20  0.002980  0.043796 -0.014329  ... -0.016949  0.009759  0.053756\n",
              "2009-08-21  0.008913  0.045455  0.002145  ...  0.020809  0.021363  0.036878\n",
              "2009-08-24 -0.001767  0.013378 -0.014031  ...  0.012813 -0.024402 -0.035566\n",
              "2009-08-25 -0.006490  0.082508  0.010130  ...  0.018976  0.000510 -0.000615\n",
              "2009-08-26  0.005344  0.088415 -0.006686  ...  0.000000 -0.004082 -0.007995\n",
              "2009-08-27  0.002363 -0.030812  0.008654  ...  0.013544 -0.003586  0.001240\n",
              "2009-08-28  0.011786 -0.020231  0.000715  ...  0.005568  0.000514  0.039009\n",
              "2009-08-31 -0.005824 -0.047198 -0.019052  ... -0.026578 -0.019013 -0.024434\n",
              "2009-09-01  0.006444 -0.117647 -0.017966  ... -0.022184 -0.015715 -0.070250\n",
              "2009-09-02 -0.024447  0.042105 -0.000989  ... -0.013962 -0.010644 -0.009198\n",
              "2009-09-03  0.002983  0.040404  0.002970  ...  0.010619  0.006455  0.006631\n",
              "2009-09-04  0.022606  0.038835 -0.010116  ...  0.025102  0.013896  0.021080\n",
              "2009-09-08  0.020942  0.012461  0.007228  ...  0.000000  0.004744 -0.040000\n",
              "2009-09-09  0.027920  0.046154  0.001237  ...  0.025057 -0.017314  0.006720\n",
              "2009-09-10  0.026053  0.123529 -0.022739  ...  0.057778 -0.002136 -0.014686\n",
              "2009-09-11  0.007023  0.002618 -0.035913  ... -0.021534 -0.003745 -0.002710\n",
              "2009-09-14  0.001609  0.023499  0.013379  ... -0.001074  0.001611  0.029212\n",
              "2009-09-15  0.008034  0.066327 -0.016309  ...  0.043525  0.004826  0.107591\n",
              "2009-09-16  0.011158 -0.004785 -0.006316  ...  0.001545  0.011740  0.065554\n",
              "2009-09-17 -0.005255  0.170673 -0.001854  ... -0.006684  0.005274 -0.053691\n",
              "2009-09-18 -0.004226 -0.028747  0.014858  ... -0.003106  0.015740  0.007092\n",
              "2009-09-21  0.015915  0.088795  0.021176  ... -0.004154 -0.026860 -0.011150\n",
              "...              ...       ...       ...  ...       ...       ...       ...\n",
              "2019-06-25 -0.008633 -0.017660  0.014245  ... -0.001736 -0.003163 -0.002947\n",
              "2019-06-26 -0.005114  0.006421 -0.029579  ...  0.015648 -0.001722  0.008866\n",
              "2019-06-27  0.014587  0.022010  0.011872  ...  0.007989  0.003996  0.013970\n",
              "2019-06-28  0.020266  0.014357  0.016017  ...  0.002264  0.000995  0.021778\n",
              "2019-07-01  0.017045  0.008000  0.015895  ...  0.023440 -0.010662  0.007612\n",
              "2019-07-02 -0.002243 -0.020757  0.020436  ... -0.016556  0.012878 -0.031945\n",
              "2019-07-03  0.015739  0.016521  0.005257  ...  0.023569  0.000721  0.011594\n",
              "2019-07-05 -0.013672 -0.007973 -0.000062  ... -0.001096 -0.006668  0.018514\n",
              "2019-07-08 -0.025215  0.010201 -0.015129  ... -0.021405 -0.001724 -0.019260\n",
              "2019-07-09 -0.005282 -0.013158 -0.017005  ...  0.008132  0.003998  0.013460\n",
              "2019-07-10 -0.001089  0.017674  0.005981  ... -0.013074  0.004435 -0.014152\n",
              "2019-07-11 -0.022216  0.002742 -0.000895  ... -0.015784  0.004686  0.012367\n",
              "2019-07-12 -0.001255  0.022789  0.014652  ...  0.012887 -0.004036  0.011780\n",
              "2019-07-15 -0.015352 -0.005051  0.002144  ... -0.010178  0.007924 -0.021777\n",
              "2019-07-16 -0.008505  0.018214  0.017871  ...  0.008569 -0.003484  0.002645\n",
              "2019-07-17 -0.005147 -0.028152 -0.025284  ... -0.012744  0.002062 -0.013410\n",
              "2019-07-18  0.007760  0.014484  0.001459  ...  0.009753  0.011542  0.014706\n",
              "2019-07-19 -0.020391 -0.019631 -0.006143  ... -0.025852 -0.004688  0.012297\n",
              "2019-07-22  0.005677 -0.005461  0.012553  ... -0.007582  0.006665 -0.018872\n",
              "2019-07-23  0.011579  0.025320 -0.007930  ...  0.020276 -0.003178 -0.053062\n",
              "2019-07-24 -0.004436  0.025588  0.005455  ...  0.010657 -0.002303  0.015877\n",
              "2019-07-25  0.003880 -0.084421 -0.053438  ... -0.015674  0.002042  0.017008\n",
              "2019-07-26 -0.005011 -0.013625  0.017263  ... -0.003185  0.010010  0.020565\n",
              "2019-07-29  0.012518 -0.016062  0.002752  ... -0.014232  0.000702 -0.011293\n",
              "2019-07-30 -0.003126 -0.000979 -0.008102  ... -0.034178 -0.007537  0.018589\n",
              "2019-07-31 -0.010549 -0.006536 -0.007642  ... -0.020744 -0.006358 -0.009015\n",
              "2019-08-01 -0.002881 -0.021711 -0.004580  ... -0.014330  0.039282 -0.047260\n",
              "2019-08-02 -0.016327 -0.013114 -0.027809  ... -0.033502  0.003506 -0.009082\n",
              "2019-08-05 -0.032609 -0.031346 -0.017972  ... -0.040549 -0.019429 -0.032197\n",
              "2019-08-06  0.027331 -0.002462  0.017323  ... -0.001704  0.008517  0.020398\n",
              "\n",
              "[2515 rows x 450 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 96
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "scrolled": false,
        "id": "AIWsULBv8TPH",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 34
        },
        "outputId": "952428bc-ce98-411b-d027-8fccfd28dafb"
      },
      "source": [
        "# y data\n",
        "h = yf.download('IPL.TO',start='2009-08-07',end='2019-08-07')\n",
        "h = h[['Adj Close']]\n",
        "rety = h.pct_change().dropna()"
      ],
      "execution_count": 196,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "\r[*********************100%***********************]  1 of 1 downloaded\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "60yU4K6s8TPQ",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 34
        },
        "outputId": "81382a99-f2bf-4314-b7d0-286b5bdbd86d"
      },
      "source": [
        "target = pd.DataFrame({'y':np.where(rety['Adj Close'] >= 0, 1, -1)}, index = rety.index)\n",
        "target.shape"
      ],
      "execution_count": 201,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "(2507, 1)"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 201
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "PRQGeMUZ7UhS",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "forindex = pd.concat([target,ret],axis=1).dropna()\n",
        "\n",
        "y = forindex['y']\n",
        "x = forindex.drop(columns='y')"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "3nb0IKV780EP",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 34
        },
        "outputId": "ee79bc54-d35a-4803-c9c4-7ca4518ffb14"
      },
      "source": [
        "len(y), len(x)"
      ],
      "execution_count": 203,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "(2463, 2463)"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 203
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "2Slk4R3E8TPT",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "from sklearn.model_selection import train_test_split\n",
        "X_train, X_test, y_train, y_test = train_test_split(x, y, random_state=33, shuffle=False, test_size=0.2)"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "1FkbP4u5GQwo",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "from sklearn.metrics import accuracy_score\n",
        "from sklearn.metrics import confusion_matrix\n",
        "from sklearn.metrics import classification_report\n"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "yeRzrnMHGdD1",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "from sklearn.model_selection import GridSearchCV"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "P8ADq-cdGgHU",
        "colab_type": "text"
      },
      "source": [
        "## SVM"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "26L4Z0z3GfCO",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "from sklearn.svm import SVC"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "XioxHptjGzC0",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 71
        },
        "outputId": "73b6c04a-18fa-477f-8921-61ebec3bf177"
      },
      "source": [
        "svc = SVC(kernel='rbf', class_weight='balanced')\n",
        "svc = svc.fit(X_train,y_train)"
      ],
      "execution_count": 211,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "/usr/local/lib/python3.6/dist-packages/sklearn/svm/base.py:193: FutureWarning: The default value of gamma will change from 'auto' to 'scale' in version 0.22 to account better for unscaled features. Set gamma explicitly to 'auto' or 'scale' to avoid this warning.\n",
            "  \"avoid this warning.\", FutureWarning)\n"
          ],
          "name": "stderr"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "KV33LM5kGzaS",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "yfit_svc = svc.predict(X_test)"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "u_SP1LskJJOy",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 34
        },
        "outputId": "73040b7e-248a-4dbf-e456-9a305669ad5c"
      },
      "source": [
        "svc_score = accuracy_score(y_test, yfit_svc)\n",
        "svc_score"
      ],
      "execution_count": 213,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "0.5618661257606491"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 213
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "BuElZe4bJbzA",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 283
        },
        "outputId": "6282eeaf-4d09-4c92-d526-f59141c6c503"
      },
      "source": [
        "mat = confusion_matrix(y_test, yfit_svc)\n",
        "sns.heatmap(mat , annot=True)\n",
        "plt.xlabel('predicted label')\n",
        "plt.ylabel('true label');"
      ],
      "execution_count": 214,
      "outputs": [
        {
          "output_type": "display_data",
          "data": {
            "image/png": "iVBORw0KGgoAAAANSUhEUgAAAW4AAAEKCAYAAAAyx7/DAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4zLCBo\ndHRwOi8vbWF0cGxvdGxpYi5vcmcvnQurowAAHT9JREFUeJzt3XmclWX9//HXe1YGZBFxYdE0RXMJ\nCQ019ZsLKmK5Ze6hQk4Kpaa5kFsuuOTW11wxUcy91DI1Ff1q5BYaEoLgD9JUEEUl9m2Wz++Pc6NH\nYGbODHPmzD28nz3ux5xz3de5ruvU9JmLz33d162IwMzM0qOo0AMwM7PGceA2M0sZB24zs5Rx4DYz\nSxkHbjOzlHHgNjNLGQduM7OUceA2M0sZB24zs5QpKfQA6lL12bu+pdNWU9Fjz0IPwVqh6hWztLZt\nNCbmlHb7+lr3tzY84zYzS5lWO+M2M2tRtTWFHkHOHLjNzABqqgs9gpw5cJuZARG1hR5Czhy4zcwA\nah24zczSxTNuM7OU8cVJM7OU8YzbzCxdwqtKzMxSxhcnzcxSxqkSM7OU8cVJM7OU8YzbzCxlfHHS\nzCxlfHHSzCxdIpzjNjNLF+e4zcxSxqkSM7OU8YzbzCxlaqoKPYKcOXCbmYFTJWZmqeNUiZlZynjG\nbWaWMg7cZmbpEim6OFlU6AGYmbUKUZv70QBJoyXNkTR5DefOkhSSuiXvJelGSTMkTZLUr6H2HbjN\nzCCTKsn1aNjdwMBVCyVtCuwPfJBVfCDQOzkqgVsbatyB28wMmnXGHRHjgLlrOHUDcA4QWWWHAPdE\nxmtAF0nd62vfOW4zM8j7xUlJhwCzIuJfkrJP9QQ+zHo/MymbXVdbDtxmZtCoddySKsmkNVYaFRGj\n6qnfHvglmTTJWnPgNjMDqM79QQpJkK4zUK/BlsAWwMrZdi9ggqT+wCxg06y6vZKyOjnHbWYGzZrj\nXq3piLciYqOI2DwiNieTDukXER8DjwODk9UluwLzI6LONAk4cJuZZTTjqhJJDwCvAttImilpaD3V\nnwLeBWYAdwDDGmrfqRIzM2jWvUoi4pgGzm+e9TqA4Y1p34HbzAx8y7uZWep4d0Azs5RpxKqSQnPg\nNjMDiGi4TivhwG1mBs5xm5mljgO3mVnK+OKkmVnK1NQUegQ5c+A2MwOnSszMUseB28wsZZzjNjNL\nl6j1Om4zs3RxqsTMLGW8qsTMLGU84163XXDF9Yx7eTxd1+/Cn+69bbXz4ydM4rTzLqFn900AGPDd\n73DqkOPWqs8VK1Yw4rLrePud6XTp3IlrLx1Bz+4b88r4CfzmtruoqqqmtLSEs4YPZZed+q5VX9by\nTj/tZIYMOYaIYPLkaQz98Zl8Z7edufrqCykrK2XChLc4ufIsalI0a2x1UhS4/QScPDh00H7cdv3l\n9dbpt+MOPDLmZh4Zc3Ojgvas2Z9w4k/PWa380SeepVPH9fjrw6P50VGHcv0towFYv0snbrr6Vzz2\n+1sZecFZjLj02sZ9GSu4Hj024afDh7DLroPo+619KS4u5pijD2X0nb/huOOH0fdb+/LBBzMZ/KMf\nFnqo6RaR+1FgeQvckr4h6VxJNybHuZK2zVd/rcnOfb9J504dm/TZvzzzfxz949P5wQnDueTXN+Y8\ng/q/v7/KIYMGALD/Xnvyj39OJCLYduut2GjDDQDYaouvsWz5clasWNGksVnhlJSUUFHRjuLiYtpX\nVLB4yVJWrFjB9OnvAvDcc+M4/LBBBR5lyjXjo8vyLS+BW9K5wIOAgPHJIeABSeflo8+0+dfkqRx+\nwjBOOetCZrz7PgD//s8HPP383/j9bdfxyJibKSoq4olnX8ipvTmffs4mG3UDoKSkmPU6tGfe/AVf\nqTP2xZfYbputKCsra94vY3n10Ucfc/0Nt/Hev8cz84M3mb9gAX/4w+OUlJSwU78+ABx++EH02rRH\ngUeacrWR+1Fg+cpxDwW2j4iq7EJJ1wNTgKvy1G8qbLfNlox9ZAzt21cw7pXxnDbiUp566E7+8cZE\n3p42g6OHng7A8uXL6bp+FwBOG3Epsz76hKrqKmZ/8ik/OCHziLrjjzyEww7av8E+Z7z7PtffMppR\nN4zM3xezvOjSpTMHf/8Attp6V+bNW8BDD97OscceznHHD+O6a39FeXkZY58bR01N4WeCqZai6wP5\nCty1QA/g/VXKuyfn1khSJVAJcMt1l/PjwfU+bzO11uvQ4YvX//Od/lx+3c38d958IoKDDxzAz089\nabXP3HjlRUAmx33+yOu4+6Zff+X8RhtuwMdzPmOTjTakurqGRYuX0KVzJwA+nvMpp//yMq648Bds\n1suzsrTZd989ee8/H/DZZ3MBeOxPf2W3XXfm/vsfZa99DgdgvwH/Q+/eXy/kMFMvWkEKJFf5ynGf\nATwv6a+SRiXH08DzwOl1fSgiRkXEzhGxc1sN2gCffT6XSC5wvPX2O9RG0KVzJ3bduS9jX3yJz/87\nD4D5Cxby0cef5NTm3nvsyp+feg6AZ1/8O7vstCOSWLBwEcPOvpgzTjmJfn22z88Xsrz68INZ7LJL\nPyoq2gGwz957MG3adDZMrl2UlZVx9i+GM2rU7ws5zPRb11MlEfG0pK2B/kDPpHgW8HpEpOffI010\n9sVX8fqbk5g3bwH7Hno8w4b+iOrkeXZHHXYQz77wEg899iTFJcW0KyvjmkvOQxJbbvE1fnbyYCrP\nOJ/aqKW0pITzzxxGj002brDPw793ACMuu4YDjxxC504dueaSzKWEBx75Cx/O/Ijb7rqf2+66H4BR\nvxnJBkkKxlq/8a+/yaOPPsnr45+hurqaiROncMfv7uOyS85h0EEDKCoq4vbb7+GFF18u9FDTLUV7\nlShawdKWNan67N3WOTArqIoeexZ6CNYKVa+YpbVtY/Glx+UcczpcdN9a97c2fAOOmRlAdXqSAQ7c\nZmaQqlSJA7eZGbSKi465cuA2M8PLAc3M0qcZlwNKGi1pjqTJWWWXSZokaaKkZyX1SMqVbAsyIznf\nr6H2HbjNzKC513HfDQxcpeyaiOgTEX2BJ4CLkvIDgd7JUQnc2lDjTpWYmUGz3vIeEeMkbb5KWfbm\nQR2AlX8BDgHuicza7NckdZHUPSJm19W+A7eZGS3zzElJI4HBwHxg76S4J/BhVrWZSVmdgdupEjMz\naFSqRFKlpDeyjspcuoiI8yNiU+A+4KdNHapn3GZm0Kh9tiNiFDBqLXq7D3gKuJjMdiCbZp3rlZTV\nyTNuMzPI+yZTknpnvT0EmJa8fhwYnKwu2RWYX19+GzzjNjPLaMYct6QHgL2AbpJmkplZD5K0DZmt\nrd8HTkmqPwUMAmYAS4DV93VehQO3mRkQzfggiohY077Ud9ZRN4DhjWnfgdvMDHzLu5lZ2rTEcsDm\n4sBtZgaecZuZpU569phy4DYzA4jq9ERuB24zM/CM28wsbXxx0swsbTzjNjNLF8+4zczSxjNuM7N0\niepCjyB3DtxmZkB4xm1mljIO3GZm6eIZt5lZyrSJwC1pIV8+hVjJz0heR0R0yvPYzMxaTNSo4Uqt\nRJ2BOyI6tuRAzMwKKU0z7pyeOSlpD0knJa+7Sdoiv8MyM2tZUaucj0JrMMct6WJgZ2Ab4C6gDLgX\n2D2/QzMzazlpmnHncnHyMOBbwASAiPhIktMoZtamRBR+Jp2rXAL3iogISQEgqUOex2Rm1uLa2oz7\nYUm3A10knQwMAe7I77DMzFpWbVtYVbJSRFwraT9gAbA1cFFEjM37yMzMWlBruOiYq1xvwHkLqCCz\njvut/A3HzKww0hS4G1wOKOnHwHjgcOAI4DVJQ/I9MDOzlhSR+1Foucy4zwa+FRGfA0jaAHgFGJ3P\ngZmZtaQ0zbhzCdyfAwuz3i9MyszM2ow2sRxQ0pnJyxnAPyT9mUyO+xBgUguMzcysxdSkaFVJfTnu\njsnxb+BPfLnh1J+B9/I8LjOzFhWhnI+GSBotaY6kyVll10iaJmmSpMckdck6N0LSDEnvSDqgofbr\n22Tqkhy+q5lZm9DMOe67gZuAe7LKxgIjIqJa0tXACOBcSdsBRwPbAz2A5yRtHRE1dTWey14lGwLn\nJI22W1keEfs0/ruYmbVOzblaJCLGSdp8lbJns96+RmaVHmTSzw9GxHLgPUkzgP7Aq3W1n8vugPcB\n04AtgEuA/wCv5zZ8M7N0aOHdAYcAf01e9wQ+zDo3MymrUy6Be4OIuBOoioi/RcQQwLNtM2tTamqL\ncj4kVUp6I+uozLUfSecD1WQmxU2Sy3LAquTnbEkHAR8BXZvaoZlZa9SYVElEjAJGNbYPSScC3wP2\njfiix1nAplnVeiVldcolcF8uqTNwFvBboBPw88YO2MysNavN8zpuSQPJXC/8bkQsyTr1OHC/pOvJ\nXJzsTeZu9TrlssnUE8nL+cDeTRqxmVkr15w34Eh6ANgL6CZpJnAxmVUk5cBYSQCvRcQpETFF0sPA\n22RSKMPrW1EC9d+A81u+XLu9mog4rZHfxcys1WrmVSXHrKH4znrqjwRG5tp+fTPuN3JtJB8Wnep9\nrGx1c0/aodBDsDYq36mS5lTfDThjWnIgZmaFVFOb07PTW4Vc9+M2M2vTWsFurTlz4DYzo42kSszM\n1iVp2tY1lyfgbC3p+ZW7XEnqI+mC/A/NzKzl1DbiKLRcsvF3kFl/WAUQEZPI7GRlZtZmBMr5KLRc\nUiXtI2J8smB8peo8jcfMrCCqU5QqySVwfyZpS5KLrpKOAGbndVRmZi2sNcykc5VL4B5OZjOVb0ia\nRebpN8fndVRmZi2sNeSuc5XLXiXvAgMkdQCKImJhQ58xM0ubNjXjlnTRKu8BiIhL8zQmM7MW16Zm\n3MDirNftyOwlOzU/wzEzK4yatjTjjojrst9LuhZ4Jm8jMjMrgOZ9VnB+NeXOyfZkntBgZtZm1Lal\nGbekt/hy/5ViYEPA+W0za1Pa2iZT38t6XQ18EhG+AcfM2pQ2c3FSUjHwTER8o4XGY2ZWELVKT6qk\n3r1KkueevSNpsxYaj5lZQdQ04ii0XFIl6wNTJI0na2lgRByct1GZmbWwtraq5MK8j8LMrMDa1KoS\nYFBEnJtdIOlq4G/5GZKZWctL06qSXPbj3m8NZQc290DMzAqpVrkfhVbnjFvSqcAw4OuSJmWd6gi8\nnO+BmZm1pLayHPB+4K/AlcB5WeULI2JuXkdlZtbCalrBTDpXdQbuiJgPzAeOabnhmJkVRluZcZuZ\nrTMcuM3MUiZFj5zMaVWJmVmbV9uIoyGSRkuaI2lyVtkPJU2RVCtp51Xqj5A0Q9I7kg5oqH0HbjMz\nmv2W97uBgauUTQYOB8ZlF0raDjga2D75zC3JPlF1cuA2M6N513FHxDhg7iplUyPinTVUPwR4MCKW\nR8R7wAygf33tO3CbmdG4VImkSklvZB2Va9F1T+DDrPczk7I6+eKkmRmNW1USEaOAUfkaS0McuM3M\nKOheJbOATbPe90rK6uRUiZkZBd2r5HHgaEnlkrYAegPj6/uAZ9xmZjTvAxIkPQDsBXSTNBO4mMzF\nyt+SeW7vk5ImRsQBETFF0sPA22QeDzk8eYhNnRy4zcyA2mZMlkREXVuFPFZH/ZHAyFzbd+A2M8O3\nvJuZpU6aHqTgwG1mhmfcZmapU630zLkduM3McKrEzCx1nCoxM0uZ5lwOmG8O3GZmOFViZpY6TpWY\nmaVMTYrm3A7cZmZ4xm1mljrhGbeZWbp4xr2Oa3/qOZTutBsxfx4LzjpptfOlO+9Ou6OHQATU1LDk\n7puomfbWWvWp9TrS4ecXU7ThJtR++jGLr/8VsXgRZXsMoPzQY5BELF3CkjtuoOb9f69VX9Y07Qaf\nSck3dyEWzmPxpT9Z7XzJjrtRfvDgzO9FbQ3LHrqNmn9PWbtO23ek/cm/RBtsTHz+CUvuGAlLFlHS\nf2/KDzgSJGLZUpbd/1tqZ767dn2lXJqWA/pBCnmw4sWnWTTynDrPV02ewMJfDGXh2T9myS1X0+GU\ns3Nuu2S7vrQfft5q5e0OPZaqtyaw4LTjqXprAu0OPRaAmjmzWXTx6Sw4awhL/3gP7X9yVuO/kDWL\nqlefZcmN59d5vnramyy+7FQWXz6MpWOup93gn+fcdvHWfWh3wur/25YPPDLT7kVDqJ72JuUDjwIg\nPvuExdedzeJLT2HFk/dRcfzpjf9CbUw04ig0B+48qJ46iVi0sO4Ky5Z++bpdu8wMK1F+8FF0vPI2\nOl57J+2OPDHnPku/vTsrXnwayPzhKO2/BwA1/28KsXhR5vX0tynaYMPcv4g1q5rpk4kl9fxeLF/2\nxUuVf/X3omz/I+gw4kY6XHgr5d//Uc59luy4G1WvPgdA1avPUbLjbpmxvPs2LMn8XlS/Nw116daY\nr9ImVRM5H4XW4qkSSSdFxF0t3W9rU9p/DyqOrUSdu7DoyswMuqTPzhR378XCEaeARIdzr6Bk2z5U\nT53UYHvq3JWYNxeAmDcXde66Wp2yfQ6i6s16n4hkBVbS9zuUHzaEoo5dWHLThQAUb9uPoo16svjK\n00CiYtglFPfegZrpkxtsr6jT+sSC5PdiwVyKOq2/Wp2y3QdSPeX15v0iKeSLk/W7BFhj4E4ecV8J\ncH2/3pz49R4tOa4WVTX+JarGv0TJtn2oOGooiy47i9Idv01Jn2/T8ZrfAaB2FRR17wVTJ9Hxilug\ntAy1q0DrdfyiztJ7b6f6X2v4P1189ZewZPu+lO8ziIUX/izv382arnriK1RPfIXi3jtQfvAJLPnN\neZRstxMl2/ajwwW3AKDyCoo26knN9Ml0OO9/oaQUlVegDh0pTuose/ROat7+5+odrPJ7Ubz1jpTu\nfgBLrjkz79+ttVvnL05KqmuKKGDjuj6X/cj7//5wr/T8+VsL1VMnUbRxd9SxMwiWPXYfK577y2r1\nFv5yGJDJcZftPZAlN1/1lfMxfy7qkpl1q0tXYsF/vzhXvNnXaX/K2Sy64lxi0YL8fiFrFjXTJ1PU\nbRPUoRNILH/6Iar+/tRq9RZflclNF2/dh9Ld9mPZmOu+cr52wX9Rp67EgrmoU1dqF8774lxRzy2o\nGHwGS268gFhcTwpnHZGmGXe+ctwbA4OB76/h+DxPfaZG0SY9v3hdvEVvVFpKLJxP1cTXKd/nQGhX\nAYC6dkOduuTUZtUbr1C210AAyvYaSNXrL2fa6LYRHc6+jMW/vYLa2TOb+ZtYc9KGX/4Ls2jTraCk\nlFi8gOopb1C2+wFQ3i5Tr8sGmT/0Oaie9Bqluw0AoHS3AVT/69VMG+tvSPtTLmLp6GuonTOrmb9J\nOtU24ii0fKVKngDWi4iJq56Q9GKe+mw1Opx+ISXb90UdO9P5tj+w9OG7oDjzX/WKsY9Tusv/UP7d\n/YmaGlixnEU3XApA9aQ3WNHra3QaeTMAsWwpi28cSSyYV2dfKy177H46nHkx5fsMovbTT1h8w68A\nqDjiBLReJ9qfnKxQqKlh4XmrL0Wz/KsYeh7F2/RB63VmvavuZflffv/F70XVuCcp7bcHpbsOgJpq\nomo5S++4AoCaqROo6r4ZHc79DQCxfClL7/w1LJzfYJ8rnn6IisrzKd19IDF3DktGZZ5HW/6941CH\njrQ79qeZirU1LL5i3U6j1UR6ZtyKVjrYdSVVYo1T3LW80EOwVqjT7c9obds49muH5Rxz7n//sbXu\nb234BhwzM9KV43bgNjOjdeSuc+XAbWZGum55d+A2M8OpEjOz1EnTqhIHbjMz0pUq8SZTZmY07w04\nkkZLmiNpclZZV0ljJU1Pfq6flEvSjZJmSJokqV9D7Ttwm5mRyXHn+p8c3A0MXKXsPOD5iOgNPJ+8\nBzgQ6J0clcCtDTXuwG1mRiZVkuvRkIgYB8xdpfgQYEzyegxwaFb5PZHxGtBFUvf62nfgNjMDIiLn\nQ1KlpDeyjsocutg4ImYnrz/myw33egIfZtWbmZTVyRcnzcyAmkZcnMzeybQpIiIkNflqqAO3mRkt\nsqrkE0ndI2J2kgqZk5TPAjbNqtcrKauTUyVmZjQuVdJEjwMnJK9PAP6cVT44WV2yKzA/K6WyRp5x\nm5nRvDNuSQ8AewHdJM0ELgauAh6WNBR4Hzgyqf4UMAiYASwBTmqofQduMzOa95b3iDimjlP7rqFu\nAMMb074Dt5kZvuXdzCx10nTLuwO3mRkO3GZmqdNaH+O4Jg7cZmZ4xm1mljp+kIKZWcrURHqeOunA\nbWaGc9xmZqnjHLeZWco4x21mljK1TpWYmaWLZ9xmZinjVSVmZinjVImZWco4VWJmljKecZuZpYxn\n3GZmKVMTNYUeQs4cuM3M8C3vZmap41vezcxSxjNuM7OU8aoSM7OU8aoSM7OU8S3vZmYp4xy3mVnK\nOMdtZpYyaZpxFxV6AGZmrUEtkfPREEmnS5osaYqkM5KyrpLGSpqe/Fy/qWN14DYzIzPjzvWoj6Qd\ngJOB/sCOwPckbQWcBzwfEb2B55P3TeLAbWZGZlVJrkcDtgX+ERFLIqIa+BtwOHAIMCapMwY4tKlj\ndeA2MyNzcTLXowGTgT0lbSCpPTAI2BTYOCJmJ3U+BjZu6lh9cdLMjMZdnJRUCVRmFY2KiFFJO1Ml\nXQ08CywGJgJf2XowIkJSk6+GOnCbmdG4OyeTID2qnvN3AncCSLoCmAl8Iql7RMyW1B2Y09SxOlVi\nZkbzXZwEkLRR8nMzMvnt+4HHgROSKicAf27qWD3jNjOj2W/AeUTSBkAVMDwi5km6CnhY0lDgfeDI\npjauNC06X1dJqlyZPzNbyb8X6y6nStKhsuEqtg7y78U6yoHbzCxlHLjNzFLGgTsdnMe0NfHvxTrK\nFyfNzFLGM24zs5Rx4G7lJA2U9I6kGZKavJuYtR2SRkuaI2lyocdiheHA3YpJKgZuBg4EtgOOkbRd\nYUdlrcDdwMBCD8IKx4G7desPzIiIdyNiBfAgma0hbR0WEeOAuYUehxWOA3fr1hP4MOv9zKTMzNZh\nDtxmZinjwN26zSKzAftKvZIyM1uHOXC3bq8DvSVtIakMOJrM1pBmtg5z4G7FkufV/RR4BpgKPBwR\nUwo7Kis0SQ8ArwLbSJqZbBNq6xDfOWlmljKecZuZpYwDt5lZyjhwm5mljAO3mVnKOHCbmaWMA7e1\nKEmLkp89JP2xgbpnSGrfyPb3kvREruWr1DlR0k2N7O8/kro15jNma8uB29Zasotho0TERxFxRAPV\nzgAaFbjN1gUO3FYnSZtLmibpPklTJf1x5Qw4mWleLWkC8ENJW0p6WtI/Jf1d0jeSeltIelXSW5Iu\nX6XtycnrYknXSposaZKkn0k6DegBvCDphaTe/klbEyT9QdJ6SfnAZJwTgMNz+F79k3belPSKpG2y\nTm8q6UVJ0yVdnPWZ4yWNlzRR0u1N+WNl1lwcuK0h2wC3RMS2wAJgWNa5zyOiX0Q8SOb5hz+LiJ2A\nXwC3JHX+F7g1Ir4JzK6jj0pgc6BvRPQB7ouIG4GPgL0jYu8kHXEBMCAi+gFvAGdKagfcAXwf2AnY\nJIfvNA3YMyK+BVwEXJF1rj/wA6APmT9IO0vaFjgK2D0i+gI1wHE59GOWFyWFHoC1eh9GxMvJ63uB\n04Brk/cPASQz3+8Af5C08nPlyc/dyQRCgN8DV6+hjwHAbckt/kTEmvaa3pXMwyReTvooI3Pb9zeA\n9yJiejKWe8n8IahPZ2CMpN5AAKVZ58ZGxOdJW48CewDVZP4ovJ70XQHMaaAPs7xx4LaGrLonQvb7\nxcnPImBeMhvNpY2mEJmgesxXCqW6+qzPZcALEXGYpM2BF7POren7ChgTESOa0JdZs3OqxBqymaTd\nktfHAi+tWiEiFgDvSfohgDJ2TE6/TGZXQ6g7vTAW+ImkkuTzXZPyhUDH5PVrwO6StkrqdJC0NZm0\nx+aStkzqfSWw16EzX26Pe+Iq5/aT1FVSBXBoMv7ngSMkbbRyfJK+lkM/ZnnhwG0NeQcYLmkqsD5w\nax31jgOGSvoXMIUvH7F2evL5t6j76T2/Az4AJiWfPzYpHwU8LemFiPiUTJB9QNIkkjRJRCwjkxp5\nMrk4mUsK49fAlZLeZPV/dY4HHgEmAY9ExBsR8TaZ/PqzSd9jge459GOWF94d0OqUpBGeiIgdCjwU\nM8viGbeZWcp4xm1mljKecZuZpYwDt5lZyjhwm5mljAO3mVnKOHCbmaWMA7eZWcr8fzzn9qmv1yS9\nAAAAAElFTkSuQmCC\n",
            "text/plain": [
              "<Figure size 432x288 with 2 Axes>"
            ]
          },
          "metadata": {
            "tags": []
          }
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "3YuUkfcKJeVU",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 170
        },
        "outputId": "7a0d2b4a-867a-4416-c5ea-5fa72f93c2d2"
      },
      "source": [
        "print(classification_report(y_test, yfit_svc))"
      ],
      "execution_count": 215,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "              precision    recall  f1-score   support\n",
            "\n",
            "        -1.0       0.54      0.62      0.58       237\n",
            "         1.0       0.59      0.50      0.54       256\n",
            "\n",
            "    accuracy                           0.56       493\n",
            "   macro avg       0.56      0.56      0.56       493\n",
            "weighted avg       0.57      0.56      0.56       493\n",
            "\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "hRxILTyK8TPX",
        "colab_type": "text"
      },
      "source": [
        "## PCA-SVM Pipeline"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "_ORjpMyk8TPa",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "from sklearn.decomposition import PCA "
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "XSi4HCA48TPg",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "pca = PCA().fit(ret)"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "Z1ojzC0V8TPl",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 300
        },
        "outputId": "79977a1f-652e-4954-98ae-5580fae5657d"
      },
      "source": [
        "plt.plot(np.cumsum(pca.explained_variance_ratio_))\n",
        "plt.xlabel('number of components')\n",
        "plt.ylabel('cumulative explained variance')\n",
        "plt.axhline(0.90, c='r', ls='--' )\n",
        "plt.axvline(200, c='r', ls='--' )"
      ],
      "execution_count": 218,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "<matplotlib.lines.Line2D at 0x7f1f630656a0>"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 218
        },
        {
          "output_type": "display_data",
          "data": {
            "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYUAAAEKCAYAAAD9xUlFAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4zLCBo\ndHRwOi8vbWF0cGxvdGxpYi5vcmcvnQurowAAIABJREFUeJzt3Xl8FfXV+PHPIZCQhJBAEraETdlR\nBIyAiD5URcEHl6p11+KjYutWrO3v0T5qW221i1bauqLFXXGrihY3BFREZd8RCJskAlkgZN/P74+Z\nhEsIyYC5mZvc83695jXrnXvuEO65M99NVBVjjDEGoI3fARhjjAkdlhSMMcbUsqRgjDGmliUFY4wx\ntSwpGGOMqWVJwRhjTC1LCsYYY2pZUjDGGFPLkoIxxphabf0O4EglJSVpnz59/A7DtDYbNzrzgQP9\njcOYIFm2bFmOqiY3dlyLSwp9+vRh6dKlfodhWpvx4535ggV+RmFM0IjIDi/H2eMjY4wxtVrcnYIx\nQXH33X5HYExIsKRgDMCZZ/odgTEhwR4fGQOwcqUzGRPm7E7BGIBp05y5FTSbMBe0OwURmSkiWSKy\n9jD7RUT+ISLpIrJaREYGKxZjjDHeBPPx0XPAxAb2TwL6u9NU4IkgxmKMMcaDoD0+UtXPRaRPA4ec\nD7ygznigX4tIgoh0V9VdwYrJGGNCSWVVNftLKigoraS4vIri8oPnReVVlJRXUlJeTVV1NWcM7soJ\nPROCGpOfZQopwM6A9Qx32yFJQUSm4txN0KtXr2YJzhhjvKqqVvYVl5NbWE5uYRn7iivIKylnf0mF\nMxU78zx3XjMVllUe0ft06di+VScFz1R1BjADIC0tTX0Ox7RGDzzgdwQmxFRWVZNTWM7u/FKy8kvJ\nLXK+8HMKywOWy8gtLGdvcTl6mG+myLZtSIhuR7w79Uhoz6DucSRERxIf3Y6EmHbEtW9LTGRbYiIj\n3ClgOaot7du2IaKNICJB/9x+JoVMoGfAeqq7zZjmN3as3xGYZqKq5JdUsju/lD35pbVf+rvzS9m9\nv4ysglJ27y8lp7CM6nq+6OPatyWpQxSJsZH0TYolrU9nkmIjSewQRWKHSBJjo+gU246E6EgSYtrR\nvl1E83/IH8DPpDAbuEVEZgGjgf1WnmB8s2iRM7fk0OKpKtmFZWTuKyFjXwmZeSXucnHtclF51SGv\nS4hpR7eO7enasT2DusU5y/Ht6RrnbEuKi6RzbCRRbVvWl/yRClpSEJFXgfFAkohkAL8F2gGo6pPA\nHOAcIB0oBq4NVizGNOo3v3Hm1k6hRdhfUsGO3CK25xbzXW7RwV/+eSWUV1YfdHx8dDtSEqLpnRjL\n2GOTSEmIplu882XfrWN7unSManG/6IMlmLWPLm9kvwI3B+v9jTEtW15xOdtzi50v/5xitucWsT23\niB25xewtKj/o2KQOUaR0imZw945MGNKVlE7RpCRE187j2rfz6VO0PC2ioNkY0zpVVlXz3d5i0rMK\n2ZxVyJasQrbkFLEjt4i84ora40SgR3w0vRNjmHhcN/okxtA7MZa+SbH07BRDdKT9ym8qlhSMMUFX\nVlnFtpwi58t/TyHp2YWk7ylkW04R5VUHHvV069ieY7vE8t/Hd6dPYix9kmLpkxhDz84x9ninmVhS\nMMY0mepqZee+YjbsymfDrgK+3Z3Ppj2F7Mgtqq3JIwK9OsfQL7kD4wcl0y+5A/27xnFscqw95gkB\nlhSMAZg+3e8IWpyC0go27i5wEoA737i7gGK3Zk8bgT5JsQzqFse5w7pzbJcO9O8SxzHJsfarP4RZ\nUjAGYPhwvyMIafuKylmTud+ZMvazbtd+du4tqd3fsX1bBnfvyCVpPRncPY5B3ToyoGucPetvgSwp\nGAMwd64zt8F22F9SwbrM/ax2E8DqzLyDEkCfxBiGpSZw2Um9ahNA9/j2zdLa1gSfJQVjAP7wB2ce\nZkmhvLKa9bvyWbZjHyt35rEmI4/tucW1+3t2jmZYSgJXju7NsJR4hqbEEx9tz/1bM0sKxoSRrIJS\nlu/IY8V3+1i2Yx9rMvdT5jb06h7fnmGp8fwkrSfHp8RzfEo8nWIjfY7YNDdLCsa0UtXVyre7C1i6\nYy/Ld+xj2Xf7ah8DRUa0YWhKR64e05uRvTsxslcnusW39zliEwosKRjTSlRVKxt25fP11ly+2baX\nxdv2sr/EaQDWJS6Kkb06cc2YPozsncDQHvFWA8jUy5KCMS1UZZVTHvD11ly+2bqXxdv3UlDq9M/f\nOzGGs4d2ZXTfREb17Uxqp2grCDaeWFIwBuCpp/yOoFGqypbsQj7flMPC9BwWb9tbO0jLMUmxTB7W\nnTHHJDK6b6I9CjJHzZKCMQADB/odQb1yCsv4Mj2HLzbnsHBzDrvzSwHomxTL+cN7uEmgM106WhIw\nTcOSgjEA773nzM8919cwKqqqWbJ9L59tyuaLTTms35UPOH39n9IviVP7JTGufxKpnWJ8jdO0XpYU\njAF4+GFn7kNSyCksY8HGbOZ/m8Xnm7IpKKukXYRwYu9O/PrsgZzaP4mhPeKJaGNlAib4LCkY08xU\nlfW78pm3IYt5G7NYuTMPVaeG0OQTuvOjgV04pV8SsVH239M0P/urM6YZlFdW89XWXD5at5t5G7Jq\nywZO6JnA7WcO4PRBXRjao6PVEDK+85QURGQc0F9VnxWRZKCDqm4LbmjGtGylFVV8timbj9buZu6G\nPeSXVhIbGcFpA5I5fVAXxg/sQnJclN9hGnOQRpOCiPwWSAMGAs/ijLP8EnBKcEMzpuUpKK1g3rdZ\nfLRuN/O/zaakoor46HacNbQbE4d2Y1z/JGs0ZkKalzuFHwMjgOUAqvq9iMQFNSpjmtuLLx71S4vL\nK/lk/R5mr/yeLzbnUF5VTXJcFBedmMLEod0ZfUxn2kW0acJgjQkeL0mhXFVVRBRARGKDHJMxza9n\nzyM6vKKqmi82Z/Puyu/5eN0eSiqq6BHfnqtP7s2k47oxslcn2lhtIdMCeUkKr4vIU0CCiNwA/A/w\ndHDDMqaZvfaaM7/00sMeUl2tLN2xj3dXZjJnzS72FVeQENOOC0emcP7wFNJ6WyIwLV+jSUFVHxKR\nCUA+TrnCvar6iZeTi8hE4O9ABPCMqv6pzv7ewEwgGdgLXKWqGUf2EYxpAk884czrSQqb9hTw1vIM\n3lv5Pd/vLyW6XQRnDe3K+cN7MK5fMpFt7dGQaT28FDT3Bb6oSQQiEi0ifVR1eyOviwAeAyYAGcAS\nEZmtqusDDnsIeEFVnxeR04EHgauP7qMY03T2l1Tw3qrveWNZBqt25tG2jXDagGT+d9Igzhzc1doQ\nmFbLy1/2G8DYgPUqd9tJjbxuFJCuqlsBRGQWcD4QmBSGAL90l+cD7zQazcaNMH78wdsuuQRuugmK\ni+Gccw59zZQpzpSTAxdffOj+n//c+YW4cydcXU9OuuMOp6Xrxo1w442H7r/7bmfErpUrYdq0Q/c/\n8ACMHQuLFsFvfnPo/unTnTGC5849MAJYoKeecvrmee+9Ay1vA734ovNM/LXXDvziDfTmm5CUBM89\n50x1zZkDMTHw+OPw+uuH7l+wwJk/9BC8//7B+6Kj4YMPnOX774dPPz14f2IivPWWs3zXXfDVVwfv\nT02Fl15ylqdNc65hoAEDYMYMZ3nqVNi06eD9w4c71w/gqqsgo86N5sknw4MPOssXXQS5uQfvP+MM\nuOceAHT1avJHn0JWQRl7i8rpp8rkEady3q9/zQXDe5A4+WwOYX979rcHP/hvj0mToKTk4P2TJ8Ov\nfuUs1/3Ogx/+t3cYXpJCW1Utr1lR1XIR8TIcUwqwM2A9Axhd55hVwIU4j5h+DMSJSKKqHnT1RGQq\nMBVgWJTV6zZNK2NfMbqvhI6llWzYlU9EG6FLXBTJcVGMHtcXGdfX7xCNaTaiqg0fIPIJ8E9Vne2u\nnw/cpqpnNPK6i4GJqnq9u341MFpVbwk4pgfwKNAX+By4CDhOVfMOd960tDRdunSpl89mzGFVVSuf\nb8rmpa93MG9jFq++fCfx0e1If/19Jgzpam0JTKsjIstUNa2x47zcKfwMeFlEHgUE59f/NR5elwkE\n1vNLdbfVUtXvce4UEJEOwEUNJQRjfqjcwjJeX5rBK4t3sHNvCUkdorjlR/3off0cusdHMzgpye8Q\njfGVl9pHW4Ax7pc2qlro8dxLgP5uQXUmcBlwReABIpIE7FXVauAunJpIxjQpVWXZjn289PUO5qzZ\nTXlVNWOO6cz/ThzEWUO6We0hYwJ4qX0UhfNYpw/QtqbDLlW9r6HXqWqliNwCfIRTJXWmqq4TkfuA\npe7jqPHAg27DuM+Bm4/+oxhzsPLKat5b9T3/WriN9bvyiYtqyxWje3Hl6F7071qnUX5NIeiUKc0d\npjEhxUuZwofAfmAZTs0jAFS1nqoIwWdlCqYx+4rKefmbHbzw1Q6yCsro36UD157Sl/OH9zh8VdKa\n2h01tV2MaWWaskwhVVUnNkFMxgRVelYhM7/cxr+XZ1BaUc1pA5L560/6clr/JOuS2hiPvCSFRSJy\nvKquCXo0xhyFJdv38sSCLcz7NovItm24cEQK/zOuLwPqPiIyxjTKS1IYB0wRkW1AGU4NJFXVYUGN\nzJgGqCqfbcrm8flbWLx9L51jI5l2Zn+uGtObpA7WlsWYo+UlKUwKehTGeFRVrXy0bjePzU9n3ff5\ndI9vz2/PHcJlJ/UiOtLaFhjzQ3mpkroDQES6AO2DHpEx9aioquadFZk88dkWtmYX0Tcplr9cNIwL\nRqQ0TZXSOXN++DmMaQW8VEk9D3gY6AFkAb2BDcDQ4IZmjFOt9M1lGTw2P53MvBIGd+/Io1eMYNJx\n3Yloym6qY2Ka7lzGtGBeHh/dD4wB5qrqCBH5EXBVcMMy4a6yqpp/L8/kH/M2k7GvhOE9E7j/gqH8\naGCX4NQkevxxZ37TTU1/bmNaEC9JoUJVc0WkjYi0UdX5IjI96JGZsFRVrby7MpN/fLqZ7bnFHJ8S\nz/3nH8f4gcnBrVZa00OnJQUT5rwkhTy3i4vPcfpAygKKghuWCTfV1cr7a3Yxfe4mtmYXMbh7R2Zc\nfSIThnS1NgbGNCMvSeF8oBS4HbgSiAca7OLCmCPx2aZsHpyzgW93FzCgaweeuHIkZw/tZkNbGuMD\nL7WPAu8Kng9iLCbMrPt+P3/64Fu+2JxDz87R/P2y4Uwe1qNpC5CNMUfksElBRBaq6jgRKQACO0iq\nabzWMejRmVYpM6+Ehz/eyNsrMomPbsc9k4dw1ZheRLW1dgbG+O2wSUFVx7lz6yvANIn80goen7+F\nmV9uA2Dqacdw0/h+xEe38zkyrCM8Y1wNPj4SkQhgnaoOaqZ4TCtUVa3MWvIdD320kX3FFVw4IoVf\nnjWA1E7WNsCYUNNgUlDVKhHZKCK9VPW75grKtB5Ltu/lt++uY/2ufEb17cy9k4dwXEq832Ed6qGH\nnHnNQOnGhCkvtY86AetEZDEBVVFV9bygRWVavD35pTw4ZwPvrPye7vHt+eflI5g8rHvoVi99/31n\nbknBhDkvSeGeoEdhWo2yyipmLtzOP+dtprJKueVH/bjpR8cSE+nlT80Y4zcvVVI/a45ATMu3aEsO\nd7+9lq05RZw5uCv3TB5M78RYv8MyxhwBLx3ijQH+CQwGInHGWy6yKqmmxr6icv44ZwNvLsugd2IM\nz117EuMHdvE7LGPMUfByT/8ocBnwBpAGXAMMCGZQpmVQVd5ekckf/rOB/JIKbhp/LLed0Z/27Vpg\ne4PoaL8jMCYkeHrQq6rpIhKhqlXAsyKyArgruKGZULY9p4j/e2cNX6bnMrJXAg9ceDyDurXgm8cP\nPvA7AmNCgpekUCwikcBKEfkLsAtoglFNTEtUVa3MXLiNhz7eSGREG+6/4DiuHNXL+ikyppXw8uV+\ntXvcLThVUnsCF3k5uYhMdNs5pIvInfXs7yUi80VkhYisFpFzjiR407y2ZhdyyVNf8cc5Gzi1fzJz\n7/gvrh7Tu3UkhPvvdyZjwpyXO4UTgf+oaj7we68ndltDPwZMADKAJSIyW1XXBxx2N/C6qj4hIkOA\nOUAfr+9hmkd1tfLsou385cNviWrbhkcuPYELhqeEbpuDo/Hpp878HquBbcKbl6RwLvCIiHwOvAZ8\nqKqVHl43CkhX1a0AIjILpxvuwKSgQM2D6Hjge6+Bm+axPaeI//fmahZv38vpg7rw4IXH07WjDdVt\nTGvlpZ3CtSLSDpgEXA48JiKfqOr1jbw0BdgZsJ4BjK5zzO+Aj0XkViAWOLO+E4nIVGAqQK9evRoL\n2TQBVWXWkp3c99562rYR/nrxMC4+MbV13R0YYw7htfZRhYh8gPPLPhq4AGgsKXhxOfCcqj4sIicD\nL4rIcapaXef9ZwAzANLS0rSe85gmlFdczp1vreHDdbsZe2wiD19yAt3jrcqmMeHAS+O1ScClwHhg\nAfAMcImHc2fiFErXSHW3BboOmAigql+JSHsgCcjycH4TBF9tyeX211aSU1jGXZMGccOpx7SOguTG\nJCb6HYExIcHLncI1OGUJN6pq2RGcewnQX0T64iSDy4Ar6hzzHXAG8JyIDAbaA9lH8B6miVRUVTN9\n7iYeX7CFPomx/PumsQxLTfA7rObz1lt+R2BMSPBSpnD50ZxYVStF5BbgI5yuMWaq6joRuQ9Yqqqz\ngTuAp0XkdpxHU1NU1R4PNbOde4u59dUVrNyZxyVpqfz23KHERlkHdsaEo6D+z1fVOTjVTAO33Ruw\nvB44JZgxmIbN+3YPt7+2impVHr1iBJOH9fA7JH/c5TbQf/BBf+Mwxmf2czBMVVUrj3yyiUfnpzOk\ne0eeuGpkePdo+tVXfkdgTEiwpBCGcgrLuO3VFSzaksulaT35/flDW2YndsaYJnfYpCAia3Ce89dL\nVYcFJSITVMt27OWml5eTV1zBXy4exiVpPRt/kTEmbDR0pzDZnd/szl9051cGLxwTTLMWf8c9766l\nR0I0b980iiE9WnCvpsaYoDhsUlDVHQAiMkFVRwTsulNElgOHdHBnQlNFVTV//M8Gnlu0nVP7J/Ho\n5SOJj2nnd1ihJTXV7wiMCQleyhRERE5R1S/dlbFY19ktxr6icm5+ZTmLtuRy/bi+3DlpEG0j7J/v\nEC+95HcExoQEL0nhOmCmiMS763nA/wQvJNNUNu0p4Prnl7J7fykP/eQELj7Rfg0bYxrmpfHaMuCE\nmqSgqvuDHpX5weau38MvZq0gJqots24cw8henfwOKbRNm+bMp0/3Nw5jfOal76OuwANAD1Wd5I57\ncLKq/ivo0Zmj8uyX27jv/fUc1yOeGdecaJ3ZebFypd8RGBMSvDxcfg6nq4qapq6bgGnBCsgcvapq\n5b731vP799Zz5uCuvH7jyZYQjDFHxEtSSFLV14FqcPo0AqqCGpU5YiXlVdz08jJmfrmNKWP78ORV\nJxIdaQ3SjDFHxktBc5GIJOI2ZBORMYCVK4SQ3MIyrnt+Kasy8rhn8hCuG9fX75CMMS2Ul6TwS2A2\ncKyIfAkkAxcHNSrj2Y7cIq6ZuZjd+0t54sqRTDyuu98htUwDBvgdgTEhwUvto+Ui8l/AQECAjapa\nEfTITKM27MrnmpmLqayq5tWpVsPoB5kxw+8IjAkJXjvEGwX0cY8fKSKo6gtBi8o0atmOvVz77BJi\nItvyyo0n079rnN8hGWNaAS9VUl8EjgVWcqCAWQFLCj75bFM2P3txGV07RvHS9aNJ7RTjd0gt39Sp\nztzuGEyY83KnkAYMsRHRQsN/Vu9i2msr6Ncljhf+ZxTJcVF+h9Q6bNrkdwTGhAQvVVLXAt2CHYhp\n3DsrMrn11eWckJrArKljLCEYY5qclzuFJGC9iCwGymo2qup5QYvKHOLfyzP41RurGN03kX9NSSMm\n0sZHMsY0PS/fLL8LdhCmYW8uy+DXb65i7LGJPHPNSdYozRgTNF6qpH7WHIGY+r2+dCf/+9ZqxvVL\n4ulr0mzYzGAZPtzvCIwJCQ0Nx7lQVceJSAEHD8spgKqqDdsVZO+uzLSE0Fysd1RjgAYKmlV1nDuP\nU9WOAVOc14QgIhNFZKOIpIvIISO1icgjIrLSnTaJSN7Rf5TW5ZP1e/jl66sY3bezJQRjTLPxXFop\nIl2A9jXrqvpdI8dHAI8BE4AMYImIzFbV9QHnuD3g+FuBEYecKAx9mZ7Dza8s57iUeJ756UmWEJrD\nVVc5cxuBzYS5Rqukish5IrIZ2AZ8BmwHPvBw7lFAuqpuVdVyYBZwfgPHXw686uG8rdqyHfu44YWl\n9E2M5flrT6JDlNUyahYZGc5kTJjz0k7hfmAMsElV+wJnAF97eF0KsDNgPcPddggR6Q30BeYdZv9U\nEVkqIkuzs7M9vHXLtP77fK59djHJcVG8eN0oEmIi/Q7JGBNmvCSFClXNBdqISBtVnY/TyrkpXQa8\nqar1jtOgqjNUNU1V05KTk5v4rUPDtpwirpn5DbFRbXnputF06di+8RcZY0wT8/JsIk9EOgCfAy+L\nSBZQ5OF1mUDPgPVUd1t9LgNu9nDOVimnsIyfzlxMtcKL142mZ2fry8gY4w8vSeF8oBS4HbgSiAfu\n8/C6JUB/EemLkwwuA66oe5CIDAI6AV95jLlVKSmv4rrnl5JVUMorN4yhX5cOfocUnk4+2e8IjAkJ\nXhqvBd4VPO/1xKpaKSK34IzvHAHMVNV1InIfsFRVZ7uHXgbMCscO96qqldtmrWB1Rh5PXnWijYfg\npwcf9DsCY0JCQ43X6m20xhE0XlPVOcCcOtvurbP+uyOIt9VQVe5/fz2frN/D784dwtlDrc9BY4z/\nDpsUVNVGbQmiZ7/cznOLtnP9uL5MOcXGVPbdRRc587fe8jcOY3zmqRK8iIwExuHcKSxU1RVBjaqV\nW7g5hz/8Zz1nDenKb84Z7Hc4BiA31+8IjAkJXhqv3YtTlpCI0432cyJyd7ADa6125BZx8yvL6d8l\njr9dOpw2bcTvkIwxppaXO4UrgRNUtRRARP6EMzTnH4IZWGtUWFbJDS8sRQSevibNWisbY0KOl8Zr\n3xPQ5xEQxeHbG5jDqK5Wbn9tJVuyi3jsipH0SrS2CMaY0OPlp+p+YJ2IfIJTpjABWCwi/wBQ1duC\nGF+r8c956Xyyfg+/PXcIp/RL8jscU9cZZ/gdgTEhwUtSeNudaiwITiit16L0HKZ/uokLR6QwZWwf\nv8Mx9bnnHr8jMCYkeEkKH6hqVuAGERmoqhuDFFOrkl1Qxi9eW8kxSbHcf8FxiFjBsjEmdHkpU/hC\nRC6pWRGROzj4zsEcRpVbjpBfUsFjV44k1gqWQ9ekSc5kTJjz8i01HpghIj8BugIbcMZKMI14fH46\nC9Nz+NOFxzOom41eGtJKSvyOwJiQ0OidgqruAj4ETgb6AM+ramGQ42rxvt6ayyNzN3H+8B5celLP\nxl9gjDEhoNE7BRGZi1Mt9TicrrD/JSKfq+qvgh1cS7W/pILbX1tJ78RY/vjj460cwRjTYngpU3hU\nVa9R1TxVXQOMxammag7jd7PXkVVQxvRLh1sDNWNMi+Kl6+x33OEy+6vqXKAdMD3okbVQc9bs4u0V\nmfzijP6c0DPB73CMV5Mn+x2BMSHBy+OjG4CpQGfgWJwR1J7EGavZBMjKL+X/3l7DsNR4bjm9n9/h\nmCPxK3saagx4e3x0M3AKkA+gqpuBLsEMqqW69911FJVX8bdLhtMuwsulNcaY0OLlm6tMVctrVkSk\nLQcPvmOAD9fu5sN1u5l2Zn8bUrMlGj/emYwJc16Swmci8hsgWkQmAG8A7wU3rJZlf0kF9767lsHd\nO3LDqcf4HY4xxhw1L0nhTiAbWAPciDO8po2nEODPH35LTmEZf77oeHtsZIxp0bzUPqoGnnYnU8c3\nW3N55ZvvuOHUvgxLtdpGxpiWzX7W/gAVVdX83ztrSe0Uze0TBvgdjjHG/GDWsuoHeOGrHaRnFfLM\nNWnERNqlbNEuuaTxY4wJA57vFETkiIcKE5GJIrJRRNJF5M7DHHOJiKwXkXUi8sqRvodfcgvLmD53\nE6cNSOaMwVZDt8W76SZnMibMNZoURGSsiKwHvnXXTxCRxz28LgJ4DJgEDAEuF5EhdY7pD9wFnKKq\nQ4FpR/4R/PHQxxspKa/i3slDrG+j1qC42JmMCXNe7hQeAc4GcgFUdRVwmofXjQLSVXWr285hFnB+\nnWNuAB5T1X3uubNoAdZm7mfWkp38dGwfa5PQWpxzjjMZE+Y8PT5S1Z11NlV5eFkKEPi6DHdboAHA\nABH5UkS+FpGJ9Z1IRKaKyFIRWZqdne0l5KB68IMNdIqJ5LYz+vsdijHGNCkvSWGniIwFVETaiciv\ncAbaaQptgf44A/lcDjwtIofU61TVGaqapqppycnJTfTWR2fh5hy+TM/llh/1Iz66na+xGGNMU/OS\nFH6G0/9RCpAJDHfXG5OJM/5CjVR3W6AMYLaqVqjqNmATTpIISdXVyp8//JaUhGiuHNPL73CMMabJ\neUkKoqpXqmpXVe2iqlepaq6H1y0B+otIXxGJBC4DZtc55h2cuwREJAnncdJW7+E3rw/W7mZN5n5u\nnzCAqLYRfodjjDFNzkvl+i9FZDvwGvCWquZ5ObGqVorILcBHQAQwU1XXich9wFJVne3uO8ut3VQF\n/Npjwml2lVXVPPzxRgZ07cCPR9QtGjEt3pQpfkdgTEgQ1cY7PBWRUTi/9C8A1gOzVPWlIMdWr7S0\nNF26dGmzv+8bS3fy6zdXM+PqEzlraLdmf39jjPkhRGSZqqY1dpzX2keLVfWXONVM9wLP/8D4WpTK\nqmoeX7CFoT06MmFIV7/DMcGQk+NMxoQ5L43XOorIT0XkA2ARsAsnOYSN91fvYltOEbee3t8aqrVW\nF1/sTMaEOS9lCqtwCoTvU9WvghxPyKmqVv45bzMDu8Zxlt0lGGNaOS9J4Rj1UvDQSn2wdhdbsot4\n9IoRtGljdwnGmNbtsElBRKar6jRgtogckhRU9bygRhYCVJVH56VzbHIsk47r7nc4xhgTdA3dKbzo\nzh9qjkBC0Rebc/h2dwF/vXgYEXaXYIwJA4dNCqq6zF0crqp/D9wnIr8APgtmYKHgmYXbSI6L4rzh\nPfwOxQTbz3/udwTGhAQvVVIbODlgAAAQpUlEQVR/Ws+2KU0cR8jZuLuAzzdl89OTe1vr5XBw6aXO\nZEyYa6hM4XLgCqCviAR2TxGH01ahVZu5cBvt27XhitG9/Q7FNIedboe+PXs2fJwxrVxDZQo1bRKS\ngIcDthcAq4MZlN/yist5e2UmF5+YSufYSL/DMc3h6qud+YIFvoZhjN8aKlPYAewATm6+cELDv5dn\nUl5ZzVV2l2CMCTNeWjSPEZElIlIoIuUiUiUi+c0RnB9UlVcXf8fwngkM6dHR73CMMaZZeSlofhRn\nAJzNQDRwPc7Yy63Ssh372JxVyBWjbLwEY0z48dohXjoQoapVqvosUO+wma3BK4u/o0NUWyafYI3V\njDHhx0s3F8XuIDkrReQvOIXPnpJJS1NYVsmcNbu4aGQqMZFeLo1pNe64w+8IjAkJXr75rsYZJOcW\n4HacITYvCmZQfvl43W5KK6q5cKQNohN2zj3X7wiMCQmNJgW3FhJACfD74Ibjr9mrviclIZqRvTr5\nHYppbhs3OvOBA/2NwxifNdR4bQ1w2N5RVXVYUCLyyd6ichZuzuH6U4+xMRPC0Y03OnNrp2DCXEN3\nCpObLYoQ8NG63VRWK5OHWQGzMSZ8NdZ4LWx8tG43PTtHM9TaJhhjwpiXxmsFIpLvTqWtsfFaQWkF\ni9JzOXtIN3t0ZIwJa14KmuNqlsX5xjwfGBPMoJrb/I3ZlFdVc/Zx3fwOxRhjfHVE7Q3U8Q5wtpfj\nRWSiiGwUkXQRubOe/VNEJFtEVrrT9UcST1P5aN1ukjpEWa2jcHb33c5kTJhr9E5BRC4MWG0DpAGl\nHl4XgdMdxgQgA1giIrNVdX2dQ19T1Vu8h9y0SiuqWPBtFucNT7HR1cLZmWf6HYExIcFL47XAVj2V\nwHacR0iNGQWkq+pWABGZ5b6ublLw1Vdbcikqr+LsoV39DsX4aeVKZz58uL9xGOMzL2UK1x7luVOA\nnQHrGcDoeo67SEROAzYBt6vqzroHiMhUYCpAr15N21Hd55uzad+uDWOOSWzS85oWZto0Z27tFEyY\n8/L4qC9wK9An8HhVPa8J3v894FVVLRORG4HngdPrHqSqM4AZAGlpaYdtUHc0Fm7O4aQ+nWnfzobc\nNMYYL4+P3gH+hfMFXn0E587E6SepRqq7rZaq5gasPgP85QjO/4PtyS9lc1YhP0lLbc63NcaYkOUl\nKZSq6j+O4txLgP7unUYmcBnOmM+1RKS7qu5yV88DNhzF+xy1hZtzADilX1Jzvq0xxoQsL0nh7yLy\nW+BjoKxmo6oub+hFqlopIrcAH+H0sjpTVdeJyH3AUlWdDdwmIufhFGDvBaYc3cc4Ol+m55AYG8ng\nbtaK2RhjwFtSOB6n++zTOfD4SKnn2X9dqjoHmFNn270By3cBd3kNtqkt/24faX060caqopoHHvA7\nAmNCgpek8BPgGFUtD3YwzWl/cQXbc4v5SVrPxg82rd/YsX5HYExI8NKieS2QEOxAmtvqzDwATkht\ndR/NHI1Fi5zJmDDn5U4hAfhWRJZwcJlCU1RJ9c3qjP0AHJ8a73MkJiT85jfO3NopmDDnJSn8NuhR\n+GDVzjz6JsUSH93O71CMMSZkeGnR/FlzBNLcVmfsZ/Qxnf0OwxhjQoqXFs0FHBiWMxJoBxSpaout\nx5lTWMbu/FKOT7FHR8YYEygsx1PYvKcQgAFd4xo50hhjwouXMoVaqqrAO25jtkPGR2gp0rOdpNCv\nSwefIzEhY/p0vyMwJiQEbTyFULYlq5DYyAi6x7f3OxQTKqzLbGOA4I6nELLSswo5tksHG4/ZHDB3\nrjO3wXZMmAvmeAohKz2rkLHH2vgJJsAf/uDMLSmYMNdoi2YReV5EEgLWO4nIzOCGFTwFpRXszi+l\nX1crTzDGmLq8dHMxTFXzalZUdR8wInghBdeW7CIA+iVbUjDGmLq8JIU2ItKpZkVEOnOEtZZCSXqW\n1TwyxpjD8fLl/jDwlYi84a7/BPhj8EIKrsx9JQCkdorxORJjjAk9XgqaXxCRpRwYP+FCVV0f3LCC\nJ6uglE4x7Yhs6+UmyYSNp57yOwJjQoKnx0BuEmixiSBQVkEZXeKsfYKpY+BAvyMwJiSE3c/lrIIy\nunSM8jsME2ree8+ZjAlzLbbA+Ghl55dybLK1UTB1PPywMz/33IaPM6aVC6s7BVUlu9AeHxljzOGE\nVVLYV1xBRZXS1R4fGWNMvcIqKezJd/rxszsFY4ypX1CTgohMFJGNIpIuIoftaltELhIRFZG0YMaT\nVeAMMW0FzcYYU7+gFTSLSATwGDAByACWiMjsum0cRCQO+AXwTbBiqZFVe6dgScHU8eKLfkdgTEgI\n5p3CKCBdVbeqajkwi/q73L4f+DPNMEZD7Z2CPT4ydfXs6UzGhLlgJoUUYGfAeoa7rZaIjAR6qup/\nGjqRiEwVkaUisjQ7O/uoA8ouKCMuqi3RkRFHfQ7TSr32mjMZE+Z8K2gWkTbA34A7GjtWVWeoapqq\npiUnJx/1e2YVlJJs5QmmPk884UzGhLlgJoVMIPB+PNXdViMOOA5YICLbgTHA7GAWNmfll1l5gjHG\nNCCYSWEJ0F9E+opIJHAZMLtmp6ruV9UkVe2jqn2Ar4HzVHVpsALaW1xOYqwlBWOMOZygJQVVrQRu\nAT4CNgCvq+o6EblPRM4L1vs2JK+4goSYdn68tTHGtAhB7ftIVecAc+psu/cwx44PZizV1UpecTmd\nYiKD+TbGGNOihU2HeAWllVQrdqdg6vfmm35HYExICJuksK+4HMDuFEz9kpL8jsCYkBA2fR/llVQA\ndqdgDuO555zJmDAXNkmh5k4hwe4UTH0sKRgDhFFSyKt9fGR3CsYYczhhkxT2FTmPj6xMwRhjDi9s\nkkJqp2jOGtKVjtF2p2CMMYcTNrWPzhrajbOGdvM7DGOMCWlhkxSMadCcOY0fY0wYsKRgDEBMjN8R\nGBMSwqZMwZgGPf64MxkT5iwpGAPw+uvOZEyYs6RgjDGmliUFY4wxtSwpGGOMqWVJwRhjTC1RVb9j\nOCIikg3sOMqXJwE5TRhOS2fX42B2PQ5m1+OA1nAteqtqcmMHtbik8EOIyFJVTfM7jlBh1+Ngdj0O\nZtfjgHC6Fvb4yBhjTC1LCsYYY2qFW1KY4XcAIcaux8HsehzMrscBYXMtwqpMwRhjTMPC7U7BGGNM\nA8ImKYjIRBHZKCLpInKn3/E0BxGZKSJZIrI2YFtnEflERDa7807udhGRf7jXZ7WIjPQv8qYnIj1F\nZL6IrBeRdSLyC3d7uF6P9iKyWERWudfj9+72viLyjfu5XxORSHd7lLue7u7v42f8wSIiESKyQkTe\nd9fD7nqERVIQkQjgMWASMAS4XESG+BtVs3gOmFhn253Ap6raH/jUXQfn2vR3p6nAE80UY3OpBO5Q\n1SHAGOBm928gXK9HGXC6qp4ADAcmisgY4M/AI6raD9gHXOcefx2wz93+iHtca/QLYEPAevhdD1Vt\n9RNwMvBRwPpdwF1+x9VMn70PsDZgfSPQ3V3uDmx0l58CLq/vuNY4Ae8CE+x6KEAMsBwYjdNAq627\nvfb/DfARcLK73NY9TvyOvYmvQyrOD4PTgfcBCcfrERZ3CkAKsDNgPcPdFo66quoud3k30NVdDptr\n5N7qjwC+IYyvh/uoZCWQBXwCbAHyVLXSPSTwM9deD3f/fiCxeSMOuunA/wOq3fVEwvB6hEtSMPVQ\n52dOWFU/E5EOwFvANFXND9wXbtdDVatUdTjOL+RRwCCfQ/KNiEwGslR1md+x+C1ckkIm0DNgPdXd\nFo72iEh3AHee5W5v9ddIRNrhJISXVfXf7uawvR41VDUPmI/zeCRBRGqG6Q38zLXXw90fD+Q2c6jB\ndApwnohsB2bhPEL6O2F4PcIlKSwB+rs1CSKBy4DZPsfkl9nAT93ln+I8W6/Zfo1b62YMsD/gsUqL\nJyIC/AvYoKp/C9gVrtcjWUQS3OVonPKVDTjJ4WL3sLrXo+Y6XQzMc++sWgVVvUtVU1W1D873wzxV\nvZJwvB5+F2o01wScA2zCeW76f37H00yf+VVgF1CB8zz0Opznnp8Cm4G5QGf3WMGpobUFWAOk+R1/\nE1+LcTiPhlYDK93pnDC+HsOAFe71WAvc624/BlgMpANvAFHu9vbuerq7/xi/P0MQr8144P1wvR7W\notkYY0ytcHl8ZIwxxgNLCsYYY2pZUjDGGFPLkoIxxphalhSMMcbUsqRgWjQRWSAiQR87V0RuE5EN\nIvJysN/LTyKSICI3+R2H8Y8lBRO2AlqqenETMEGdBk2tWQLOZzVhypKCCToR6eP+yn7a7bv/Y7cV\n7UG/9EUkye1mABGZIiLvuGMcbBeRW0Tkl25f91+LSOeAt7haRFaKyFoRGeW+Plac8SQWu685P+C8\ns0VkHk6jtbqx/tI9z1oRmeZuexKnEdMHInJ7neMjROQh9/jVInKru/0M933XuHFEudu3i8iDbrxL\nRWSkiHwkIltE5GfuMeNF5HMR+Y84Y4A8KSJt3H2Xu+dcKyJ/DoijUET+KM74CF+LSFd3e7KIvCUi\nS9zpFHf779y4FojIVhG5zT3Vn4Bj3fj+KiLd3Vhqru+pR/2HYFoGv1vP2dT6J5zuuyuB4e7668BV\n7vIC3NbCQBKw3V2egtNaNA5IxumF8mfuvkdwOrSref3T7vJpuN2EAw8EvEcCTmv2WPe8Gbgtl+vE\neSJO6+VYoAOwDhjh7tsOJNXzmp8Db3Kge+XOOK1ddwID3G0vBMS7Hfh5wOdYHfAZ97jbxwOlOIko\nAqcH04uBHsB37rFtgXnABe5rFDjXXf4LcLe7/Aowzl3uhdPNB8DvgEVAlHvdc4F2HNrV+h24PQC4\nscT5/fdkU3CnI7l9NuaH2KaqK93lZThfPo2Zr6oFQIGI7Afec7evwemmocarAKr6uYh0dPv0OQun\ng7Nfuce0x/lSBPhEVffW837jgLdVtQhARP4NnIrTHcThnAk8qW73yqq6V0ROcD/vJveY54Gbcbpm\nhgP9bq0BOgR8xrKa/oiAxaq61Y3jVTe2CmCBqma721/GSYTvAOU4YwCAc30nBMQ3xOn6CYCO4vQU\nC/AfVS0DykQkiwPdhgdaAswUpzPBdwL+DU0rZUnBNJeygOUqINpdruTAY8z2DbymOmC9moP/duv2\n1aI4fRddpKobA3eIyGig6Igib3qBn6PuZ6z5XPV9poZUqGrNMVUB52kDjFHV0sCD3SRR99/kkO8D\nN9GeBvw38JyI/E1VX2gkFtOCWZmC8dt2nMc2cKA3yiN1KYCIjMPpzXQ/zshYt7q9oyIiIzyc5wvg\nAhGJEZFY4MfutoZ8AtxYU2jtlnVsBPqISD/3mKuBz47wM40Sp1ffNjifbyFOx2v/5Za9RACXezjv\nx8CtNSsiMryR4wtwHmfVHN8b57HW08AzQKsaq9ocypKC8dtDwM9FZAXOs+2jUeq+/kkOjKF7P84z\n8tUiss5db5CqLscZ13oxzqhsz6hqQ4+OwPmi/M59n1XAFe6v8muBN0RkDc4dwJNH+JmWAI/idGe9\nDeex1i6cMaTnA6uAZar67uFPAcBtQJpbCL4e+FlDB6tqLvClW6j8V5zyjVXu9b0UZ4wB04pZL6nG\nhBgRGQ/8SlUn+x2LCT92p2CMMaaW3SkYY4ypZXcKxhhjallSMMYYU8uSgjHGmFqWFIwxxtSypGCM\nMaaWJQVjjDG1/j+hZI2aGTieigAAAABJRU5ErkJggg==\n",
            "text/plain": [
              "<Figure size 432x288 with 1 Axes>"
            ]
          },
          "metadata": {
            "tags": []
          }
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "uXgFOdzf8TPp",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "\n",
        "from sklearn.pipeline import make_pipeline"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "J95Hk3tc8TPv",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "pca = PCA(n_components=200, whiten=True, random_state=33)\n",
        "\n",
        "model = make_pipeline(pca, svc)"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "Le-WKTJo8TP4",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 71
        },
        "outputId": "cc07fa17-dd8c-48be-8a42-45a2de8a8486"
      },
      "source": [
        "pipe = model.fit(X_train,y_train)\n",
        "yfit_ps = pipe.predict(X_test)"
      ],
      "execution_count": 221,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "/usr/local/lib/python3.6/dist-packages/sklearn/svm/base.py:193: FutureWarning: The default value of gamma will change from 'auto' to 'scale' in version 0.22 to account better for unscaled features. Set gamma explicitly to 'auto' or 'scale' to avoid this warning.\n",
            "  \"avoid this warning.\", FutureWarning)\n"
          ],
          "name": "stderr"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "57H_6-S98TQA",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 34
        },
        "outputId": "a87f604d-61a7-42fd-ff99-0b90debc3e13"
      },
      "source": [
        "pca_svm_score = accuracy_score(y_test, yfit_ps)\n",
        "pca_svm_score"
      ],
      "execution_count": 222,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "0.5740365111561866"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 222
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "zHaTSVR38TQE",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 283
        },
        "outputId": "f84829c8-63b9-44f5-c226-efaba31b003d"
      },
      "source": [
        "mat = confusion_matrix(y_test, yfit_ps)\n",
        "sns.heatmap(mat , annot=True)\n",
        "plt.xlabel('true label')\n",
        "plt.ylabel('predicted label');"
      ],
      "execution_count": 223,
      "outputs": [
        {
          "output_type": "display_data",
          "data": {
            "image/png": "iVBORw0KGgoAAAANSUhEUgAAAW4AAAEKCAYAAAAyx7/DAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4zLCBo\ndHRwOi8vbWF0cGxvdGxpYi5vcmcvnQurowAAHctJREFUeJzt3XecFeXZ//HPlyadpSggWNAfatSo\njxJFYxIsMZYY8GeX2BULGo0llthiJUaTiEYNKiqJsRvF3kIsiCJYUDRGHo1KUUSKwKJxd6/njzOL\nS9nd2WXPOTuH75vXvPbMPTP3XOclXtx7zT0zigjMzCw7WhQ7ADMzaxgnbjOzjHHiNjPLGCduM7OM\nceI2M8sYJ24zs4xx4jYzyxgnbjOzjHHiNjNrYpJGS5ot6e0abVtJelnSG5ImSdo2aZekkZKmSZoi\naet6+2+ud04es/5+zTMwK6rzyhYUOwRrhtZ/42mtah/fzPkgdc5p3WODOs8n6YfAImBMRGyetD0F\n/CEiHpe0J/CriBiUfD4Z2BPYDrgmIrarq3+PuM3MmlhEPA/MXb4Z6Jx87gLMTD4PJpfgIyJeBsok\n9a6r/1ZNGayZWWZVVabeVdIwYFiNplERMaqew04FnpR0FblB8w5Jex/gkxr7TU/aZtXWkRO3mRlA\nZUXqXZMkXV+iXt4JwC8j4n5JBwC3ALs2sA/ApRIzMwAiqlIvjXQ48EDy+V5g2+TzDGCdGvv1Tdpq\n5cRtZgZQVZV+aZyZwI+SzzsD7yefxwKHJbNLBgILIqLWMgm4VGJmltP4kfQKJN0JDAJ6SJoOXAgc\nC1wjqRXwFd/WyB8jN6NkGlAOHFlf/07cZmbQoIuT9YmIg2vZtM1K9g1geEP6d+I2M4MmHXHnmxO3\nmRkQDZhVUmxO3GZmsCoXHQvOidvMDFwqMTPLnCa8OJlvTtxmZuARt5lZ5vjipJlZxvjipJlZtkS4\nxm1mli2ucZuZZYxLJWZmGeMRt5lZxlR+U+wIUnPiNjMDl0rMzDLHpRIzs4zxiNvMLGOcuM3MsiV8\ncdLMLGNc4zYzyxiXSszMMsYjbjOzjPGI28wsYzziNjPLmAq/SMHMLFs84jYzyxjXuM3MMsYjbjOz\njPGI28wsYzziNjPLGM8qMTPLmIhiR5CaE7eZGWSqxt2i2AGYmTULVVXpl3pIGi1ptqS3l2s/WdK/\nJE2VdGWN9nMkTZP0nqSf1Ne/R9xmZtDUFydvA64DxlQ3SNoJGAxsGRFfS1orad8UOAjYDFgbeEbS\nRhFRWVvnHnGbmQFUVqZf6hERzwNzl2s+ARgREV8n+8xO2gcDd0XE1xHxITAN2Lau/p24zcygQaUS\nScMkTaqxDEtxho2AH0h6RdJzkr6XtPcBPqmx3/SkrVYulZiZQYMuTkbEKGBUA8/QCugGDAS+B9wj\naYMG9rG0IzMzy/8NONOBByIigImSqoAewAxgnRr79U3aauVSiZkZEFWRemmkB4GdACRtBLQB5gBj\ngYMkrSGpH9AfmFhXRx5xm5lBk87jlnQnMAjoIWk6cCEwGhidTBH8L3B4MvqeKuke4B2gAhhe14wS\ncOI2M8tJMVskrYg4uJZNP69l/8uAy9L278RtZgaZunPSibtAjrjyRLbYeRsWfrGAC39y2ir3t8O+\nP2Kvk/YD4NHr7uOl+5+jTds2HH/96ay5Xi+qKquY8uwk7v/tHat8Lmsa3S86nfY/3I7KufOZuV/t\ns8fabLYRvW8fyednX0b5My+s0jlbdO7Emlf+mlZr96Ji5qd8fualVC1cRIc9d6bLEQeCRFV5OV9c\nNpJv/v3BKp0r8zKUuH1xskDG3zeOPx5+aYOPO/Ou39C975rLtHXo0pG9TzmAy4ecw2WDz2bvUw6g\nfecOADx501jO3+UULt7rTDbcZhM2H/Q/TRK/rbpFY5/isxPPrXunFi3oesoxLHl5coP6bjtgC3pc\nfOYK7V2OOpCvXnmdGT87gq9eeZ0uRx0EQMWMT/n06NOZuf8wFoy6gx7nn9qg85WkiPRLkeVtxC1p\nE3J3BFVPJJ8BjI2Id/N1zubs/YnvrpCA11y3J0MvOYZO3Trz9ZL/MuacG/j0f2fW29dmP9qSd158\nk8ULFgHwzotvsvmgrZg4djzvTZgKQOU3FXw89QO69ure9F/GGuXr196i1do969yn88GDKX/2RdbY\nbONl2w/fnw67/Qi1bk35uPHMv2FMLT0sq/2gHfj0mDMAWPTw0/S6+SrmXXMzX7/5zrdxTXmXlj3X\nrK2L1cfqPuKWdBZwFyBy01omJp/vlHR2Ps6ZRYddcTx/u/AWLtn7LO69fAxDLzk21XFlPbszd+YX\nS9fnzZpLWc9lE3S7zu3ZcpcBvDt+SpPGbPnTcq3utN9pRxbe8/Ay7W2334bW6/Zh1tCTmHng8bT5\nTn/W2Pq76frs3pXKObk7ryvnzKVl964r7NNxn91Z8uKrq/4Fsq4q0i9Flq8R99HAZhHxTc1GSb8H\npgIj8nTezFijfVs23GYjjr/+9KVtrdu0BuD7++/ELkfuCcBa6/XilFvPpeKbCuZ8Mpvrj/tdvX23\naNmCYSN/ybO3PcacT2bXu781D93OPJF519y8wq/i7QZuQ7vtt2Htu28EQO3a0nrdPnz92lv0/stI\n1KYNateWFl06Ld1n7h9v5qsJk1Y4RyzXd9sBW9JxyB58eqRLJU05qyTf8pW4q8g95eqj5dp7J9tW\nKrnffxjA97v9D5t0atTdoJmgFqL8y3Iu3nPFuuT4e8cx/t5xQK7GPfqM6/hi+udLt8//7As2HrjZ\n0vWuvbvx3stTl64fdsXxzP5wFs+MfjSP38CaWptN+7Pmb3M18BZlXWi34/dyyURi/i13sej+Ff97\nzjr0F0Cuxt3xZz9hzgXL/sNe+cU8Wvbolhtt9+hG1dz5S7e17t+P7heexmfDz6VqwcI8frNsiNW9\nVAKcCjwr6XFJo5LlCeBZ4JTaDoqIURExICIGlHLSBvhq0RLmfDKbbfbcfmlb3++sl+rYqc+9yaY/\n2JL2nTvQvnMHNv3Blkx97k0Ahpx+EO06teeui2/NS9yWPzP2Oozpex7K9D0PpfyZF/ji8mspH/cS\nSyZMotOQn6B2bYFcSaVF17JUfZY/N4GOe/8YgI57/5jyf76U66PXmqx19YXMOe+3VHxc593Vq4/V\nvVQSEU8kt3Ruy7IXJ1+t746gUnXsyFPZeOBmdOzaiSsn/Jmxf7ibm0+5hp9fdiw/PXlfWrZqycSH\nxzP93eV/SVnR4gWLeGTk/Zw3NldxemTkfSxesIiuvbrx05P3Y9a06Zz/aO4Z7eNuf4IX7n42r9/N\n0ulxxbm0HbAFLcu60PfJvzH/hjGoVe5/wYX3PVLrcV9NmMyifuvSe8xIAKrKlzDn1yOomje/1mOq\nLRh9F2teeT4d99mDipmf8fmvcjObyoYdSouyznQ/Nzdij4pKZg0dvqpfMdsy9LJgLV/zai6OWX+/\n5hmYFdV5ZQuKHYI1Q+u/8bRWtY/FFw9NnXM6XHDHKp9vVfgGHDMzgIrsFAOcuM3MIFOlEiduMzNo\nFhcd03LiNjMjW9MBnbjNzMAjbjOzzHHiNjPLGN/ybmaWLavwLsmCc+I2MwOXSszMMsezSszMMsYj\nbjOzjHHiNjPLlqh0qcTMLFtKYcQtqVtdB0bE3KYPx8ysOEplOuBkIMi95Hd5AZT2K2rMbPVSCok7\nIvoVMhAzs6LKTom7/hq3JAFDgX4RcYmkdYFeETEx79GZmRVIVGQnc6d5WfD1wPbAIcn6QuBPeYvI\nzKwYqhqwFFmaWSXbRcTWkl4HiIh5ktrkOS4zs4IqlYuT1b6R1JLcBUkkrUmz+DfHzKwJZSirpUnc\nI4G/Az0lXQbsB5yX16jMzAosSyPuemvcEXEH8CvgcmAmMCQi7s13YGZmBdWENW5JoyXNlvT2Srad\nLikk9UjWJWmkpGmSpkjaur7+01ycBGgPtEz2b5fyGDOzzIiK9EsKtwG7L98oaR1gN+DjGs17AP2T\nZRhwQ32d15u4JV0A3A50A3oAt0pyqcTMSkpUpV/q7SvieWBld5f/gVwFo2ZdZjAwJnJeBsok9a6r\n/zQ17qHAlhHxFYCkEcAbwKUpjjUzy4YGXJyUNIzc6LjaqIgYVc8xg4EZEfFm7vaYpfoAn9RYn560\nzaqtrzSJeybQFvgqWV8DmJHiODOzzEgzkl66by5J15moa5LUHjiXXJlkldX1kKlryQ3nFwBTJT2d\nrP8Y8F2TZlZSGpK4G2FDoB9QPdruC7wmaVtyA+F1auzbl3oGx3WNuCclPyeTmw5Y7Z8Ni9fMrPmL\nypU9T6+J+o54C1irel3Sf4ABETFH0ljgJEl3AdsBCyKi1jIJ1P2QqdubJmQzs+avKUfcku4EBgE9\nJE0HLoyIW2rZ/TFgT2AaUA4cWV//aR4y1R+4AtiUXK0bgIjwY13NrGREVdONuCPi4Hq2r1/jcwDD\nG9J/mnnct5KbV1gB7ASMAf7akJOYmTV3TTkdMN/SJO52EfEsoIj4KCIuAvbKb1hmZoUVodRLsaWZ\nDvi1pBbA+5JOIne1s2N+wzIzK6zmMJJOK03iPoXcLe+/AC4BdgYOz2dQZmaFVpXHWSVNrd7EHRGv\nJh8XkeJqp5lZFjXlxcl8q+sGnIdZ9n76ZUTEz/ISkZlZEZRE4gauKlgUZmZFFtl5HHedN+A8V8hA\nzMyKqVRG3GZmq43mMM0vLSduMzOgspRmlZiZrQ5KYsTtWSVmtjoplRp39ayS/w/04tvnkxwMfJbP\noMzMCq2kZpVIujoiBtTY9LCkSbUcZmaWSaUy4q7WQdIGEfEBgKR+QIf8hmVmVliVVWmeudc8pEnc\nvwT+KekDQMB6wHF5jcrMrMBKolRSLSKeSF6msEnS9K+I+Dq/YZmZFVZVKcwqqZa8nfg0YL2IOFZS\nf0kbR8Qj+Q/PzKwwsjQdMO0bcP4LbJ+szwAuzVtEZmZFEJF+KbY0Ne4NI+JASQcDRES5kvfL59Nt\nMyfk+xSWQTdMeqHYIViJKqlSCfBfSe1IbsaRtCHgGreZlZRSm1VyEfAEsI6kO4Dv4xcqmFmJaQYV\nkNTSzCp5StJkYCC56YCnRMScvEdmZlZAJVUqkfRsROwCPLqSNjOzkpClWSV1PWSqLbmXBPeQ1JXc\naBugM9CnALGZmRVMhl7yXueI+zjgVGBtYDLfJu4vgevyHJeZWUEFJTDijohrgGsknRwR1xYwJjOz\ngqvIUKkkzfyXKkll1SuSuko6MY8xmZkVXKDUS7GlSdzHRsT86pWImAccm7+QzMwKr6oBS7Glmcfd\nUpIiovoGnJZAm/yGZWZWWM1hJJ1WmsT9BHC3pD8n68clbWZmJaM5jKTTSpO4zyKXrE9I1p8Gbs5b\nRGZmRVCZoRF3vTXuiKiKiBsiYr9k+XNEVBYiODOzQqlS+qU+kkZLmi3p7Rptv5P0L0lTJP19uUkf\n50iaJuk9ST+pr/9aE7eke5KfbyUnWmapP3Qzs+yoQqmXFG4Ddl+u7Wlg84jYAvg3cA6ApE2Bg4DN\nkmOuT64l1qquUskpyc+fponSzCzLmvIhUxHxvKT1l2t7qsbqy8B+yefBwF3Jm8U+lDQN2Bao9dnW\ndd2AMyv5+VGjIjczy5CGXJyUNAwYVqNpVESMakAXRwF3J5/7kEvk1aZTz2NF6npWyULq+EcoIjqn\nj9HMrHmrasD7YZIk3ZBEvZSkXwMVwB2NOR7qHnF3Sk5yCTAL+Au555UMBXo39oRmZs1RIWZcSDqC\nXPl5l+p7Y8i9DnKdGrv1TdpqlebOyZ9FxPURsTAivoyIG8jVZMzMSkZTzipZGUm7A78il1PLa2wa\nCxwkaQ1J/YD+wMS6+kqTuBdLGiqppaQWkoYCixsXuplZ89SUs0ok3Unu4uLGkqZLOprcU1U7AU9L\nekPSjQARMRW4B3iH3M2Nw+ubcp3mBpxDgGuSJYDxSZuZWclo4lklB6+k+ZY69r8MuCxt/2leXfYf\nXBoxsxLX2BJIMdRbKpG0kaRnq+8AkrSFpPPyH5qZWeFk6emAaWrcN5G7w+cbgIiYQu4uHzOzklGp\n9Euxpalxt4+IiVp2jmNFnuIxMyuK5jCSTitN4p4jaUOS2r2k/cjN6zYzKxmllriHk7tDaBNJM4AP\nyd2EY2ZWMjL0ysm6E7ekFsCAiNhVUgegRUQsLExoZmaFk6URd50XJyOiitydPkTEYidtMytVlQ1Y\nii1NqeQZSWeQe5LV0jsmI2Ju3qIyMyuwLM3jTpO4D0x+Dq/RFsAGTR+OmVlxZKlUkubOyX6FCMTM\nrJhKKnFLagucCOxIbqT9AnBjRHyV59jMzAqmKZ9Vkm9pSiVjgIXAtcn6IeSezb1/voIyMyu0Uqtx\nbx4Rm9ZYHyfpnXwFZGZWDM1htkhaaZ5V8pqkgdUrkrYDJuUvJDOzwqsiUi/FlmbEvQ3wkqSPk/V1\ngfckvQVE8qp5M7NMK6mLk8DueY/CzKzIij+OTi/NdMCPChGImVkxldqI28ys5FUoO2NuJ24zM0qs\nVGJmtjpwqcTMLGOawzS/tJy4zcxwqcTMLHNcKjEzy5jKDI25nbjNzPCI28wsc8IjbjOzbPGI2xpt\no4025G933LB0fYN+63LRb66irKwzRx91CJ/Pyb3q8/zzR/D4E/8oVpjWCOdd/nueHz+Rbl3LePCv\nN66wfeGixZx98ZXM+uxzKisqOeKQfdlnr91W6ZwLvlzI6edfwcxPP2PtXj25+pJz6NK5E488+Q9u\nueNeCGjfvh3nn3ESm/Rfvd9GmKXpgGke62oF9O9//y8DvrcbA763G9tutzvl5Ut48KHHAbhm5E1L\ntzlpZ8+QPX/Mjb+/tNbtd97/MBuuvy4P3H49t173W3537U188803qfqe+NoUfn3p1Su03/yXexg4\nYCseu/sWBg7Yilv+eg8AfdbuxW3XXcnf/3IDxx9xML+5cmTjvlQJiQYsxebE3YztsvOOfPDBR3z8\n8Yxih2JNYMBW36VL5061bpfE4vIlRATlS76iS+dOtGzZEoDRd9zHgUf/gn0OO4Hrbv5L6nOOe2EC\ng/fYFYDBe+zKP56fAMD/fHfTpbFssdkmfDZ7TmO/VsmoIFIvxVbwxC3pyEKfM6sOOGAwd9394NL1\nE084ktcmP81No66mrKxLESOzfDhk37354D+fsNPgoexz2AmcferxtGjRgvGvTObj6TO46+ZruP+2\nP/HOe9OY9MZbqfr8Yt581uzRDYAe3bvyxbz5K+zzwCNPsuPAAU36XbIoGvCn2Iox4v5NbRskDZM0\nSdKkqqrFhYyp2WndujV7/3Q37rv/EQBu/PMYNtpkB7YZsBuffjqb3115QZEjtKY2fuJkNum/AeMe\nuoP7b/sTl//+ehYtXsxLr77GSxNfY78jTmL/I0/mw48+4aNPZgJw8LGnsu/hw7lwxB8Z9+LL7Hv4\ncPY9fDjjX5m8Qv+SkJZ9seLEyW/ywCNPcdqJRxXkOzZnVQ1Y6iNptKTZkt6u0dZN0tOS3k9+dk3a\nJWmkpGmSpkjaur7+83JxUtKU2jYBPWs7LiJGAaMAWrXpU/x/1opo99134vXX32J28ivs7Bq/yt58\nyx089ODtxQrN8uTvjz7NMT8/AEms23dt+vTuxYcfTYeAYw49kAOG7LnCMXfe9EcgV+N+6LGnuey8\n05fZ3r1rGZ/PmcuaPbrx+Zy5dKvxm9p70z7kghF/5MarL6GsS+f8frkMaOKR9G3AdeRetl7tbODZ\niBgh6exk/SxgD6B/smwH3JD8rFW+Rtw9gcOAvVeyfJGnc5aUgw4cskyZpFevtZZ+HjJ4D6ZOfa8Y\nYVke9e65Ji9PfgOAOXPn8Z+Pp9N37V7ssO3W/P3RpygvXwLAZ5/PWWnJY2UG7TiQhx5/BoCHHn+G\nnX6wPQCzPp3NqedewhUXnMn66/bNw7fJnqYccUfE88Dc5ZoHA9UjrtuBITXax0TOy0CZpN519Z+v\n6YCPAB0j4o3lN0j6Z57OWTLat2/Hrrv8kBNOPGtp24grzmPLLTclIvjoo+nLbLNsOPPCEbz6+hTm\nz/+SXYb8nBOPPpSKigoADtxnL44/4hB+fdnV7HPoCUQEvzzxKLqWdeH7223DBx99wtDjTgOgfbu2\nXHHBmXTvWlbvOY859ABOP/9yHnjkSdbutRZXX3IuADfc+jcWfLmQS6/6EwAtW7bkntGr98ySysj7\nL/k9I2JW8vlTvq0+9AE+qbHf9KRtFrVQ5D/YRlndSyW2cktmvlDsEKwZat1jA9W/V90OWW+f1Dnn\nzo8fPA4YVqNpVFLqXUrS+sAjEbF5sj4/IspqbJ8XEV0lPQKMiIgXk/ZngbMiYlJt5/cNOGZmNKzG\nXfN6XAN8Jql3RMxKSiGzk/YZwDo19uubtNXK87jNzGjaGnctxgKHJ58PBx6q0X5YMrtkILCgRkll\npTziNjOjaW95l3QnMAjoIWk6cCEwArhH0tHAR8ABye6PAXsC04ByoN57XZy4zcxo2umAEXFwLZt2\nWcm+AQxvSP9O3GZmFGRWSZNx4jYzI1tPB3TiNjPDz+M2M8uc5vDwqLScuM3McKnEzCxzmutd5Cvj\nxG1mBlR6xG1mli0ulZiZZYxLJWZmGeMRt5lZxng6oJlZxviWdzOzjHGpxMwsY5y4zcwyxrNKzMwy\nxiNuM7OM8awSM7OMqYzsPNjVidvMDNe4zcwyxzVuM7OMcY3bzCxjqlwqMTPLFo+4zcwyxrNKzMwy\nxqUSM7OMcanEzCxjPOI2M8sYj7jNzDKmMiqLHUJqTtxmZviWdzOzzPEt72ZmGZOlEXeLYgdgZtYc\nVEWkXuoj6ZeSpkp6W9KdktpK6ifpFUnTJN0tqU1jY3XiNjMjN6sk7Z+6SOoD/AIYEBGbAy2Bg4Df\nAn+IiP8HzAOObmysTtxmZuRueU+7pNAKaCepFdAemAXsDNyXbL8dGNLYWJ24zczI1bjTLvX0MwO4\nCviYXMJeAEwG5kdERbLbdKBPY2N14jYzo2E1bknDJE2qsQyr7kdSV2Aw0A9YG+gA7N6UsXpWiZkZ\nDZtVEhGjgFG1bN4V+DAiPgeQ9ADwfaBMUqtk1N0XmNHYWD3iNjMjN4877VKPj4GBktpLErAL8A4w\nDtgv2edw4KHGxurEbWZGk9a4XyF3EfI14C1yeXYUcBZwmqRpQHfglsbGquY66bxVmz7NMzArqiUz\nXyh2CNYMte6xgVa1jw7t10+dcxaX/2eVz7cqXOM2M8OPdTUzy5zmWn1YGSduMzP8PG4zs8zxiNvM\nLGOyVONutrNK7FuShiUT/s2W8t+L1ZfncWfDsPp3sdWQ/16sppy4zcwyxonbzCxjnLizwXVMWxn/\nvVhN+eKkmVnGeMRtZpYxTtzNnKTdJb2XvGD07GLHY8UnabSk2ZLeLnYsVhxO3M2YpJbAn4A9gE2B\ngyVtWtyorBm4jSZ+o4plixN387YtMC0iPoiI/wJ3kXslkq3GIuJ5YG6x47DiceJu3voAn9RYX6UX\njJpZaXDiNjPLGCfu5m0GsE6N9VV6waiZlQYn7ubtVaC/pH6S2gAHAWOLHJOZFZkTdzMWERXAScCT\nwLvAPRExtbhRWbFJuhOYAGwsabqko4sdkxWW75w0M8sYj7jNzDLGidvMLGOcuM3MMsaJ28wsY5y4\nzcwyxonbmpSkMkkn5rH/IyRdV88+F0k6o4H9Llq1yMwKx4nbmloZsNLELalVgWMxK0lO3NbURgAb\nSnpD0u8kDZL0gqSxwDuS1q/5HGlJZ0i6KPm8oaQnJE1OjtmkrhNJ2lvSK5Jel/SMpJ41Nm8paYKk\n9yUdW+OYMyW9KmmKpN807Vc3KwyPgKypnQ1sHhFbAUgaBGydtH0oaf06jh0FHB8R70vaDrge2LmO\n/V8EBkZESDoG+BVwerJtC2Ag0AF4XdKjwOZAf3KPyxUwVtIPk8ekmmWGE7cVwsSI+LCuHSR1BHYA\n7pVU3bxGPf32Be6W1BtoA9Q8x0MRsQRYImkcuWS9I7Ab8HqyT0dyidyJ2zLFidsKYXGNzxUsW6Jr\nm/xsAcyvHqmndC3w+4gYm4zsL6qxbflnOQS5UfYVEfHnBpzDrNlxjdua2kKgUx3bPwPWktRd0hrA\nTwEi4kvgQ0n7Ayhny3rO1YVvH3N7+HLbBktqK6k7MIjckxafBI5KRvdI6iNprfRfzax58IjbmlRE\nfCFpfHIB8nHg0eW2fyPpYmAiuaT7rxqbhwI3SDoPaE3uVW1v1nG6i8iVVuYB/wD61dg2BRgH9AAu\niYiZwExJ3wEmJOWYRcDPgdmN/LpmReGnA5qZZYxLJWZmGePEbWaWMU7cZmYZ48RtZpYxTtxmZhnj\nxG1mljFO3GZmGePEbWaWMf8HE33roRW+lBwAAAAASUVORK5CYII=\n",
            "text/plain": [
              "<Figure size 432x288 with 2 Axes>"
            ]
          },
          "metadata": {
            "tags": []
          }
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "4dLd-ITq8TQQ",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 170
        },
        "outputId": "e69ff558-e923-4158-fd87-ddd447d155cd"
      },
      "source": [
        "print(classification_report(y_test, yfit_ps))"
      ],
      "execution_count": 224,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "              precision    recall  f1-score   support\n",
            "\n",
            "        -1.0       0.58      0.43      0.49       237\n",
            "         1.0       0.57      0.71      0.63       256\n",
            "\n",
            "    accuracy                           0.57       493\n",
            "   macro avg       0.57      0.57      0.56       493\n",
            "weighted avg       0.57      0.57      0.57       493\n",
            "\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "3bJIFl-Q8TQT",
        "colab_type": "text"
      },
      "source": [
        "## Random Forest"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "BVuyq0d_8TQU",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "from sklearn.ensemble import RandomForestClassifier"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "YktLD7Zt8TQe",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 190
        },
        "outputId": "4ad405cd-4d65-4513-ce86-e144a6715e02"
      },
      "source": [
        "clf_rf = RandomForestClassifier()\n",
        "clf_rf.fit(X_train, y_train )"
      ],
      "execution_count": 226,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "/usr/local/lib/python3.6/dist-packages/sklearn/ensemble/forest.py:245: FutureWarning: The default value of n_estimators will change from 10 in version 0.20 to 100 in 0.22.\n",
            "  \"10 in version 0.20 to 100 in 0.22.\", FutureWarning)\n"
          ],
          "name": "stderr"
        },
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "RandomForestClassifier(bootstrap=True, class_weight=None, criterion='gini',\n",
              "                       max_depth=None, max_features='auto', max_leaf_nodes=None,\n",
              "                       min_impurity_decrease=0.0, min_impurity_split=None,\n",
              "                       min_samples_leaf=1, min_samples_split=2,\n",
              "                       min_weight_fraction_leaf=0.0, n_estimators=10,\n",
              "                       n_jobs=None, oob_score=False, random_state=None,\n",
              "                       verbose=0, warm_start=False)"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 226
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "Dxunjt1R8TQk",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 71
        },
        "outputId": "4250187f-488b-4641-9f8d-e2ec48f52e0d"
      },
      "source": [
        "param_grid2 = {'max_depth':[4,5,6,7]}\n",
        "grid2 = GridSearchCV(clf_rf, param_grid2)\n",
        "rf_best = grid2.fit(X_train,y_train)\n",
        "yfit_rf_best = rf_best.predict(X_test)"
      ],
      "execution_count": 227,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "/usr/local/lib/python3.6/dist-packages/sklearn/model_selection/_split.py:1978: FutureWarning: The default value of cv will change from 3 to 5 in version 0.22. Specify it explicitly to silence this warning.\n",
            "  warnings.warn(CV_WARNING, FutureWarning)\n"
          ],
          "name": "stderr"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "OIYrGHA88TQr",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 34
        },
        "outputId": "4beae466-ef55-4889-fd9b-522034885d1b"
      },
      "source": [
        "#Gridsearch\n",
        "rf_score = accuracy_score(y_test, yfit_rf_best)\n",
        "rf_score"
      ],
      "execution_count": 228,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "0.6085192697768763"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 228
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "IF8SP4J_8TQy",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 283
        },
        "outputId": "4ca280ad-96e7-4763-e60b-4e510e5ea912"
      },
      "source": [
        "from sklearn.metrics import confusion_matrix\n",
        "mat = confusion_matrix(y_test, yfit_rf_best)\n",
        "sns.heatmap(mat , annot=True)\n",
        "plt.xlabel('true label')\n",
        "plt.ylabel('predicted label');"
      ],
      "execution_count": 229,
      "outputs": [
        {
          "output_type": "display_data",
          "data": {
            "image/png": "iVBORw0KGgoAAAANSUhEUgAAAW4AAAEKCAYAAAAyx7/DAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4zLCBo\ndHRwOi8vbWF0cGxvdGxpYi5vcmcvnQurowAAHG1JREFUeJzt3XmcVmX5x/HPd9hBQBAEQkBQ0NSf\nG7lVKm65h7uoFSoGWirlbpqSaJqplbuYJpWKpj/KXFAjc8VUxHD/uWWyr7IMaMzM9fvjecBHYGbO\nMM92hu/b13nNc+7zPPe5ntdruOb2Ove5jyICMzNLj4pSB2BmZg3jxG1mljJO3GZmKePEbWaWMk7c\nZmYp48RtZpYyTtxmZinjxG1mljJO3GZmKdO81AHU5uJNj/ctnbaGE9vOL3UIVoY2f+txNbaPFfM+\nTJxzWnTp1+jzNYZH3GZmKVO2I24zs6KqqS51BIk5cZuZAVRXlTqCxJy4zcyAiJpSh5CYE7eZGUCN\nE7eZWbp4xG1mljK+OGlmljIecZuZpUt4VomZWcr44qSZWcq4VGJmljK+OGlmljIecZuZpYwvTpqZ\npYwvTpqZpUuEa9xmZuniGreZWcq4VGJmljIecZuZpUz1ilJHkJgTt5kZuFRiZpY6LpWYmaWMR9xm\nZinjxG1mli7hi5NmZinjGreZWcq4VGJmljIecZuZpYxH3GZmKeMRt5lZylT5QQpmZumSxxG3pDuB\nQ4A5EbFNtu0+YIvsWzYEPo2I7SVtCrwNvJs99mJEnFpX/07cZmaQ7xr3XcCNwO9XNkTEsStfS7oW\nWJTz/g8iYvuknTtxm5lBXkfcEfFMdiS9BkkCjgH2Xtf+K9b1g2ZmTUpNTfKtcXYHZkfEezltfSVN\nkfS0pN3r68AjbjMzaNCIW9JwYHhO05iIGJPw48cB9+bszwR6R8R8SQOBP0vaOiIW19aBE7eZGTRo\nVkk2SSdN1KtIag4cAQzM6etz4PPs68mSPgAGAK/U1o8Tt5kZQEQxzrIv8E5ETFvZIKkrsCAiqiX1\nA/oDH9bViWvcZmaQ1xq3pHuBScAWkqZJGpY9NIQvl0kA9gCmSnoNeAA4NSIW1NW/R9xmZpDX6YAR\ncVwt7Seupe1B4MGG9O/EbWYGvuXdzCx1qqtLHUFiTtxmZuDVAc3MUseJ28wsZVzjNjNLl6gpyjzu\nvHDiNjMDl0rMzFLHs0rMzFLGI25b3eFXD2eLvXegcv5ibtj//Eb3t8ORu7Pn6YcD8PSN45ny4LO0\naN2SITePpHOfbtRU1/DuxFd54hfjGn0uy4+NLz+LtnvuQvWCT/lk8Iha39dqmwFscs+vmXXOz6l8\n4rlGnbOiY3u6X/sTmvfsRtX02cw66wpqFi9lg0P2otOwY0CipnI5cy+7gf++W+fyGE1fihK31yop\nkikPPMPYob9o8OeGjbuYDTfp8qW2Nh3bsdfII7ntsJ9y6+CfstfII2ndoR0Az93+CL/Z5xxuPvhC\neg8cQP9B2+Ulfmu8xeOfYObwi+p+U0UFG501jGUvTG5Q32122paNrzh7jfZOpxzDshen8J8DT2bZ\ni1PodErmISxV02Yzfei5fHLYqSy89W42/tnIBp2vSYpIvpVYwUbckrYEBgM9s03TgYci4u1CnbOc\n/fuld9ZIwJ17b8who0+iXecOrFj+OX++8LfM+2BGvX3133NbPnjudZYvqgTgg+deZ8CgbZn60CQ+\nmvQWANUrqpnx5r/p2L1z/r+MrZPPJr9B8690q/M9HU8YTOWTz9FqmwFfat/w5KPYYP89UMsWVE58\ngQU3/iHROdvtvRvTh54HwJI//42eY69m/nV38Nlrb30R17/eoXm3LrV1sf5Y30fcks4HxgECXspu\nAu6VdEEhzplGg688hUcuHcsth17EhJ/fzbdHn5Toc+27dWbRjPmr9hfNXED7bl9O0K07tGXLfXbk\ng+ffzGvMVjjNNt6IDfb9OovGPfyl9jZf35EWvXsy7dgz+eSIH9Bqq/60HrhNsj436kT1vMxCc9Xz\nFtBso05rvKfDkQdQ+ezLjf8CaVcTybcSK9SIexiwdUSsyG2UdB3wJnBVgc6bGi3btqL3wAEMufnM\nVW3NWrYAYMej92S3k/YHoHOf7nzvd+dRvaKKhZ/M5Z4Rv6q374pmFRxz/elMumsCCz+ZU5gvYHnX\n9cJTmXftHWv8r3jbbwyk7Td2pNf/3gyA2rahRZ+efDb5DTYZ9xvUsgVq24ZmHduves/8a+9g2fNr\nKbes1nebnbejwxH7M+07ZxXmS6WJZ5VQA3wF+Hi19h7ZY2uV+zigAzvvxI7tNy9QeKWnigo+W1zJ\nTQf9ZI1jr/7paV7909NApsb94Dm38um0eauOL5m9gL67brVqv2OPznz04hf/6zv4ylOY/9EsJt05\noYDfwPKt1dYD6H7thQA069SRtnvsnEkmEgtvv4/F9z+6xmemDcnUptvstC3tD9uPORdd+6Xj1fMX\n0qxL58xou0tnqhd8uupYywF92fiyHzFjxMXULFpSwG+WDrG+l0qAHwETJT0maUx2mwBMBGq9ChIR\nYyLiaxHxtaactAE+X7qchZ/MZeuDdlnV1v2rvRN99r2np7L57v9D6w7taN2hHZvv/j+89/RUAPY9\n+2hat2/Lo5clq4Fa+fj4W0P5eL/MtvTxZ5k7+gYqJ05i2XOv0OGI/VHb1kCmpNKsc8dEfVY+9SLt\nD9sXgPaH7Uvl3ycB0LxHV7pffwmzL/glKz6eXpgvlDbre6kkIiZIGgDszJcvTr4cEen5/5E8Oub6\n0+m761dp26k95066gb//6kH+NPImDr3iZAadcRjNmjfj9b9OYtbb/6m3r+WLKnnq+vGc9tBoAJ66\nfjzLF1XSoXtnBp1xOHPen84PHrkCgBfHPsHk+/5RyK9mCXX75QW02Xlbmm3YkU3//kfm3/gH1CLz\nT3DxfY/U+rnlL7zKkn692eSeXwMQy5Yz6/yrYcGies+58Pb76P6ri+hw5AFUzZjDrLMyvxedTjuB\nZh3b0/WS0zN9VlUz7ZgzGvsV0y1Fa5UoymBqy9pcvOnx5RmYldSJbefX/yZb72z+1uNqbB+Vl52Q\nOOe0u+TuRp+vMXwDjpkZQFV6igFO3GZmkKpSiRO3mRmUxUXHpJy4zcxI13RAJ24zM/CI28wsdZy4\nzcxSxre8m5mli585aWaWNk7cZmYp41klZmYp4xG3mVnKpChx+5mTZmZAVNck3uoj6U5JcyS9kdM2\nStJ0Sa9lt4Nyjl0o6X1J70rav77+PeI2M4N8j7jvAm4Efr9a+68i4prcBklbAUOArck8gOZvkgbU\ntQR2rYlbUp1PmY2IBXXHbWaWHvmcDhgRz0jaNOHbBwPjIuJz4CNJ75N5lsGk2j5Q14h7MhBkHvK7\nRlxAv4RBmZmVv+LUuE+X9D3gFeDsiFhI5mEzL+a8ZxpfPIBmrWqtcUdE34jol/25+uakbWZNS03y\nTdJwSa/kbMMTnOEWYDNge2AmcG3db69dvTVuSQJOAPpGxGhJvYHuEfHSup7UzKzcRFXyedwRMQYY\n06D+I2avfC3pduDh7O50oFfOWzfJttUqyaySm4HdgOOz+0uAm5IGa2aWCg0Yca8LST1ydg8HVs44\neQgYIqmVpL5Af6DOgXGSWSW7RMSOkqYARMRCSS3XIW4zs7KVz4uTku4FBgFdJE0DLgUGSdqezDXC\nfwMjACLiTUn3A28BVcAP63uoepLEvUJSs+zJkNSVdf6bY2ZWpvKY1SLiuLU031HH+68Arkjaf5LE\nfT0wHugm6QrgKODipCcwM0uDJrU6YETcLWkysE+26bCIeLuwYZmZFVmK6ghJ75xsC6wsl7QpXDhm\nZqURVaWOILl6Z5VIugQYC3QGugC/k+RSiZk1KVGTfCu1JCPuE4DtIuIzAElXAa8BlxcyMDOzoiqD\nhJxUksQ9A2gNfJbdb0U9k8PNzNKmHEbSSdW1yNQNZGrai4A3JT2Z3d+PeiaHm5mlTZNI3GQWQYHM\nYlPjc9r/UbBozMxKJKrXtp5eeao1cUfE2GIGYmZWSk1lxA2ApP7AlcBWZGrdAHiFQDNrSqImPSPu\nJItM/Y7McoRVwF5knujwx0IGZWZWbGmaDpgkcbeJiImAIuLjiBgFHFzYsMzMiitCibdSSzId8HNJ\nFcB7kk4nMxVwg8KGZWZWXOUwkk4qSeIeSeaW9zOB0cDewNBCBmVmVmw1TWFWyUoR8XL25VLgpMKG\nY2ZWGmm6OFnXDTh/JbsG99pExLcLEpGZWQk0icQNXFO0KMzMSizSsxx3nTfgPF3MQMzMSqmpjLjN\nzNYb5TDNLyknbjMzoLopzSoxM1sfNIkRt2eVmNn6pKnUuFfOKjkC6M4X65McB8wuZFBmZsXWpGaV\nSLo2Ir6Wc+ivkl6p5WNmZqnUVEbcK7WT1C8iPgSQ1BdoV9iwzMyKq7omyZp75SFJ4v4x8A9JHwIC\n+gAjChqVmVmRNYlSyUoRMSH7MIUts03vRMTnhQ3LzKy4aprCrJKVJLUFzgL6RMT3JfWXtEVEPFz4\n8MzMiiNN0wGTPgHnv8Bu2f3pwOUFi8jMrAQikm+llqTGvVlEHCvpOICIWCap4H+arprhpVJsTZfO\neLbUIVgTlaZSSZIR938ltSF7M46kzQDXuM2sSamuqUi81UfSnZLmSHojp+2Xkt6RNFXSeEkbZts3\nlbRc0mvZ7db6+k+SuEcBE4Beku4GJgLnJ/icmVlqRAO2BO4CDlit7Ulgm4jYFvg/4MKcYx9ExPbZ\n7dT6Ok8yq+QJSZOBXclMBxwZEfOSxW5mlg75LJVExDOSNl2t7Ymc3ReBo9a1/3pH3JImRsT8iHgk\nIh6OiHmSJq7rCc3MylGRn/J+MvBYzn5fSVMkPS1p9/o+XNciU63JPCS4i6ROZEbbAB2Ano0I2Mys\n7DTkIe+ShgPDc5rGRMSYhJ+9CKgC7s42zQR6R8R8SQOBP0vaOiIW19ZHXaWSEcCPgK8Ak/kicS8G\nbkwSoJlZWgTJR9LZJJ0oUeeSdCJwCLBPRGZiYfaGxs+zrydL+gAYANS6JlRdi0z9BviNpDMi4oaG\nBmhmliZVBZ4OKOkA4Dxgz4hYltPeFVgQEdWS+gH9gQ/r6ivJrJKaldNWsifpJOkH6xa6mVl5CpR4\nq4+ke4FJwBaSpkkaRqZS0R54crVpf3sAUyW9BjwAnBoRC+rsP+q5DUjSaxGx/WptUyJih3qjb4Tm\nLXuWwf1JVm6W+wYcW4sWXfo1erj8ZLdjE+ec/WbfV9K7dZLcOdlMklbWYyQ1A1oWNiwzs+JqSI27\n1JIk7gnAfZJuy+6PyLaZmTUZDZlVUmpJEvf5ZJL1adn9J4HfFiwiM7MSqG5KI+6IqAFuyW5mZk1S\nip5cVucNOPdHxDGSXmctt+dn77c3M2sSaprIiHtk9uchxQjEzKyU0jSNra4bcGZmf35cvHDMzEqj\nSVyclLSEOv4IRUSHgkRkZlYCNYV/Pkze1DXibg8gaTSZRVD+QGa9khOAHkWJzsysSKpLHUADJJkO\n+O2I2C5n/xZJ/wIuKVBMZmZFl6ZZJUnWKqmUdIKkZpIqJJ0AVBY6MDOzYqpBibdSS5K4jweOAWZn\nt6OzbWZmTUaeH11WUEluwPk3MLjwoZiZlU6TKpVIGiBp4sqnFUvaVtLFhQ/NzKx4ahqwlVqSUsnt\nZJ5GvAIgIqYCQwoZlJlZsVUr+VZqSWaVtI2Il/TlOY5VBYrHzKwkymEknVSSxD1P0mZka/KSjiIz\nr9vMrMloaon7h2QeirmlpOnAR2RuwjEzazIK/MjJvKozcUuqAL4WEftKagdURMSS4oRmZlY8aRpx\n13lxMrsW93nZ15VO2mbWVFU3YCu1JKWSv0k6B7iPnDsm63sKsZlZmqRpHneSxH1s9ucPc9oC6Jf/\ncMzMSiNNpZIkd072LUYgZmal1KQSt6TWwA+Ab5IZaT8L3BoRnxU4NjOzoimHNUiSSlIq+T2wBLgh\nu388mbW5jy5UUGZmxdbUatzbRMRWOftPSXqrUAGZmZVCOcwWSSrJWiWvStp15Y6kXYBXCheSmVnx\n1RCJt1JLMuIeCLwg6T/Z/d7Au5JeByIiti1YdGZmRdKkLk4CBxQ8CjOzEiv9ODq5JNMBPy5GIGZm\npZSmEXeSGreZWZNXpUi81UfSnZLmrHwATbats6QnJb2X/dkp2y5J10t6X9JUSTvW178Tt5kZeX/m\n5F2sWWa+AJgYEf2Bidl9gAOB/tltOHBLfZ07cZuZkd9Hl0XEM8Dq6zkNBsZmX48FDstp/31kvAhs\nKKlHXf0nuThpZtbkFWGaX7eIWPkQmllAt+zrnsAnOe+blm2r9YE1HnGbmdGwUomk4ZJeydmGN+hc\nEQ2ouqzJI24zMxo2qyQixpB5MlhDzJbUIyJmZkshc7Lt04FeOe/bJNtWK4+4zcyAaiLxto4eAoZm\nXw8F/pLT/r3s7JJdgUU5JZW18ojbzIz8zuOWdC8wCOgiaRpwKXAVcL+kYcDHwDHZtz8KHAS8DywD\nTqqvfyduMzMg8nhxMiKOq+XQPmt5b/DlB9XUy4nbzIx03TnpxF2G3v+/F1mydCnV1TVUVVWx624H\nsd12W3PzjVfRqnUrqqqqOOOMn/DyK6+VOlRrhJmz5/KT0dcwf+FChDhq8IF895jD6v9gHf7y6JPc\nNnYcACOGDmHwQfux/LPPOOvinzNt+kwqKioY9M1d+PFpJ+fjKzQp5bDqX1JO3GVq3/2OZv78hav2\nr/r5RYy+/DomPP4UBx6wN1ddeRH77OdnWaRZ82bNOPeM77PVFptTWbmMY4adydd32oHN+vap97Mn\nnn4eV1x0Nj17dFvVtmjxEm753T3cd8f1ABw77EwGfXNXWrZswUnHHcnOA7djxYoVDDvzQp6d9DK7\n77ZTwb5bGqUnbTtxp0ZE0L5DewA6dGzPjJmzSxyRNVbXLp3p2qUzAO3ataVfn17MnjufFi1acMV1\nN7Pw00W0btWKUReMpF+fXvX0Bs//czK77bQDHbO/J7vttAPP/3MyB+03iJ0HbgdAixYt+OoWmzN7\n7rzCfbGUqkpR6i564pZ0UkT8rtjnTZOI4LFH7yUiuP32P/LbO+7mrHMu5dGH7+Hqq35KRYXYfc/B\npQ7T8mj6zNm8/d4HbLv1Foy8cDSXnHsGfXr1ZOqb73D5NTdx5w1X1dvH7Lnz6L5x11X73bp2WSNB\nL16ylKef/yffOdq/P6vL58XJQivFiPtnwFoTd/buo+EAataRiop2xYyrbOy51+HMmDGLrl03YsJj\n43j33fc54oiDOfvcUYwf/yhHHXUot992LfsfOKTUoVoeLFu2nB9fdDnnnzmCClXw2utvc9bFP191\n/L8rVgAw/pEn+OP9mam//5k+g9PO+Sktmreg51e6cf2Vl9R7nqqqas4b9QtOOOrb9OpZ51IY66X1\n/uKkpKm1HeKL+/PXkHs3UvOWPdPz5y/PZsyYBcDcufP5y18eY6edtud73z2aH5+V+cf5wAN/Zcyt\nvyxliJYnK6qq+NFFl3Pwt/Ziv0HfYGllJe3bt+PBsTet8d7DD/4Whx/8LWDtNe5uXbvw8pQv/unN\nnjuPnXb44gFVo67+Db03+QrfPfbwAn6j9ErTiLtQd052A74HHLqWbX6BztkktG3bhg02aLfq9X77\n7smbb77LjJmz2XOP3QDYe69v8t77H5UyTMuDiOCSK39Nvz69GDrkCAA2aNeOnj268/jfn131nnfe\n+zBRf9/YZSAvvPQqixYvYdHiJbzw0qt8Y5eBAFw/ZixLly7jgpEjCvNlmoB8rg5YaIUqlTwMbBAR\na8xXk/SPAp2zSejWrSsP/OkOAJo3b8a4cX/m8Sf+wdJTz+W66y6jefPmfP7ZZ5x22nkljtQaa8rU\nN/nrhIn032xTjhyauf9i5Iih/OLS8xh9zY3cNvZeqqqqOHCfPdmyf796++vYoT0jTjyOIaeMBODU\nk46nY4f2zJozlzFjx9G3Ty+OPukMAI478lCO+rafSpirOtIz4laUabDrc6nEard8xrOlDsHKUIsu\n/dTYPo7vc3jinHPPx+Mbfb7G8HRAMzPSVeN24jYzozxq10k5cZuZ4VvezcxSx6USM7OUSdOsEidu\nMzNcKjEzSx1fnDQzSxnXuM3MUsalEjOzlCnXu8jXxonbzAyo9ojbzCxdXCoxM0sZl0rMzFLGI24z\ns5TxdEAzs5TxLe9mZinjUomZWco4cZuZpYxnlZiZpYxH3GZmKZOvWSWStgDuy2nqB1wCbAh8H5ib\nbf9JRDy6Ludw4jYzA6ojPwu7RsS7wPYAkpoB04HxwEnAryLimsaew4nbzIyC1bj3AT6IiI8l5a3T\nirz1ZGaWYjVE4k3ScEmv5GzDa+l2CHBvzv7pkqZKulNSp3WNVeV6JbV5y57lGZiV1PIZz5Y6BCtD\nLbr0a/RwdtvuuyXOOVNnTar3fJJaAjOArSNitqRuwDwggNFAj4g4eV1idanEzAyoyf8g9kDg1YiY\nDbDyJ4Ck24GH17Vjl0rMzMjMKkn6X0LHkVMmkdQj59jhwBvrGqtH3GZm5G9WCYCkdsB+wIic5qsl\nbU+mVPLv1Y41iBO3mRn5LZVERCWw0Wpt381X/07cZmZ4WVczs9QpwMXJgnHiNjPDI24zs9SpjupS\nh5CYE7eZGV7W1cwsdbysq5lZynjEbWaWMp5VYmaWMp5VYmaWMvm85b3QnLjNzHCN28wsdVzjNjNL\nGY+4zcxSxvO4zcxSxiNuM7OU8awSM7OU8cVJM7OUcanEzCxlfOekmVnKeMRtZpYyaapxK01/ZdZX\nkoZHxJhSx2Hlxb8X66+KUgdgiQwvdQBWlvx7sZ5y4jYzSxknbjOzlHHiTgfXMW1t/HuxnvLFSTOz\nlPGI28wsZZy4y5ykAyS9K+l9SReUOh4rPUl3Spoj6Y1Sx2Kl4cRdxiQ1A24CDgS2Ao6TtFVpo7Iy\ncBdwQKmDsNJx4i5vOwPvR8SHEfFfYBwwuMQxWYlFxDPAglLHYaXjxF3eegKf5OxPy7aZ2XrMidvM\nLGWcuMvbdKBXzv4m2TYzW485cZe3l4H+kvpKagkMAR4qcUxmVmJO3GUsIqqA04HHgbeB+yPizdJG\nZaUm6V5gErCFpGmShpU6Jisu3zlpZpYyHnGbmaWME7eZWco4cZuZpYwTt5lZyjhxm5mljBO35ZWk\nDSX9oID9nyjpxnreM0rSOQ3sd2njIjMrHiduy7cNgbUmbknNixyLWZPkxG35dhWwmaTXJP1S0iBJ\nz0p6CHhL0qa560hLOkfSqOzrzSRNkDQ5+5kt6zqRpEMl/VPSFEl/k9Qt5/B2kiZJek/S93M+c66k\nlyVNlfSz/H51s+LwCMjy7QJgm4jYHkDSIGDHbNtHkjat47NjgFMj4j1JuwA3A3vX8f7ngF0jIiSd\nApwHnJ09ti2wK9AOmCLpEWAboD+Z5XIFPCRpj+wyqWap4cRtxfBSRHxU1xskbQB8HfiTpJXNrerp\ndxPgPkk9gJZA7jn+EhHLgeWSniKTrL8JfAuYkn3PBmQSuRO3pYoTtxVDZc7rKr5comud/VkBfLpy\npJ7QDcB1EfFQdmQ/KufY6ms5BJlR9pURcVsDzmFWdlzjtnxbArSv4/hsYGNJG0lqBRwCEBGLgY8k\nHQ2gjO3qOVdHvljmduhqxwZLai1pI2AQmZUWHwdOzo7ukdRT0sbJv5pZefCI2/IqIuZLej57AfIx\n4JHVjq+QdBnwEpmk+07O4ROAWyRdDLQg86i2f9VxulFkSisLgb8DfXOOTQWeAroAoyNiBjBD0leB\nSdlyzFLgO8Ccdfy6ZiXh1QHNzFLGpRIzs5Rx4jYzSxknbjOzlHHiNjNLGSduM7OUceI2M0sZJ24z\ns5Rx4jYzS5n/BxXMrC2lQtKGAAAAAElFTkSuQmCC\n",
            "text/plain": [
              "<Figure size 432x288 with 2 Axes>"
            ]
          },
          "metadata": {
            "tags": []
          }
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "L-S6tS4g8TQ3",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 170
        },
        "outputId": "87df27ec-2952-4b5e-b7c9-1c3863b7612d"
      },
      "source": [
        "print(classification_report(y_test, yfit_rf_best))"
      ],
      "execution_count": 230,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "              precision    recall  f1-score   support\n",
            "\n",
            "        -1.0       0.64      0.43      0.51       237\n",
            "         1.0       0.59      0.77      0.67       256\n",
            "\n",
            "    accuracy                           0.61       493\n",
            "   macro avg       0.62      0.60      0.59       493\n",
            "weighted avg       0.62      0.61      0.60       493\n",
            "\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "wCT7oz0D8TQ8",
        "colab_type": "text"
      },
      "source": [
        "## Gaussian Naive Bayesian"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "HCroylzu8TQ9",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "from sklearn.naive_bayes import GaussianNB\n",
        "modelgnb = GaussianNB()\n",
        "modelgnb.fit(X_train, y_train);\n",
        "yfit_gnb = modelgnb.predict(X_test)"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "nPJUJelm8TRC",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 34
        },
        "outputId": "ac7b1925-1836-4521-9796-dd7238d10a5b"
      },
      "source": [
        "\n",
        "gnb_score = accuracy_score(y_test, yfit_gnb)\n",
        "gnb_score"
      ],
      "execution_count": 232,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "0.5983772819472617"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 232
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "Gnuukrq68TRG",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 283
        },
        "outputId": "f8e8d881-5a8f-4052-8d3b-42531e07b970"
      },
      "source": [
        "mat = confusion_matrix(y_test, yfit_gnb)\n",
        "sns.heatmap(mat , annot=True)\n",
        "plt.xlabel('true label')\n",
        "plt.ylabel('predicted label');"
      ],
      "execution_count": 233,
      "outputs": [
        {
          "output_type": "display_data",
          "data": {
            "image/png": "iVBORw0KGgoAAAANSUhEUgAAAW4AAAEKCAYAAAAyx7/DAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4zLCBo\ndHRwOi8vbWF0cGxvdGxpYi5vcmcvnQurowAAHiJJREFUeJzt3XeYVOXZx/HvjyYISC8qFlRIRING\nUTDRBDU2wivGgoBJbBELGqxRE2ONxoiisUtesSQ2XnuiWGMhiUoRotiJWCiC0kHa7t7vHzNLVmB3\nzy4zO3uG38frXDvznDPPuee61ntvnvOc5ygiMDOz9GhQ6ADMzKxmnLjNzFLGidvMLGWcuM3MUsaJ\n28wsZZy4zcxSxonbzCxlnLjNzFLGidvMLGUaFTqAyrza+Sjf0mnreLxpw0KHYPXQyE8e1Ib2sfqr\njxPnnMbtt9vg820IV9xmZilTbytuM7M6VVZa6AgSc+I2MwMoLSl0BIk5cZuZARFlhQ4hMSduMzOA\nMiduM7N0SVHF7VklZmaQuTiZdKuGpNGS5kqaulb7GZLel/SOpGuybdtKWi5pSna7vbr+XXGbmUGu\nK+67gZuBe8sbJO0LDAB2iYiVkjpWOP4/EbFr0s6duM3MgMjhrJKIeFXStms1nwpcHRErs8fMrW3/\nHioxM4PMxcmkW+10B/aR9IakVyTtUWFfV0mTs+37VNeRK24zM6jRUImkocDQCk2jImJUNR9rBLQF\n+gB7AGMkbQfMBraOiHmSdgcel7RTRCyuqiMzM6vBnZPZJF1dol7bDODRiAhgvKQyoH1EfAmUD59M\nkvQfMtX5xMo68lCJmRlkKu6kW+08DuwLIKk70AT4SlIHSQ2z7dsB3YCPq+rIFbeZGeT0lndJDwB9\ngfaSZgCXAKOB0dkpgquAYyMiJP0AuFzSaqAMOCUi5lfVvxO3mRnk9M7JiBhcya6frufYR4BHatK/\nE7eZGRDh1QHNzNIlRbe8O3GbmYEXmTIzSx1X3GZmKVO6utARJObEbWYGHioxM0sdD5WYmaWMK24z\ns5Rx4jYzS5fwxUkzs5TxGLeZWcp4qMTMLGVccZuZpYwrbjOzlHHFbWaWMiW5e5BCvjlxm5mBK24z\ns9TxGLeZWcq44jYzSxlX3GZmKeOK28wsZTyrxMwsZSIKHUFiTtxmZuAxbjOz1HHiNjNLGV+cNDNL\nmdLSQkeQmBO3mRl4qMTMLHWcuM3MUsZj3GZm6RJl6ZnH3aDQAZiZ1QtlZcm3akgaLWmupKkV2i6V\nNFPSlOzWr8K+CyVNk/SBpIOq698Vt5kZ5HpWyd3AzcC9a7VfHxHXVmyQ1AMYBOwEbAG8IKl7RFQa\nkCtuMzPIacUdEa8C8xOeeQDwYESsjIjpwDRgz6o+4Io7D7pffyptD9id1V8tYlLfc9bZ3+6gXmxz\n/iAoC6K0lP/89m4Wj39/g87ZqHULdrzjLJpu1YEVn3/Je0NHUrJoGR0P35supx+GJEqWLmfa+X9i\n2bufbtC5rHaOvuZkeuy3G0vnLWbEQeets7/j9lswaMQpdNmpK09f+xAv/+lvG3zOhk0aMWTkMLba\nuSvLFi7l3tP/yIIZX9J97+/w4/MH06hxI0pWl/DXq+5j2mvvbPD5Uq1uZpWcLunnwETgnIhYAGwJ\nvF7hmBnZtkq54s6DOQ+9zNTBV1a6f8G4qby537m8+aPz+PDMW+l+3SmJ+271vR50/+Owddq3OuMw\nFo57mwnf+yULx73NVmccBsCKz+by1k8uYdK+5/DZ9Q/T7dqTa/6FLCcmPPwKo479faX7v164lMcu\nvZuXapGw23TpwGkPXrxOe++B+7J80VKu6nsmr9z5FP0vGALAsgVLuPPEEYw4+Fc8cM6tHHP9ur9T\nG52IxJukoZImVtiGJjjDbcD2wK7AbOC62oaat4pb0rfJ/BOg/C/HTODJiHgvX+esLxa9/h6bbNWh\n0v1lX69Y87rBpk2/sSpZl9MOpcOhe6EmjZk3djyfjhiT6JztDtqDtw6/BIA5Y16m56OXMf1397F4\n4odrjlky6SM22bxdTb+O5cjH49+nTZfKfy+WzlvM0nmL6bHfbuvs2/2wvdnnuINp2KQRn02ZxsMX\n3ZloFsTOB/bi2RseBuCtp9/g8MuOB2DmO5+sOeaLD2fQuGkTGjZpROmq9CxtmnM1qLgjYhQwqibd\nR8Sc8teS/gSU/4WeCWxV4dAu2bZK5aXilnQ+8CAgYHx2E/CApAvycc60aXfInvQadwM7/+VCPjjr\nNgDa/LAnzbpuzuSDL+TN/c+jRc/taNVnx0T9NenQilVzFwKwau5CmnRotc4xnYfsx/y/T87dl7A6\n0XH7Ldi1/17ceOQlXNfvAspKy9j9sL0TfbZVp7YsnDUPgLLSMlYsWU7zNi2/cUzPQ3ozY+r0jTtp\nA5RF8q0WJG1e4e1PgPIZJ08CgyRtIqkr0I1MzqxUviruE4GdImJ1xUZJI4F3gKvzdN7UmDd2PPPG\njqdVnx3Z9vyjeXvgFbTuuwtt+vZktxdGANCweVOadd2cRa+/x65PX0WDJo1p2LwpjVq3WHPM9N/9\nhQUv/3ud/mOttYVbfX8nOg/ejykDfpv/L2c51f3736HLd7py1pOZ4bfGmzRh6bzFABx/x9m03aoj\nDRs3os0W7Tnn6cz/Wq/eNZYJ//dKtX136taF/hcM4Y6fXZW/L5AWOZxVIukBoC/QXtIM4BKgr6Rd\ngQA+AU4GiIh3JI0B3gVKgGFVzSiB/CXuMjLTWta+CrZ5dt96ZceJhgKc03I3Dt10uzyFV38sev09\nmm7TiUZtWyKJz298jNl/fmGd46b0+zWQGePudPS+fDj8lm/sX/XlIpp0bJ2ptju2ZvVXi9fsa77j\n1nS/7hSmDrmKkgVL8/uFLPcEEx95laeueXCdXXedPBLIjHEPvvZUbh10+Tf2L5ozn9ZbtGPRF/Np\n0LABTVs2Y9mCJQC06tyW4+84h/vPvoV5n81Zp++NTeTw4mREDF5P851VHH8lUPmFsbXk6+LkmcCL\nksZKGpXdngFeBIZX9qGIGBURvSKiVzEn7abbdl7zusV3utKgSWNK5i9hwUtT6DR4v8y4N9Ckc1sa\nt98sUZ/znptIp4F9Aeg0sC/znp0AwCZbtqfH6PP44PSbWP7x7Nx+EasTH/1zKj0P6U2LdpnfhU1b\nNafNlu0Tffad5yexxxE/AKBnv95M+1dm5kjTzTblpLvO56k/3M8nkz6sqouNR56HSnIpLxV3RDwj\nqTuZuYgVL05OqO6fAMXg27cNp9X3dqJx25b0fvN2Ph0xBjVuCMDse5+nff/edDrqh8TqUspWrOK9\nk68HYMErb9GsWxe++1TmD2/pshW8P+zGb1TPlfn8psfYcdTZdB6yHytmfMl7QzN9bn32kTRq04Id\nrj4JgCgtZfJBvsxQCD+98Qx26NOD5m1acvFrt/Ds9Q/TIPt78dp9L9CyQyvOevIqmrZoRkTwgxMO\n4Q8HnMucaTMZe90YTv7zr5FEaUkpj148mgUzv6r2nG+MeYkhI4fx65dv4OuFS7n3jBsB2PvnB9Fu\nm04cOPwIDhx+BAB3/OyqNUMwG6UUrVWitcdC64tXOx9VPwOzgnq8acNCh2D10MhPHtSG9rHs8mMS\n55zmF9+3wefbEL4Bx8wMoCQ9gwFO3GZmkKqhEiduMzOoFxcdk3LiNjMjt9MB882J28wMXHGbmaWO\nE7eZWcrk9kEKeeXEbWZGup456cRtZgYeKjEzSx3PKjEzSxlX3GZmKePEbWaWLlHqoRIzs3Qphopb\nUtuqPhgR83MfjplZYRTLdMBJZJ6Ntr51ZwMo3kfUmNnGpxgSd0R0rctAzMwKKj1D3NWPcUsScAzQ\nNSKukLQ10Dkiqnx8vJlZmkRJejJ3kocF3wrsBQzJvl8C3FL54WZmKVRWg63Akswq6R0Ru0maDBAR\nCyQ1yXNcZmZ1qlguTpZbLakhmQuSSOpAvfibY2aWQynKakkS943AY0AnSVcCRwIX5TUqM7M6VlQV\nd0TcJ2kSsH+26bCIeC+/YZmZ1bEiq7gBNgXKh0ua5S8cM7PCiJJCR5BctbNKJF0M3AO0BdoDd0ny\nUImZFZUoS74VWpKK+xhgl4hYASDpamAK8Lt8BmZmVqfqQUJOKkningU0BVZk328CzMxbRGZmBVAf\nKumkqlpk6iYyY9qLgHckPZ99fwDguybNrKgUReIGJmZ/TiIzHbDcy3mLxsysQKJ0fevp1Y6k0UB/\nYG5E7JxtuwIYQGZQZi5wXETMktQXeAKYnv34oxFxeVX9V7XI1D0bHr6ZWTrkuOK+G7gZuLdC24iI\n+C2ApF8CFwOnZPeNi4j+STtPsshUN+D3QA8yY90ARISXdTWzohFluau4I+JVSduu1ba4wtvmZO9G\nr40ki0zdBdwGlAD7kvkL8pfantDMrD6qi+mAkq6U9DmZ2XoXV9i1l6R/Sxoraafq+kmSuJtFxIuA\nIuLTiLgU+HGtojYzq6cilHiTNFTSxArb0GTniN9ExFbAfcDp2eY3gW0iYhfgJuDx6vpJMh1wpaQG\nwEeSTiczFbBFkiDNzNKiJpV0RIwCRm3A6e4DngYuqTiEEhFPS7pVUvuI+KqyDyepuIeTueX9l8Du\nwM+AYzcgYDOzeqesVIm32sheLyw3AHg/2945+8AaJO1JJi/Pq6qvJItMTci+XAocX5uAzczqu1xe\nnJT0ANAXaC9pBnAJ0E/St8hMB/yU/84oORI4VVIJsBwYFBFVXris6gacv1LFVc+IOLQG38PMrF7L\n8aySwetpvrOSY28mM3Uwsaoq7mtr0pGZWZpVXePWL1XdgPNKXQZiZlZIuay48y3petxmZkUtwonb\nzCxVSnO4Vkm+OXGbmVEkFbdnlZjZxqRYxrjLZ5UcDnTmv+uTDAbm5DMoM7O6VlSzSiRdFxG9Kuz6\nq6SJlXzMzCyViqXiLtdc0nYR8TGApK5kliQ0MysapWVJVgCpH5Ik7rOAlyV9DAjYBjg5r1GZmdWx\nohgqKRcRz2QXR/l2tun9iFiZ37DMzOpWWTHMKiknaVPgbDLrxZ4kqZukb0XE3/IfnplZ3UjTdMCk\nT8BZBeyVfT8T+F3eIjIzK4CI5FuhJRnj3j4ijpY0GCAivi5fOzaf9pv/r3yfwlJo+axxhQ7BilRR\nDZUAqyQ1I3szjqTtAY9xm1lRKbZZJZcCzwBbSboP+D5+oIKZFZl6MAKSWJJZJc9JmgT0ITMdcHhV\nz0IzM0ujohoqkfRiROwPPLWeNjOzopCmWSVVLTLVlMxDgttLakOm2gbYDNiyDmIzM6szNXjIe8FV\nVXGfDJwJbAFM4r+JezE1fD6amVl9FxRBxR0RfwT+KOmMiLipDmMyM6tzJSkaKkky/6VMUuvyN5La\nSDotjzGZmdW5QIm3QkuSuE+KiIXlbyJiAXBS/kIyM6t7ZTXYCi3JPO6GkhQR5TfgNASa5DcsM7O6\nVR8q6aSSJO5ngIck3ZF9f3K2zcysaNSHSjqpJIn7fDLJ+tTs++eB/81bRGZmBVBaTBV3RJQBt2U3\nM7OilKInl1V5A86YiBgo6W3Wcxt/RPTMa2RmZnWorEgq7uHZn/3rIhAzs0IqikWmImJ29uendReO\nmVlhFMXFSUlLqOKPUERslpeIzMwKoCz/z4fJmUpvwImIltnk/EfgAjILS3UhM8vkhroJz8ysbpTW\nYKuOpNGS5kqaWqFthKT3Jb0l6bG17ki/UNI0SR9IOqi6/pPcOXloRNwaEUsiYnFE3AYMSPA5M7PU\nKFPyLYG7gYPXanse2Dk7seND4EIAST2AQcBO2c/cmr3RsVJJEvcyScdIaiipgaRjgGWJQjczS4ky\nlHirTkS8Csxfq+25iCjJvn2dzAgGZArhByNiZURMB6YBe1bVf5LEPQQYCMzJbkdl28zMikbUYJM0\nVNLECtvQGp7uBGBs9vWWwOcV9s2gmmceJLkB5xM8NGJmRa4mN+BExChgVG3OI+k3QAlwX20+Dwkq\nbkndJb1YPsguqaeki2p7QjOz+qguVgeUdByZe2OOKV+4D5gJbFXhsC7ZtkolGSr5E5lB9NUAEfEW\nmYF0M7OiUarkW21IOhj4FZkJH19X2PUkMEjSJpK6At2A8VX1lWSRqU0jYry+OcexpLKDzczSKJc3\n4Eh6AOhL5pm9M4BLyBTAmwDPZ/Pp6xFxSkS8I2kM8C6Z3DosIqqcdZgkcX8laXuyN+NIOhKYXcvv\nY2ZWL+UycUfE4PU031nF8VcCVybtP0niHkZmEP7bkmYC04Fjkp7AzCwNUvTIyaoTt6QGQK+I+JGk\n5kCDiFhSN6GZmdWdNK1VUuXFyexa3L/Kvl7mpG1mxSqXt7znW5KhkhcknQs8RIU7JiNifuUfMTNL\nl6J4kEIFR2d/DqvQFsB2uQ/HzKww0jRUkuTOya51EYiZWSEVVeKW1BQ4DdibTKU9Drg9IlbkOTYz\nszpTFE/AqeBeYAlwU/b9EODPZBabMjMrCsU2xr1zRPSo8P4lSe/mKyAzs0KoD7NFkkqyVsmbkvqU\nv5HUG5iYv5DMzOpeGZF4K7QkFffuwL8kfZZ9vzXwgaS3gcg+zcHMLNWK6uIk6z5+x8ys6BS+jk4u\nyXTAT+siEDOzQiq2itvMrOiVKD01txO3mRlFNlRiZrYx8FCJmVnK1Idpfkk5cZuZ4aESM7PU8VCJ\nmVnKlKao5nbiNjPDFbeZWeqEK24zs3RxxW21NvyXJ3HCCYOJCKZOfZ8Tf3E2z459gBYtWwDQsUM7\nJkycwhFHnljgSK2mLrpqJK/+czxt27Tm8b/cvs7+0fc9zFPPvQRAaWkpH3/6OeOeepBWm7Ws9TlX\nrVrFhVdcx7sffETrVptx7eUXsuXmnfjX+De54fa7WL26hMaNG3HOsBPpvfuutT5PMUjTdMAky7pa\nHdlii86cPuwEevfpx67f3Z+GDRty9MAB9N3vcHrtcSC99jiQ19+YxGOPjy10qFYLh/U7gNtH/q7S\n/ScccySP3HMLj9xzC2eechy9dv1O4qQ9c/Ycjjv9V+u0P/q359isZQvGjhnNz44+jJG3jgagTevN\nuPkPl/LYn2/jyovO4cLLr63dlyoiUYOt0Jy465lGjRrRrFlTGjZsyKbNmjF79hdr9rVs2YJ9+36f\nJ554poARWm3VJBE//cIr9Dvgh2ve//XZvzPoF8M54thhXHbNjZSWJlv2/+/jXmNAvx8BcGDffXhj\n0hQigh2770DHDu0A2KHrNqxYuZJVq1bV8BsVlxIi8VZodZ64JR1f1+dMi1mzvmDk9bcz/T/jmfHZ\nZBYtXszzL7y6Zv+AAQfz95f+yZIlSwsYpeXb8hUr+MfrEzmg794A/OeTz3jmxVf48+3X8cg9t9Cg\nQQP+lh1Sqc7cL+fRuWN7ABo1akiL5puycNHibxzz/Mv/oMe3dqBJkya5/SIpEzX4r9AKMcZ9GXDX\n+nZIGgoMBVDDVjRo0Lwu4yq41q1bcej/HMQO3fuwcOFiHnrwDoYMOZz7738UgEEDB3DnXQ8UOErL\nt5f/8Qbf7dljTXX+xsQpvPv+NAadOByAlStX0rZNawB+eeHlzJw1h9Ulq5k950uOOHYYAD8dOICf\n/PjAas817eNPGXnraEZdf2Wevk16bPQXJyW9VdkuoFNln4uIUcAogEZNtiz8n7U6tv/++zD9k8/4\n6qv5ADz2+Fj26tOL++9/lHbt2rDHHt/liKN+UeAoLd/GvvgK/X7Ud837iODQQ37EWaeu+4/VG39/\nMZAZ4/7Nlddx983XfGN/xw7t+GLuV3Tu2IGSklKWLvua1q02A+CLuV8y/NdXcNVvz2XrLlvk7wul\nRH2opJPK11BJJ+DnwP+sZ5uXp3Om3uefzaR3791o1qwpAPvtuzfvv/8RAEcc3p+nnn6BlStXFjJE\ny7MlS5cxcfLb7LvPXmva+vTaledf/gfzFiwEYNHiJcz6Yk6i/vbduw9PPP0CAM+9PI7eu++CJBYv\nWcpp513Cmaccz249d8r9F0mhshpshZavoZK/AS0iYsraOyS9nKdzpt74CZN59NGnmDD+WUpKSpgy\n5R3+9L/3AXD0wEO5ZsQtBY7QNsR5l1zNhMlvsXDhYvY/7KecduLPKCkpAeDon/wYgBdf+Rff23M3\nNs3+8QbYvus2nHHSzxl65m8oizIaN2rEb84+jS06V/qP1zUO738QF14xgkMGnkCrzVoy4rILAHjg\nkb/y+YxZ3H7X/dx+1/0AjLrhStplh2A2RqWRu4pb0migPzA3InbOtrUFHgK2BT4BBkbEAkl9gSeA\n6dmPPxoRl1fZf+Qw2FzaGIdKrHrLZ40rdAhWDzVuv502tI8h2/wkcc65/9PHqjyfpB8AS4F7KyTu\na4D5EXG1pAuANhFxfjZxnxsR/ZOe39MBzczI7aySiHgVmL9W8wDgnuzre4DDahurE7eZGXUyxt0p\nImZnX3/BNydq7CXp35LGSqr2ooNveTczo2a3vFecupw1KjsrLpGICGnN04nfBLaJiKWS+gGPA92q\n+rwTt5kZNZsOWHHqcg3MkbR5RMyWtDkwN9vXmjuiIuJpSbdKah8RX1XWkYdKzMzIzCpJutXSk8Cx\n2dfHkplJgqTOkpR9vSeZvFzltGlX3GZm5HZ1QEkPAH2B9pJmAJcAVwNjJJ0IfAoMzB5+JHCqpBJg\nOTAoqpnu58RtZkZub6yJiMGV7Np/PcfeDNxck/6duM3MSNct707cZmak60EKTtxmZmQW80oLJ24z\nM6DUFbeZWbp4qMTMLGU8VGJmljKuuM3MUsbTAc3MUiaXD1LINyduMzM8VGJmljpO3GZmKeNZJWZm\nKeOK28wsZTyrxMwsZUojlwu75pcTt5kZHuM2M0sdj3GbmaWMx7jNzFKmzEMlZmbp4orbzCxlPKvE\nzCxlPFRiZpYyHioxM0sZV9xmZinjitvMLGVKo7TQISTmxG1mhm95NzNLHd/ybmaWMq64zcxSxrNK\nzMxSJk2zShoUOgAzs/qgNMoSb9WRNFzSVEnvSDoz29ZW0vOSPsr+bFPbWJ24zczIjHEn3aoiaWfg\nJGBPYBegv6QdgAuAFyOiG/Bi9n2tOHGbmZEZ4066VWNH4I2I+DoiSoBXgMOBAcA92WPuAQ6rbaxO\n3GZm5K7iBqYC+0hqJ2lToB+wFdApImZnj/kC6FTbWH1x0syMms3jljQUGFqhaVREjAKIiPck/QF4\nDlgGTAG+cVtmRISkWl8NdeI2M6Nm87izSXpUFfvvBO4EkHQVMAOYI2nziJgtaXNgbm1j9VCJmRk5\nn1XSMftzazLj2/cDTwLHZg85FniitrG64jYzI+c34DwiqR2wGhgWEQslXQ2MkXQi8CkwsLadO3Gb\nmZHbW94jYp/1tM0D9s9F/07cZmak685JJ24zM7zIlJlZ6qRpkSml6a/MxkrS0PI5ombl/Hux8fJ0\nwHQYWv0hthHy78VGyonbzCxlnLjNzFLGiTsdPI5p6+Pfi42UL06amaWMK24zs5Rx4q7nJB0s6QNJ\n0yTV+okZVjwkjZY0V9LUQsdiheHEXY9JagjcAhwC9AAGS+pR2KisHrgbOLjQQVjhOHHXb3sC0yLi\n44hYBTxI5vFHthGLiFeB+YWOwwrHibt+2xL4vML7Gdk2M9uIOXGbmaWME3f9NpPMQ0bLdcm2mdlG\nzIm7fpsAdJPUVVITYBCZxx+Z2UbMibsei4gS4HTgWeA9YExEvFPYqKzQJD0AvAZ8S9KM7KOwbCPi\nOyfNzFLGFbeZWco4cZuZpYwTt5lZyjhxm5mljBO3mVnKOHFbTklqLem0PPZ/nKSbqznmUknn1rDf\npRsWmVndceK2XGsNrDdxS2pUx7GYFSUnbsu1q4HtJU2RNEJSX0njJD0JvCtp24rrSEs6V9Kl2dfb\nS3pG0qTsZ75d1Ykk/Y+kNyRNlvSCpE4Vdu8i6TVJH0k6qcJnzpM0QdJbki7L7Vc3qxuugCzXLgB2\njohdAST1BXbLtk2XtG0Vnx0FnBIRH0nqDdwK7FfF8f8A+kRESPoF8CvgnOy+nkAfoDkwWdJTwM5A\nNzLL5Qp4UtIPssukmqWGE7fVhfERMb2qAyS1AL4H/J+k8uZNqum3C/CQpM2BJkDFczwREcuB5ZJe\nIpOs9wYOBCZnj2lBJpE7cVuqOHFbXVhW4XUJ3xyia5r92QBYWF6pJ3QTMDIinsxW9pdW2Lf2Wg5B\npsr+fUTcUYNzmNU7HuO2XFsCtKxi/xygo6R2kjYB+gNExGJguqSjAJSxSzXnasV/l7k9dq19AyQ1\nldQO6EtmpcVngROy1T2StpTUMflXM6sfXHFbTkXEPEn/zF6AHAs8tdb+1ZIuB8aTSbrvV9h9DHCb\npIuAxmQe1fbvKk53KZmhlQXA34GuFfa9BbwEtAeuiIhZwCxJOwKvZYdjlgI/BebW8uuaFYRXBzQz\nSxkPlZiZpYwTt5lZyjhxm5mljBO3mVnKOHGbmaWME7eZWco4cZuZpYwTt5lZyvw/1jsOwLXZsDQA\nAAAASUVORK5CYII=\n",
            "text/plain": [
              "<Figure size 432x288 with 2 Axes>"
            ]
          },
          "metadata": {
            "tags": []
          }
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "BedCQYfZ8TRN",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 170
        },
        "outputId": "8f7e0bcc-2f33-4ab3-f4ee-2b1d18e880ed"
      },
      "source": [
        "print(classification_report(y_test, yfit_gnb))"
      ],
      "execution_count": 234,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "              precision    recall  f1-score   support\n",
            "\n",
            "        -1.0       0.59      0.53      0.56       237\n",
            "         1.0       0.60      0.66      0.63       256\n",
            "\n",
            "    accuracy                           0.60       493\n",
            "   macro avg       0.60      0.60      0.60       493\n",
            "weighted avg       0.60      0.60      0.60       493\n",
            "\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "LBt3rA5X8TRS",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        ""
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "slOsMmor8TRW",
        "colab_type": "text"
      },
      "source": [
        "## Boosting"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "cTRF2X8P8TRY",
        "colab_type": "text"
      },
      "source": [
        "## Ada-boosting"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "ZWPnKeYZ8TRZ",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "from sklearn.tree import DecisionTreeClassifier\n",
        "from sklearn.ensemble import AdaBoostClassifier\n",
        "\n",
        "abc = AdaBoostClassifier(base_estimator = DecisionTreeClassifier(),n_estimators=50,  learning_rate=0.1)\n",
        "abc.fit(X_train, y_train)\n",
        "yfit_abc = abc.predict(X_test)"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "XHVnM3QF8TRg",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 34
        },
        "outputId": "59041aa9-68b2-44d6-dfe0-fce05d302668"
      },
      "source": [
        "\n",
        "abc_score = accuracy_score(y_test, yfit_abc)\n",
        "abc_score"
      ],
      "execution_count": 236,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "0.5618661257606491"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 236
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "N-JK-W8M8TRm",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 300
        },
        "outputId": "4584fb28-ce0c-46e4-dd6c-41eb138aa4fd"
      },
      "source": [
        "mat = confusion_matrix(y_test, yfit_abc)\n",
        "sns.heatmap(mat , annot=True)\n",
        "plt.xlabel('true label')\n",
        "plt.ylabel('predicted label')"
      ],
      "execution_count": 237,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "Text(33.0, 0.5, 'predicted label')"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 237
        },
        {
          "output_type": "display_data",
          "data": {
            "image/png": "iVBORw0KGgoAAAANSUhEUgAAAW4AAAEKCAYAAAAyx7/DAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4zLCBo\ndHRwOi8vbWF0cGxvdGxpYi5vcmcvnQurowAAHhdJREFUeJzt3XecFdXdx/HPFxCx0LFRoqjYsD1q\nVGIJahRBDbYoltiIWLBr8kAwNiwoRaNGEaOgsWDJYyxBYokGUgxiI2IJGEQpipWitN39PX/cgVxh\nyyzs3buz+337Oi/unJmdOffl8NvDb86co4jAzMyyo1GxG2BmZtXjwG1mljEO3GZmGePAbWaWMQ7c\nZmYZ48BtZpYxDtxmZhnjwG1mljEO3GZmGdOk2A2oyLDvnexXOm01S+XbwlY3aOaDWttzLP/8P6lv\nrnXabbnW11sb7nGbmWVMne1xm5nVqrLSYrcgNQduMzOA0pJityA1B24zMyCirNhNSM2B28wMoMyB\n28wsW9zjNjPLGD+cNDPLGPe4zcyyJTyqxMwsY/xw0swsY5wqMTPLGD+cNDPLGPe4zcwyxg8nzcwy\nxg8nzcyyJcI5bjOzbHGO28wsY5wqMTPLGPe4zcwypnR5sVuQmgO3mRk4VWJmljlOlZiZZYx73GZm\nGePAbWaWLZGhh5ONit0AM7M6IcrSlypIulfSPElv59VdJWm2pDeT0itv30BJ0yW9L6lHVed3j9vM\nDGo6VTIGuB24f5X6myNiWH6FpB2APkBXoD3wgqRtopJ38N3jNjODGu1xR8QE4MuUV+4NjI2IpREx\nA5gO7FnZDzhwm5lBrsedskjqJ2lyXumX8irnSZqSpFJaJ3UdgI/zjpmV1FXIgdvMDKrV446IURGx\nR14ZleIKdwJbAbsCc4Hha9pU57jNzABKCruQQkR8uuKzpLuBZ5LN2UCnvEM7JnUVco/bzAxqNMdd\nHkmb5W0eBawYcfIU0EfSupI6A12ASZWdyz1uMzOo0VElkh4GugPtJM0CrgS6S9oVCOBD4CyAiJgq\n6VHgHaAE6F/ZiBJw4DYzy6nBuUoi4oRyqu+p5PjrgOvSnt+B28wM/Mq7mVnmeHZAM7OMKfCokprk\nwG1mBhBR7Bak5sBtZgbOcZuZZY4Dt5lZxvjhpJlZxpRW+s5LneLAbWYGTpWYmWWOA7eZWcY4x21m\nli1R5nHcZmbZ4lSJmVnGeFSJmVnGuMfdsPUYeiZbHbQr336xgDEHD1xt//ZH/oA9zzkcJJYtWswL\ng8bw2bsfrdU1GzdtQs+bz2aTnTqz5KuFPN3/dhbM+pzN99uR/QYcT+N1mlC6vIS/XPcwH//9nbW6\nlq2Zw4eeydYH/g/ffLGAuw8ZsNr+rkf+gG5nH4Ekln2zmGcHjWZeDdwXPx5xDpvutAWLv1rEE+fd\nxvxZn9N53x05YECflffFi9c/xMyGfl9kKHB76bICmPrYBB4/ZWiF++d//Bljj7uW+w4ZyCu3/oFD\nhpyR+twtOrbj+EcGrVa/0/HdWTL/G+7Z/1Im/3Y8+w/sA8DiLxfyxBnDue+QgYy/+C563XJ29b+Q\n1Yi3HpvI2FNvqnD/1x9/xgPHDebuHgP4661/oNcNfVOfu2XHdpw8dvX7Ytfkvrjzh5cy6Z5nOXBA\nbn7/b79ayKNnDOPuHgN4+pKR9L75nOp/ofomIn0psoL1uCVtB/Tmv8vMzwaeioh3C3XNumLWpPdp\n0bFdhfvnvDbtv5/fmM6Gm7VZub39Ufuw2+mH0HidJsx98wNeGDQ61dPurQ7Zjb/f/H8A/HvcJA4a\nfCoA86bOXHnM5/+eRZNmTWnctAmly7IzhWV98fGk92hZyX0xO+++mP36NFrk3Rc7HrUP3z+tB43X\nacLsN6cz/vJ090WXg3dn4i2/B+DdcZPocc1pAHyad1985vsip6H3uCX9LzAWELlFLyclnx+WtPq/\nERuwnY7vzoyXpgDQZuv2bHfEXjx89DXc33MQUVrG9kftk+o8zTdtzcI5XwIQpWUsW/gt67Xe8DvH\nbNPr+8x7+8OG/ZczI3bp050PXn4LgLZbt2eHw/fmvmOu5re9fkmUlbHjkenviwV598XScu6L7Xrt\nySe+L6As0pciK1SPuy/QNSKW51dKGgFMBYYU6LqZ0qnb9ux0/A95+JjBAGy+T1c22akzJz99DQBN\nmjXl2y8WANB71EW07LQRjZs2oXn7tpzybG55utfv/RNvPzahymu13aYD+w/sw2Mn31igb2M1ZfNu\nO7Dr8d25/5jcfdB5n65sulNnzngqd580abYO33yeuy+OvesiWnXamEZNm9CyfVt+Nu56ACaNHs+U\nFPdFuy4dOHBAHx462X8lPaoEyoD2wMxV6jdL9pVLUj+gH8Axrfdk7w27FKh5xdduu070uOln/P6U\noSz5elGuUjD18YlMvPHR1Y5/st8tQC7H3XP4WTxy/HfXFV34yVc0b9+GRZ98iRo3omnz9Vn8Ve68\nG27aht6jLmLcxSOZP3NeYb+YrZWNt+vEYTf+jLGn3sTilfeFmPL4RF6+6ZHVjn/8rNx90bJjO44Y\ndhYP9Fn9vmjRvg0Lk/ti3bz7ovmmbTh21MU8dclIvv7I90U09FQJcBHwoqRnJY1KynjgReDCin4o\nIkZFxB4RsUd9DtrN27fNBdKLRvLVjE9W1n/0t6ls02tP1m/bAoBmLTegRYe2qc75wfOv0/XY/QDY\npteeK0eOrNtifY4ecykThzzCnMnTKjuFFVmL9m055q6LePLiO/ky77748G9T2X61+6LiXHm+aS+8\nzs7H7A/A9r325MO/TwVy98Xxoy/jpRvHMmvyv2v4m2RUQ0+VRMR4SdsAe/Ldh5OvRkR2/j2yhg67\nrT+dum3Peq035Kx/3srfRvyexus0BuCtB/5MtwuPYr3WG/Kja08DoKy0lAcOv4Ivps3hr8Me49gH\n/hc1EqUlpbx4+RgWzP6iymv+65G/0OuWs+k7YThLvl7EM+fdDsD/nHowrbfYhG4XHkW3C48C4PGT\nb1yZgrHac+St/dm82/as17o5579yGxNufpzGTXJ/BV9/8EX2u/Ao1mvdnJ6DTwdy98W9R/yKz6fN\n5uVhj3Hi7wZAI1FWUsr4X41hwezPq7zmm4+8TO+bz+Gcvwxnydff8MR5twGwx6mH0HqLTdjvgqPZ\n74KjAXjop0Ma9n2RoblKFHVgaEt5hn3v5LrZMCuqpfJtYasbNPNBre05vrnmpNQ31wZXrP311oZf\nwDEzAyjJTjLAgdvMDDKVKnHgNjODOvHQMS2/8m5mRm44YNpSFUn3Spon6e1y9l0qKSS1S7Yl6VZJ\n0yVNkbRbVed34DYzg5oeDjgGOHTVSkmdgEOA/NnDegJdktIPuLOqkztwm5lBjQbuiJgAfFnOrpuB\nXwD5J+kN3B85rwCtJG1W2fmd4zYzg4K/8i6pNzA7It6SvjOasAPwcd72rKRubkXncuA2M6N6a07m\nT8+RGBURoyo5fn3gl+TSJGvNgdvMDKo1qiQJ0hUG6nJsBXQGVvS2OwKvS9qT3FvlnfKO7ZjUVciB\n28wMCjofd0T8C9h4xbakD4E9IuJzSU8B50kaC+wFzI+ICtMk4IeTZmY5NfhwUtLDwD+AbSXNklTZ\nckbjgP8A04G7gXOrOr973GZmUKMv4ETECVXs3yLvcwD9q3N+B24zM3IrBGWFA7eZGWTqlfcKA7ek\nNhXtA4iI8gaXm5llUnWGAxZbZT3u18i93VPevLMBbFmQFpmZFUN9CNwR0bk2G2JmVlTZSXFXneNW\nbrT4SUDniBgs6XvAphExqeCtMzOrJVGSncidZhz3HUA34MRkeyHwm4K1yMysGMqqUYoszaiSvSJi\nN0lvAETEV5KaFrhdZma1qr48nFxhuaTGJNMQStqIOvE7x8ysBmUoqqUJ3LcCTwCbSLoOOBa4vKCt\nMjOrZfWqxx0RD0p6DTgoqToyIt4tbLPMzGpZPetxA6wPrEiXrFe45piZFUeUFLsF6VU5qkTSFcB9\nQBugHTBaklMlZlavRFn6UmxpetwnAbtExBIASUOAN4FrC9kwM7NaVQcCclppAvccoBmwJNlelypW\nZzAzy5q60JNOq7JJpm4jl9OeD0yV9HyyfTDgtybNrF6pF4EbmJz8+Rq54YArvFyw1piZFUmUljef\nXt1U2SRT99VmQ8zMiqm+9LgBkNQFuAHYgVyuG4CI8LSuZlZvRFl2etxpJpkaDdwJlAAHAPcDDxSy\nUWZmtS1LwwHTBO71IuJFQBExMyKuAg4rbLPMzGpXhFKXYkszHHCppEbANEnnkRsKuGFhm2VmVrvq\nQk86rTSB+0Jyr7xfAAwGDgROLWSjzMxqW1l9GFWyQkS8mnxcBJxe2OaYmRVHlh5OVvYCztMkc3CX\nJyJ+XJAWmZkVQb0I3MCwWmuFmVmRRXam4670BZy/1GZDzMyKKUs97jTDAc3M6r2aHA4o6V5J8yS9\nnVc3WNIUSW9Kek5S+6Rekm6VND3Zv1tV53fgNjMDSkuVuqQwBjh0lbqhEbFzROwKPANckdT3BLok\npR+5Fx4r5cBtZkbN9rgjYgLw5Sp1C/I2N+C/gz96A/dHzitAK0mbVXZ+jyoxM6N2ctzJguunkJsu\n+4CkugPwcd5hs5K6uRWdp7Ie9zBgODADWAzcnZRFwAdr2nAzs7ooIn2R1E/S5LzSL901YlBEdAIe\nBM5b07ZWOapE0vCI2CNv19OSJlfwY2ZmmVSdHndEjAJGrcXlHgTGAVeSm0akU96+jlSxyliaHPcG\nklZO4SqpM7n8jJlZvVFa1ih1WRPJFNkr9AbeSz4/BZySjC7ZG5gfERWmSSDdXCUXAy9L+g8gYHPg\nrOo328ys7qrJF3AkPQx0B9pJmkWuZ91L0rbkliWeCZydHD4O6AVMB74lxdQiaeYqGZ/8ptguqXov\nIpZW83uYmdVpZTU4XWtEnFBO9T0VHBtA/+qcP80KOOsDlwCbR8SZkrpI2jYinqnOhczM6rK6MM92\nWmlXwFkGdEu2ZwPXFqxFZmZFUJ1RJcWWJse9VUQcL+kEgIj4VlLBfzUN+OSlQl/CMmjxnInFboLV\nUzWZKim0NIF7maT1SF7GkbQV4By3mdUrazpapBjSBO6rgPFAJ0kPAvvgBRXMrJ6pAxmQ1NKMKnlO\n0mvA3uSGA14YEZ8XvGVmZrWoXqVKJL0YEQcBfyynzsysXsjSqJLKJplqRm6R4HaSWpPrbQO0IDcB\niplZvZGhRd4r7XGfBVwEtAde47+BewFwe4HbZWZWq4J60OOOiF8Dv5Z0fkTcVottMjOrdSUZSpWk\nGf9SJqnVig1JrSWdW8A2mZnVukCpS7GlCdxnRsTXKzYi4ivgzMI1ycys9pVVoxRbmnHcjSUpmQgF\nSY2BpoVtlplZ7aoLPem00gTu8cAjku5Kts9K6szM6o260JNOK03g/l9ywfqcZPt54LcFa5GZWRGU\n1qced0SUkVsuvsol483MsqoW1gquMZW9gPNoRBwn6V+U8xp/ROxc0JaZmdWisnrS474w+fPw2miI\nmVkx1YtJplYsVhkRM2uvOWZmxVEvHk5KWkglv4QiokVBWmRmVgRlhV8fpsZU1uNuDiBpMDAX+B25\n+UpOAjarldaZmdWS0mI3oBrSDAf8cUTskrd9p6S3gCsK1CYzs1qXpVElaV55/0bSSZIaS2ok6STg\nm0I3zMysNpWh1KXY0gTuE4HjgE+T8pOkzsys3ohqlGJL8wLOh0DvwjfFzKx46lWqRNI2kl6U9Hay\nvbOkywvfNDOz2pOl2QHTpEruBgYCywEiYgrQp5CNMjOrbaVKX4otTeBePyImrVJXUojGmJkVS032\nuCXdK2neikxFUjdU0nuSpkh6YpUFagZKmi7pfUk9qjp/msD9uaStSHLyko4lN67bzKzeqOFUyRjg\n0FXqngd2TOZ5+je5TAaSdiCXxeia/MwdyboHFUoTuPsDdwHbSZpNbgHhs9O13cwsG0LpS5XnipgA\nfLlK3XMRsSJb8QrQMfncGxgbEUsjYgYwHdizsvNXOqpEUiNgj4j4kaQNgEYRsbDqZpuZZUstP3Q8\nA3gk+dyBXCBfYVZSV6FKe9zJXNy/SD5/46BtZvVVaTWKpH6SJueVfmmvI2kQueeED65pW9O88v6C\npMvI/XZY+cZkRHxZ8Y+YmWVLdcZxR8QoYFR1ryHpNHJTZR+0Yh1fYDbQKe+wjkldhdIE7uOTP/vn\n1QWwZaqWmpllQKFTJZIOJZfB+GFEfJu36yngIUkjgPZAF2DVkXzfkebNyc5r0VYzs0yoycAt6WGg\nO9BO0izgSnKjSNYFnlduCtlXIuLsiJgq6VHgHXIplP4RUelkhVUGbknNgHOBfcn1tCcCIyNiyRp/\nKzOzOqYm5yCJiBPKqb6nkuOvA65Le/40qZL7gYXAbcn2ieTm5v5J2ouYmdV1WZqrJE3g3jEidsjb\nfknSO4VqkJlZMWRpIYU0L+C8LmnvFRuS9gImF65JZma1r4xIXYotTY97d+Dvkj5Ktr8HvC/pX0Ak\nr2+amWVaXZj1L600gXvV9+3NzOqd4vej00szHHBmbTTEzKyY6luP28ys3itRdvrcDtxmZtSzVImZ\nWUPgVImZWcbUhWF+aTlwm5nhVImZWeY4VWJmljGlGepzO3CbmeEet5lZ5oR73GZm2eIet62x88/r\nS9++JyKJe+55iFtv+y277NKVO24fwrrN1qWkpITzz/8lr05+s9hNtWq6/PoRTPjbJNq0bsUfHhhZ\n7jGTXp/Cjb++i5KSElq3asGY3wxdq2suW7aMgYOH887702jVsgXDrhlIh8024e+TXueWkaNZvryE\nddZpwqX9+7LX7ruu1bWyLkvDAdNM62q1pGvXbenb90S6/eAwdtv9YA7r9SO22moLhlw/iMHXjmCP\n7x/C1VcPY8gNg4rdVFsDR/Y6mJEjrq1w/4KFi7h2+O3cfuOVPPngXQy/Nv3/59lzP+W0836xWv3/\nPfMcLZpvyLOP3stPjz+SEXfcC0DrVi24/careOJ3d3Ld5Zcy8Jph1f9C9UxUoxSbe9x1yHbbdWHS\npDdYvDi3KtyEia9w1JE9iQiat2gOQIuWzZkz99NiNtPW0B677sTsSv7fjXv+ZX70w33YbNONAWjb\nutXKfU//6c88+NiTLF9ews5dt+XyS/vTuHHjKq/554n/4Ny+JwNwSPf9uH7EnUQE22+z9cpjtu68\nOUuWLmXZsmU0bdp0Tb9e5pXUiZCcTq33uCWdXtvXzIqpU99j3333ok2b1qy3XjN6HnogHTu255LL\nruTGGy5nxgevctOQXzHo8huK3VQrgA8/msWChYs47bxfcNwZ5/Pksy8A8MGHHzH+xb/wu5HD+f19\nv6FRo0Y889xLqc4577Mv2HTjdgA0adKYDTdYn6/nL/jOMc+//Fd22HbrBh20IfdwMu1/xVaMHvfV\nwOjydkjqB/QDUOOWNGq0QW22q+jee286Q4f+hmfHPcS333zLm29NpbS0jLP6ncKlP7+KJ54Yx7HH\nHsHddw2nR88+xW6u1bDS0jLeeW8av711CEuXLuWksy5hl67b8c/Jb/LOe9Pp0/dCAJYuXUqbpDd+\nwcBrmD3nU5aXLGfup59xzKn9ATj5uN4cddghVV5z+n9mMuKOexl1c+p1auutBv9wUtKUinYBm1T0\ncxExChgF0KRph+L/WiuC0WPGMnrMWACuHTyAWbPmct21A7j4kisAePzxpxk1cu0eWFndtMnG7WjZ\nsjnrr9eM9ddrxu677sj702cQEfy454+4+JzV/7F66w25+2L23E8ZdN1wxtx+03f2b7xRWz6Z9zmb\nbrwRJSWlLPrmW1q1bAHAJ/M+48JfDub6X13G9zq2L/wXrOPqQk86rUKlSjYBTgGOKKd8UaBr1gsb\nbdQWgE6d2nPkkT15eOwTzJn7KT/cvxsABx6wL9OmzyhmE61ADthvb96YMpWSklIWL1nCv6a+z5Zb\ndGLvPXbl+Zf/yhdffQ3A/AULmfNJuuccB+y7N0+Oy6Vcnnt5InvtvguSWLBwEef+/EouOvt0dtu5\na8G+U5aUVaMUW6FSJc8AG0bEamPWJL1coGvWC489cjdt2rZm+fISLrhgEPPnL+Dss3/OiBHX0KRJ\nE5YuWcI556w+esDqvp9fOYRX35jC118v4KAjT+bcvj+lpKQEgOOPOoyttvge++y1B0efeg6N1Ihj\njuhBly23AOD8M0+h30WDKIsy1mnShEGXnEv7TSv8x+tKRx/eg4GDh9LzuDNo2aI5Q68eAMDDv3+a\nj2fNYeTohxg5+iEARt1y3XceiDY0pZGdHreijja2oaZKrHKL50wsdhOsDlqn3ZZa23OcuPlRqWPO\nQzOfWOvrrQ0PBzQzI1s5bgduMzPqRu46LQduMzP8yruZWebU5As4ku6VNE/S23l1P5E0VVKZpD1W\nOX6gpOmS3pfUo6rzO3CbmZEbVZK2pDAGOHSVureBo4EJ+ZWSdgD6AF2Tn7lDUqXzGThwm5mRS5Wk\nLVWJiAnAl6vUvRsR75dzeG9gbEQsjYgZwHRgz8rO78BtZkb1XsCR1E/S5LzSby0u3QH4OG97VlJX\nIT+cNDOjesMB86fnKAYHbjMzijqqZDbQKW+7Y1JXIadKzMyAiEhdathTQB9J60rqDHQBJlX2A+5x\nm5kBpTXY45b0MNAdaCdpFnAluYeVtwEbAX+U9GZE9IiIqZIeBd4BSoD+EVFa2fkduM3MqNlUSUSc\nUMGuJyo4/jog9aToDtxmZlCIFEjBOHCbmZGtV94duM3M8OyAZmaZk6WFFBy4zcxwqsTMLHMcuM3M\nMsajSszMMsY9bjOzjPGoEjOzjCmN7Kw66cBtZoZz3GZmmeMct5lZxjjHbWaWMWVOlZiZZYt73GZm\nGeNRJWZmGeNUiZlZxjhVYmaWMe5xm5lljHvcZmYZU1r5wup1igO3mRl+5d3MLHP8yruZWca4x21m\nljEeVWJmljEeVWJmljFZeuW9UbEbYGZWF0RE6lIVSfdKmifp7by6NpKelzQt+bN1Ui9Jt0qaLmmK\npN2qOr8Dt5kZuRx32pLCGODQVeoGAC9GRBfgxWQboCfQJSn9gDurOrkDt5kZNdvjjogJwJerVPcG\n7ks+3wccmVd/f+S8ArSStFll53eO28yMWhnHvUlEzE0+fwJsknzuAHycd9yspG4uFXCP28yM6vW4\nJfWTNDmv9KvmtQLW/DeFe9xmZlRvVElEjAJGVfMSn0raLCLmJqmQeUn9bKBT3nEdk7oKucdtZkaN\nP5wsz1PAqcnnU4En8+pPSUaX7A3Mz0uplMs9bjMzavaVd0kPA92BdpJmAVcCQ4BHJfUFZgLHJYeP\nA3oB04FvgdOrOr8Dt5kZNfvmZEScUMGug8o5NoD+1Tm/A7eZGZ5kyswsc7I0yZSy9FumoZLUL3mK\nbbaS74uGy6NKsqFaY0StwfB90UA5cJuZZYwDt5lZxjhwZ4PzmFYe3xcNlB9OmplljHvcZmYZ48Bd\nx0k6VNL7yeoYA6r+CavvyltdxRoWB+46TFJj4DfkVsjYAThB0g7FbZXVAWNYfXUVa0AcuOu2PYHp\nEfGfiFgGjCW3WoY1YBWsrmINiAN33VbRyhhm1oA5cJuZZYwDd91W7ZUxzKz+c+Cu214FukjqLKkp\n0Ifcahlm1oA5cNdhEVECnAf8CXgXeDQipha3VVZsyeoq/wC2lTQrWVHFGhC/OWlmljHucZuZZYwD\nt5lZxjhwm5lljAO3mVnGOHCbmWWMA7fVKEmtJJ1bwPOfJun2Ko65StJl1TzvorVrmVntceC2mtYK\nKDdwS2pSy20xq5ccuK2mDQG2kvSmpKGSukuaKOkp4B1JW+TPIy3pMklXJZ+3kjRe0mvJz2xX2YUk\nHSHpn5LekPSCpE3ydu8i6R+Spkk6M+9nfi7pVUlTJF1ds1/drHa4B2Q1bQCwY0TsCiCpO7BbUjdD\n0haV/Owo4OyImCZpL+AO4MBKjv8rsHdEhKSfAb8ALk327QzsDWwAvCHpj8COQBdy0+UKeErS/sk0\nqWaZ4cBttWFSRMyo7ABJGwI/AB6TtKJ63SrO2xF4RNJmQFMg/xpPRsRiYLGkl8gF632BQ4A3kmM2\nJBfIHbgtUxy4rTZ8k/e5hO+m6JolfzYCvl7RU0/pNmBERDyV9Oyvytu36lwOQa6XfUNE3FWNa5jV\nOc5xW01bCDSvZP+nwMaS2kpaFzgcICIWADMk/QRAObtUca2W/Hea21NX2ddbUjNJbYHu5GZa/BNw\nRtK7R1IHSRun/2pmdYN73FajIuILSX9LHkA+C/xxlf3LJV0DTCIXdN/L230ScKeky4F1yC3V9lYl\nl7uKXGrlK+DPQOe8fVOAl4B2wOCImAPMkbQ98I8kHbMIOBmYt4Zf16woPDugmVnGOFViZpYxDtxm\nZhnjwG1mljEO3GZmGePAbWaWMQ7cZmYZ48BtZpYxDtxmZhnz//GQ1gZDZhipAAAAAElFTkSuQmCC\n",
            "text/plain": [
              "<Figure size 432x288 with 2 Axes>"
            ]
          },
          "metadata": {
            "tags": []
          }
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "Auw-bUKc8TRp",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 170
        },
        "outputId": "d2f83ccf-1f76-4f47-bcfe-9ea2f679d88f"
      },
      "source": [
        "print(classification_report(y_test, yfit_abc))"
      ],
      "execution_count": 238,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "              precision    recall  f1-score   support\n",
            "\n",
            "        -1.0       0.55      0.50      0.52       237\n",
            "         1.0       0.57      0.62      0.59       256\n",
            "\n",
            "    accuracy                           0.56       493\n",
            "   macro avg       0.56      0.56      0.56       493\n",
            "weighted avg       0.56      0.56      0.56       493\n",
            "\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "fcy-JX7P8TRz",
        "colab_type": "text"
      },
      "source": [
        "## Gradient Boosting"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "fbzS8UIh8TR1",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 34
        },
        "outputId": "0c825168-fc54-4cc2-aaa0-b8e2305e55a5"
      },
      "source": [
        "from sklearn.ensemble import GradientBoostingClassifier\n",
        "\n",
        "gbc = GradientBoostingClassifier( n_estimators=120, max_depth=2)\n",
        "gbc.fit(X_train, y_train)\n",
        "yfit_gbc = gbc.predict(X_test)\n",
        "\n",
        "accuracy_score(y_test, yfit_gbc)"
      ],
      "execution_count": 239,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "0.6206896551724138"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 239
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "jCSrd5YP8TR7",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 34
        },
        "outputId": "2e20646e-1c73-4086-fd6b-10a2b02a1e1f"
      },
      "source": [
        "from sklearn.metrics import mean_squared_error\n",
        "err = [mean_squared_error(y_test, yhat) for yhat in gbc.staged_predict(X_test)]\n",
        "idx = np.argmin(err)\n",
        "idx"
      ],
      "execution_count": 240,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "8"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 240
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "scrolled": true,
        "id": "U_XzNdq68TSI",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "gbc_best = GradientBoostingClassifier( n_estimators=idx, max_depth=2)\n",
        "gbc_best.fit(X_train, y_train)\n",
        "yfit_gbc_best = gbc_best.predict(X_test)"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "Y-M9id4F8TSN",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 34
        },
        "outputId": "2aa48791-173a-4cf4-89ca-16451b9c12f5"
      },
      "source": [
        "#best hyperparameter\n",
        "gbc_score = accuracy_score(y_test, yfit_gbc_best)\n",
        "gbc_score\n"
      ],
      "execution_count": 243,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "0.6247464503042597"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 243
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "qMDHgdtO8TST",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 283
        },
        "outputId": "172ec5bb-e163-4c2f-9801-93917fd845a1"
      },
      "source": [
        "mat = confusion_matrix(y_test, yfit_gbc_best)\n",
        "sns.heatmap(mat , annot=True)\n",
        "plt.xlabel('true label')\n",
        "plt.ylabel('predicted label');"
      ],
      "execution_count": 244,
      "outputs": [
        {
          "output_type": "display_data",
          "data": {
            "image/png": "iVBORw0KGgoAAAANSUhEUgAAAW4AAAEKCAYAAAAyx7/DAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4zLCBo\ndHRwOi8vbWF0cGxvdGxpYi5vcmcvnQurowAAHE5JREFUeJzt3XmcVXX9x/HXe2YY9kVB1EAFETFc\nS01+aT9xyTI1WkwxKywUS0zUSEXNDUlzz0yUcqtcwrTcklQU0zJRfhgFiJKkssii7CAwM5/fH/dA\nIzHDmWHuvXMu76eP85h7zzn3nM99PMbPfPic7/keRQRmZpYdZcUOwMzMGsaJ28wsY5y4zcwyxonb\nzCxjnLjNzDLGidvMLGOcuM3MMsaJ28wsY5y4zcwypqLYAdTlzB4n+pZO+y+X7/1esUOwZqjzY89r\nS4+xbtFbqXNOiy67bvH5toQrbjOzjGm2FbeZWUHVVBc7gtScuM3MAKqrih1Bak7cZmZARE2xQ0jN\nidvMDKDGidvMLFtccZuZZYwvTpqZZYwrbjOzbAmPKjEzyxhfnDQzyxi3SszMMsYXJ83MMsYVt5lZ\nxvjipJlZxvjipJlZtkS4x21mli3ucZuZZYxbJWZmGeOK28wsY6rXFTuC1Jy4zczArRIzs8zJUKvE\nT3k3M4NcxZ12qYeknSQ9J2mapKmShiXrt5X0tKQ3k5/bJOsl6WZJMyVNkfTJzYXqxG1mBk2WuIEq\n4AcR0RfoBwyV1Be4ABgfEb2B8cl7gKOB3skyBBi9uRO4VWJmBkQTXZyMiHnAvOT1cknTgW7AAKB/\nsts9wATg/GT9ryIigL9J6iRpx+Q4m+TEbWYGeelxS+oBfAJ4Gdi+VjJ+D9g+ed0NeLfWx2Yn6+pM\n3G6VmJlBg1olkoZIerXWMmTjw0lqBzwEnB0Ry2pvS6rraGyorrjNzKBBFXdEjAHG1LVdUgtySfve\niHg4WT1/fQtE0o7AgmT9HGCnWh/vnqyrkytuMzNoylElAu4ApkfEDbU2PQoMSl4PAh6ptf5byeiS\nfsDS+vrb4IrbzCyn6XrcBwPfBP4h6bVk3YXA1cBYSYOBt4ETkm1/BL4AzARWAd/e3AmcuM3MAKqa\n5kEKEfEioDo2H7GJ/QMY2pBzOHGbmUGm7px04jYzA89VYmaWOa64zcwyxhW3mVnGuOI2M8uYJhpV\nUghO3GZmANHoO9ALzonbzAzc4zYzyxwnbjOzjPHFSTOzjKmuLnYEqTlxm5mBWyVmZpnjxG1mljHu\ncZuZZUvUeBy3mVm2uFViZpYxHlViZpYxrritsQ4b/AU+feLhRMDcGe/wmx+OZuCoU9ntoL58uHwV\nAL8efitzpr1d5EitodqedT6VB/4PNUsXs/TM/36sYMVe+9H+4lHUzM89J3btSy+w+oF7tuykFS1o\nd+6FVPTanZrly1hxzeXULHiPFvsdQJtBQ6CiBVStY+Vdo6maMnnLzpV1TtzWGB2334ZDTzmaUUee\ny7o16/jOLWez/3GfBuAPP/4Nrz35cpEjtC2xZvyTfPjEw7Q758I696maNoXlV4xo8LHLuu5Au7Mv\nYNmFZ39kfcujjiFWLGfJ6SdT+ZnDaXPK6bnkvWwpy0aOID54n/Kde9LhimtZfMrxDT5vSfEkUyBp\nD2AA0C1ZNQd4NCKm5+ucpaC8vIwWrSqprqqmsnUlS+cvLnZI1kSqpk6hrOsOjfpsZf/P0vq4r0JF\nBVVvTGfl6BtTVYiVBx3M6vvuBmDtX56n7XeHAVD91psb9ql+ZxZUttxQfW+1MlRxl+XjoJLOBx4g\n96Tjicki4H5JF+TjnKVg6fzFjP/F44z8662Mmng7q5ev5vUXpgBw3PCBjHjyGr7yo29RUel/KJWq\nij570vHmO2h/2TWU79wDgPLuu9DyM4ez9LyhLB12KtTUUHnoZ1Mdr6xzF2oWLci9qakmVq5EHTp+\nZJ/KTx9K1b/e2LqTNkBNpF+KLF8ZYDCwZ0R85DdB0g3AVODqPJ0301p3aMvenz2ASz9zJquWrWLw\nredw4JcO4dGf3M+yhUuoqKzgpKuGcOR3BzDu5oeKHa41sep/vcHiwSfCh6tpsf9BtL9oFEtOP5kW\n+36Sil670/GG2wFQZUtqluT+Jdb+wisp234HqGhB+XZd6fjTXwLw4aMPsWb8k5s9Z/nOPWhzyuks\nu2R4/r5YVnhUCTXAx4CNr6DtmGzbJElDgCEA/bfdnz3b98pTeM3THofszfvvLmDFB8sB+Pu4ifTc\nvw+v/OFFAKrWVvG3BydwxGnHFjNMy5NYvWrD63WTXoby8lx1LLHm2XGs+tUv/uszy398MVB3j7vm\n/UWUdelKzfsLoawctW1LLFua+0zn7Wh/4ZWsuPHH1Lw3N4/fLBtia2+VAGcD4yU9KWlMsowDxgPD\n6vpQRIyJiAMi4oCtLWkDfDB3ET0/0ZsWrSoB6HPwXsyfOYcO23XasM8+Rx3I3DfeLVaIlkfqtO2G\n1xW994CyMmLZUtb9fRKVB/dHHXO/B2rXnrLttk91zLUv/4WWR3wOgMqDD2VdMnJEbdvR/tKrWXXP\n7VRN/2cTf5OM2tpbJRExTtLuwKf46MXJVyIiO/8eKbC3X5vJ5Cdf5vwnrqamqobZU2fxl/uf4Xt3\nj6D9th1AYva0f/PARf9deVnz1274JbTYez/UoSOd7nqQ1ffdBeW5/wXXjHuUlgcfSssvDIDqamLN\nGlZcczkA1e++zapf/5IOV1wHKoPqKlbedhM1C+dv9pxrnv4jLc69iE6330usWM7y5Jitjvky5Tt2\no/XAQbQeOAiAZZcMJ5YuydO3z4AMzVWiaKZDYM7scWLzDMyK6vK93yt2CNYMdX7seW3pMVZecXLq\nnNP2knu3+HxbwsMTzMwAqrLTDHDiNjODTLVKnLjNzKBZXHRMy4nbzIxsDQd04jYzA1fcZmaZ48Rt\nZpYxvuXdzCxb/MxJM7OsceI2M8uYDI0qydckU2Zm2dKEk0xJulPSAkn/3Gj99yW9LmmqpGtqrR8h\naaakGZI+t7nju+I2M4OmbpXcDdwC/Gr9CkmHkXsq2L4RsUZS12R9X2AgsCe56bCfkbR7fRPyueI2\nMwOiuib1stljRfwZ+GCj1d8Dro6INck+yaOJGAA8EBFrImIWMJPczKp1cuI2M4MGtUokDZH0aq1l\nSIoz7A58RtLLkp6XdGCyvhtQe5L92fxnOuxNqrNVImnburYBRMTGf03MzDKrIcMBI2IMMKaBp6gA\ntgX6AQcCYyXt2sBjbDhQXSYBQe4hvxsLoFEnNDNrlvI/HHA28HDkHoIwUVIN0IXcQ2Z2qrVf92Rd\nnepM3BHRswkCNTPLhvyPBvwDcBjwXPKEsEpgEfAocF/yMPWPAb2BifUdaLOjSiQJOBnoGREjJe0M\n7BAR9R7YzCxLoqrpMrek+4H+QBdJs4FLgTuBO5MhgmuBQUn1PVXSWGAaUAUM3dwjHtMMB7yV3N+i\nw4GRwHLgIXI9GjOz0tCEFXdEnFTHpm/Usf8oYFTa46dJ3AdFxCclTU5OsFhSZdoTmJllQanNVbJO\nUjm5C5JI2o5CdIPMzAopQ1ktTeK+Gfg9sL2kUcDxwMV5jcrMrMBKquKOiHslTQKOSFZ9KSKm5zcs\nM7MCK7GKG6ANsL5d0jp/4ZiZFUdUFTuC9DZ7y7ukS4B7yN3x0wW4S5JbJWZWUqIm/VJsaSruk8nN\nZvUhgKSrgdeAK/MZmJlZQTWDhJxWmsQ9F2gFfJi8b8lmbsc0M8ua5lBJp1XfJFM/I9fTXkruzp6n\nk/efZTO3Y5qZZU1JJG7g1eTnJHLDAdebkLdozMyKJKo3NZ9e81TfJFP3FDIQM7NiKpWKGwBJvYGr\ngL7ket0ARISndTWzkhE12am40zwB5y5gNLlZqw4j9wy13+QzKDOzQsvScMA0ibt1RIwHFBFvR8Rl\nwDH5DcvMrLAilHoptjTDAddIKgPelHQmuaGA7fIblplZYTWHSjqtNIl7GLlb3s8iNx/34cCgfAZl\nZlZoNaUwqmS9iHglebkC+HZ+wzEzK44sXZys7wacx0jm4N6UiPhiXiIyMyuCkkjcwHUFi8LMrMgi\nO9Nx13sDzvOFDMTMrJhKpeI2M9tqNIdhfmk5cZuZAdWlNKrEzGxrUBIVt0eVmNnWpFR63OtHlXwF\n2IH/zE9yEjA/n0GZmRVaSY0qkXR9RBxQa9Njkl6t42NmZplUKhX3em0l7RoRbwFI6gm0zW9YZmaF\nVV2TZs695iFN4j4HmCDpLUDALsDpeY3KzKzASqJVsl5EjEseprBHsur1iFiT37DMzAqrphRGlawn\nqQ1wLrBLRJwmqbekPhHxeP7DMzMrjCwNB0z7BJy1wP8k7+cAV+YtIjOzIohIvxRbmh53r4g4UdJJ\nABGxSlLe/zTdNvfFfJ/CMujGV18odghWokqqVQKsldSa5GYcSb0A97jNrKSU2qiSy4BxwE6S7gUO\nxg9UMLMS0ww6IKmlGVXylKRJQD9ywwGHRcSivEdmZlZAJdUqkTQ+Io4AntjEOjOzkpClUSX1TTLV\nitxDgrtI2oZctQ3QAehWgNjMzAomQw95r3c44OnAJHI33kyqtTwC3JL/0MzMCidQ6mVzJN0paYGk\nf9Zad62k1yVNkfR7SZ1qbRshaaakGZI+t7nj15m4I+KnEdETGB4Ru0ZEz2TZNyKcuM2spFSFUi8p\n3A18fqN1TwN7RcQ+wBvACABJfYGBwJ7JZ26VVF7fwdOMf6nZ6C/DNpLOSBO5mVlWNGXFHRF/Bj7Y\naN1TEVGVvP0b0D15PQB4ICLWRMQsYCbwqfqOnyZxnxYRS2qdfDFwWorPmZllRk0DFklDJL1aaxnS\nwNN9B3gyed0NeLfWttls5jpimnHc5ZIUEetvwCkHKhsYpJlZs5amkt6wb8QYYExjziPpIqAKuLcx\nn4d0iXsc8FtJtyfvT0/WmZmVjEKMKpF0CnAscMT6Ypjc/E871dqte7KuTmkS9/nkkvX3kvdPA79s\nSLBmZs1ddQMq7saQ9HngPODQiFhVa9OjwH2SbgA+BvQGJtZ3rDR3TtYAo5PFzKwkNeWTyyTdD/Qn\ndx/MbOBScqNIWgJPJ/P0/S0ivhsRUyWNBaaRa6EMjYjq+o5f3w04YyPiBEn/YBO38SdDWszMSkJN\nE1bcEXHSJlbfUc/+o4BRaY9fX8U9LPl5bNqDmZllVUlMMhUR85KfbxcuHDOz4sjSLe/1tUqWU88f\noYjokJeIzMyKoCb/z4dpMvVV3O0BJI0E5gG/JjfR1MnAjgWJzsysQOq9GtjMpBkO+MWI2LfW+9GS\n/g5ckqeYzMwKrilHleRbmlveV0o6WVK5pDJJJwMr8x2YmVkh1aDUS7GlSdxfB04A5ifL15J1ZmYl\nIxqwFFuaG3D+TW72KjOzklVSrRJJu0sav35CcEn7SLo4/6GZmRVOQ2YHLLY0rZJfkLtVcx1AREwh\nN+m3mVnJqFb6pdjSjCppExET9dExjlV17WxmlkXNoZJOK03iXiSpF0lPXtLx5MZ1m5mVjFJL3EPJ\nTRi+h6Q5wCxyN+GYmZWMdI+SbB7qTdySyoADIuJISW2BsohYXpjQzMwKJ0sVd70XJ5O5uM9LXq90\n0jazUlXdgKXY0rRKnpE0HPgtte6YjIgP6v6ImVm2ZGkcd5rEfWLyc2itdQHs2vThmJkVR5ZaJWnu\nnOxZiEDMzIqppBK3pFbAGcAh5CrtF4DbIuLDPMdmZlYwzWEOkrTStEp+BSwHfpa8/zq5ubm/lq+g\nzMwKrdR63HtFRN9a75+TNC1fAZmZFUNzGC2SVpq5Sv5PUr/1byQdBLyav5DMzAqvhki9FFuaint/\n4K+S3kne7wzMkPQPICJin7xFZ2ZWICV1cRL4fN6jMDMrsuLX0emlGQ74diECMTMrplKruM3MSl6V\nslNzO3GbmVFirRIzs62BWyVmZhnTHIb5peXEbWaGWyVmZpnjVomZWcZUZ6jmduI2M8MVt5lZ5oQr\nbjOzbHHFbY3WsmVLJjz7EJUtW1JRUc7DDz/B5Vdcz5jbr2P//fdFgjffnMV3Bp/NypWrih2upTRv\n/kIuHHkd7y9ejBDHDziab57wpY/s8/ifnuWOex+EgDZtWvOj4WeyR+8te0Lg2rVrGTHyeqbNeJNO\nHTtw3RUj6Lbj9vx14v9x0213sW5dFS1aVPCDoYM5aP/9tuhcWZel4YCKaJ7BVlR2a56BFUDbtm1Y\nuXIVFRUV/HnC7znn3EuZNv0Nli9fAcB111zKgoWLuObanxc50sJbPfeFYofQKAsXfcDC9z+gb5/d\nWLlyFScMPoubr/oRvXrusmGfyf+Yxq677ETHDu154aVXuPXOe7n/FzelOv6cefO5aNT13H3LNR9Z\n/8DDjzNj5iwuPe/7/PGZCYx//iWuHzmC6W/MpPM229B1u868+da/Of2ci3n2kd806XcupBZddt3i\nxyB8r8cJqXPO6H+Prfd8ks4BTiU3yvAfwLeBHYEHgM7AJOCbEbG2MbGmmY/bCmx9Jd2iRQUVLVoQ\nERuSNkCr1q1orn9wbdO267ItffvsBuT+MO+6y07MX/j+R/b5xN596dihPQD77LkH8xcs2rDtsT89\ny8BTh/HVQUO5/Jqbqa5ON+3/sy+8xIAvHAnAUf0/w8uTXiMi+Pjuu9F1u84A7NZzFz5cs4a1axuV\nQ0pGFZF6qY+kbsBZwAERsRdQDgwEfgLcGBG7AYuBwY2NteCJW9K3C33OrCkrK+PVV55i3pwpjB//\nZya+MhmAX/7iBua8+xp79NmNW35+Z5GjtMaaM28+09/8F/vs2afOfR5+/E8c0u8AAP7173cYN/55\nfn3b9Tx0z88pKyvj8aeeS3WuBQvfZ4euXQCoqCinXds2LFm67CP7PD3hRfr22Y3KyspGfqPSEA34\nL4UKoLWkCqANMA84HPhdsv0e4Et1fDbVwQvtcuCuTW2QNAQYAqDyjpSVtS1kXM1GTU0NBxx4FB07\nduChB+9gzz37MHXqDE497VzKysr46U1XcsLXvsg9vxpb7FCtgVatWs05F13J+WedTru2m/79njjp\n7zz8+FP8evR1ALz86mtMe30mAwcPA2DNmjVsu00nAM4acQVz5s5nXdU65s1fyFcHDQXgGycM4MvH\nHLXZeGa+9TY33HonY24c1RRfL9Oa6uJkRMyRdB3wDrAaeIpca2RJRFQlu80GujX2HHlJ3JKm1LUJ\n2L6uz0XEGGAMbN097vWWLl3GhOf/wueO6s/UqTOAXFIfO/YRhv/gDCfujFlXVcXZF13JMUcdxmf7\nH7zJfWbMnMUlV9/EbdePpFPHDgBEBF88+kjO+d5//2P15qsuAerucXfdrjPvLVjEDl23o6qqmhUr\nV2047nsLFjLswpH8+EfD2bn7x5ryq2ZSQ4YD1i4yE2OS/IWkbYABQE9gCfAgTfxAmny1SrYHvgUc\nt4nl/Xo+t9Xr0mVbOib/Y7Vq1Yojj/hf3njjLXr16rFhn+OOPYoZM2YWKUJrjIjgkqtuYtdddmLQ\nwK9scp957y3g7AtHctUlP6THzt03rO93wH48PeFF3l+8BICly5Yz9735qc572CH9eOSPzwDw1IQX\nOGj/fZHEsuUrOOOHl3L2d7/NJ/fZcwu/XWmoacASEWMi4oBay5hahzoSmBURCyNiHfAwcDDQKWmd\nAHQH5jQ21ny1Sh4H2kXEaxtvkDQhT+csCTvuuD133nET5eVllJWV8bvfPcYTf3yG55/7Pe07tEMS\nU6ZMY+iZI4odqjXA5ClTeWzceHr36rGhnTHs9EHMm78QgBO/fAyj77qPpcuWc+V1udFC5eXljL3z\nZnr13IXvn/Ythpx9ETVRQ4uKCi469ww+tkOd/3jd4CvHfo4RI6/l6BO+Q8cO7bn28gsAuP+hx3h3\n9lxuu+s+brvrPgDG3DSKzkkLZmtU3XQX/N8B+klqQ65VcgS5B6w/BxxPbmTJIOCRxp7AwwEtU7I6\nHNDyqymGA359ly+nzjn3vf37zQ0HvBw4EagCJpMbGtiNXNLeNln3jYhY05hYfQOOmRlNe8t7RFwK\nXLrR6reATzXF8Z24zczwLe9mZpmTpVvenbjNzPDsgGZmmdOEo0ryzonbzAy3SszMMscXJ83MMsY9\nbjOzjHGrxMwsY5rrXeSb4sRtZgZUu+I2M8sWt0rMzDLGrRIzs4xxxW1mljEeDmhmljG+5d3MLGPc\nKjEzyxgnbjOzjPGoEjOzjHHFbWaWMR5VYmaWMdWRnYldnbjNzHCP28wsc9zjNjPLGPe4zcwypsat\nEjOzbHHFbWaWMR5VYmaWMW6VmJlljFslZmYZ44rbzCxjXHGbmWVMdVQXO4TUnLjNzPAt72ZmmeNb\n3s3MMsYVt5lZxnhUiZlZxmRpVElZsQMwM2sOqqMm9ZKGpHJJkyU9nrzvKellSTMl/VZSZWNjdeI2\nMyPX4067pDQMmF7r/U+AGyNiN2AxMLixsTpxm5mR63GnXTZHUnfgGOCXyXsBhwO/S3a5B/hSY2N1\nj9vMjCYfVXITcB7QPnnfGVgSEVXJ+9lAt8Ye3BW3mRm5cdxpF0lDJL1aaxmy/jiSjgUWRMSkfMXq\nitvMjIZV3BExBhhTx+aDgS9K+gLQCugA/BToJKkiqbq7A3MaG6srbjMzmm5USUSMiIjuEdEDGAg8\nGxEnA88Bxye7DQIeaWysTtxmZjTtxck6nA+cK2kmuZ73HY09kFslZmbk55b3iJgATEhevwV8qimO\n68RtZka27px04jYzw5NMmZllTpYmmVKW/spsrSQNSYYfmW3g34utl0eVZMOQze9iWyH/XmylnLjN\nzDLGidvMLGOcuLPBfUzbFP9ebKV8cdLMLGNccZuZZYwTdzMn6fOSZiSPO7qg2PFY8Um6U9ICSf8s\ndixWHE7czZikcuDnwNFAX+AkSX2LG5U1A3cDny92EFY8TtzN26eAmRHxVkSsBR4ABhQ5JiuyiPgz\n8EGx47DiceJu3roB79Z6v0WPOzKz0uDEbWaWMU7czdscYKda77focUdmVhqcuJu3V4DeknpKqiT3\nGKRHixyTmRWZE3czljxU9EzgT8B0YGxETC1uVFZsku4HXgL6SJotaXCxY7LC8p2TZmYZ44rbzCxj\nnLjNzDLGidvMLGOcuM3MMsaJ28wsY5y4rUlJ6iTpjDwe/xRJt2xmn8skDW/gcVdsWWRmhePEbU2t\nE7DJxC2posCxmJUkJ25ralcDvSS9JulaSf0lvSDpUWCapB6155GWNFzSZcnrXpLGSZqUfGaP+k4k\n6ThJL0uaLOkZSdvX2ryvpJckvSnptFqf+aGkVyRNkXR50351s8JwBWRN7QJgr4jYD0BSf+CTybpZ\nknrU89kxwHcj4k1JBwG3AofXs/+LQL+ICEmnAucBP0i27QP0A9oCkyU9AewF9CY3Xa6ARyX9bzJN\nqllmOHFbIUyMiFn17SCpHfBp4EFJ61e33MxxuwO/lbQjUAnUPscjEbEaWC3pOXLJ+hDgKGBysk87\nconcidsyxYnbCmFlrddVfLRF1yr5WQYsWV+pp/Qz4IaIeDSp7C+rtW3juRyCXJV9VUTc3oBzmDU7\n7nFbU1sOtK9n+3ygq6TOkloCxwJExDJglqSvAShn382cqyP/meZ20EbbBkhqJakz0J/cTIt/Ar6T\nVPdI6iapa/qvZtY8uOK2JhUR70v6S3IB8kngiY22r5N0BTCRXNJ9vdbmk4HRki4GWpB7VNvf6znd\nZeRaK4uBZ4GetbZNAZ4DugAjI2IuMFfSx4GXknbMCuAbwIJGfl2zovDsgGZmGeNWiZlZxjhxm5ll\njBO3mVnGOHGbmWWME7eZWcY4cZuZZYwTt5lZxjhxm5llzP8DcflbAr6fGTgAAAAASUVORK5CYII=\n",
            "text/plain": [
              "<Figure size 432x288 with 2 Axes>"
            ]
          },
          "metadata": {
            "tags": []
          }
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "scrolled": true,
        "id": "mqttjWuc8TSX",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 170
        },
        "outputId": "d60abac7-7631-43e2-fa71-d96ba82b32f2"
      },
      "source": [
        "print(classification_report(y_test, yfit_gbc_best))"
      ],
      "execution_count": 245,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "              precision    recall  f1-score   support\n",
            "\n",
            "        -1.0       0.72      0.36      0.48       237\n",
            "         1.0       0.59      0.87      0.71       256\n",
            "\n",
            "    accuracy                           0.62       493\n",
            "   macro avg       0.66      0.61      0.59       493\n",
            "weighted avg       0.66      0.62      0.60       493\n",
            "\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "PgCJyNXL8TSd",
        "colab_type": "text"
      },
      "source": [
        "## Single Decision Tree Model"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "scrolled": true,
        "id": "7Kboxzvp8TSe",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 272
        },
        "outputId": "54e56f3c-f2d6-4cb1-abc4-6c1e89edb802"
      },
      "source": [
        "params = {'max_depth': [2,3,4,5,6]}\n",
        "dtc_grid = GridSearchCV(DecisionTreeClassifier(), params, cv=5)\n",
        "dtc_grid"
      ],
      "execution_count": 246,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "GridSearchCV(cv=5, error_score='raise-deprecating',\n",
              "             estimator=DecisionTreeClassifier(class_weight=None,\n",
              "                                              criterion='gini', max_depth=None,\n",
              "                                              max_features=None,\n",
              "                                              max_leaf_nodes=None,\n",
              "                                              min_impurity_decrease=0.0,\n",
              "                                              min_impurity_split=None,\n",
              "                                              min_samples_leaf=1,\n",
              "                                              min_samples_split=2,\n",
              "                                              min_weight_fraction_leaf=0.0,\n",
              "                                              presort=False, random_state=None,\n",
              "                                              splitter='best'),\n",
              "             iid='warn', n_jobs=None, param_grid={'max_depth': [2, 3, 4, 5, 6]},\n",
              "             pre_dispatch='2*n_jobs', refit=True, return_train_score=False,\n",
              "             scoring=None, verbose=0)"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 246
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "Lb4QfVL18TSm",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 119
        },
        "outputId": "4a26582c-7952-4551-d839-ce0b0f28d6f7"
      },
      "source": [
        "dtc_grid.fit(X_train, y_train)\n",
        "dtc_grid.best_estimator_"
      ],
      "execution_count": 247,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "DecisionTreeClassifier(class_weight=None, criterion='gini', max_depth=3,\n",
              "                       max_features=None, max_leaf_nodes=None,\n",
              "                       min_impurity_decrease=0.0, min_impurity_split=None,\n",
              "                       min_samples_leaf=1, min_samples_split=2,\n",
              "                       min_weight_fraction_leaf=0.0, presort=False,\n",
              "                       random_state=None, splitter='best')"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 247
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "VY5ERr_F8TSu",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 34
        },
        "outputId": "6591c49d-5daa-4276-beef-0417f96ba9d4"
      },
      "source": [
        "\n",
        "yfit_dtc_best = dtc_grid.best_estimator_.predict(X_test)\n",
        "tree_score = accuracy_score(yfit_dtc_best, y_test)\n",
        "tree_score"
      ],
      "execution_count": 248,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "0.5983772819472617"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 248
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "fnW3fi4p8TS1",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 283
        },
        "outputId": "357f1827-26d6-475f-9a36-46dfb86513c4"
      },
      "source": [
        "mat = confusion_matrix(y_test, yfit_dtc_best)\n",
        "sns.heatmap(mat , annot=True)\n",
        "plt.xlabel('true label')\n",
        "plt.ylabel('predicted label');"
      ],
      "execution_count": 249,
      "outputs": [
        {
          "output_type": "display_data",
          "data": {
            "image/png": "iVBORw0KGgoAAAANSUhEUgAAAW4AAAEKCAYAAAAyx7/DAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4zLCBo\ndHRwOi8vbWF0cGxvdGxpYi5vcmcvnQurowAAG45JREFUeJzt3XmcVnX5//HXm112WUXFNdwXUlTM\nSkwtNb+hpbh9i1zAEk0NLVfSr5j+Sk3TolBcMtPQMkkFF8ykXDGVxJU0kkUYkB0EZub6/XEfbECY\nOTPc27l5P32cx5zt/pzrPB7jNR+u+3M+RxGBmZllR7NSB2BmZo3jxG1mljFO3GZmGePEbWaWMU7c\nZmYZ48RtZpYxTtxmZhnjxG1mljFO3GZmGdOi1AFsyGnbHedHOu1Tfrp7ValDsDLU9ZG/amPbWD3v\nvdQ5p2W3HTb6ehvDPW4zs4wp2x63mVlR1daUOoLUnLjNzABqqksdQWpO3GZmQERtqUNIzYnbzAyg\n1onbzCxb3OM2M8sYfzlpZpYx7nGbmWVLeFSJmVnG+MtJM7OMcanEzCxj/OWkmVnGuMdtZpYx/nLS\nzCxj/OWkmVm2RLjGbWaWLa5xm5lljEslZmYZ4x63mVnG1KwudQSpOXGbmYFLJWZmmeNSiZlZxrjH\nbWaWMU7cZmbZEv5y0swsY1zjNjPLGJdKzMwyxj1uM7OMcY/bzCxj3OM2M8uY6uy8SKFZqQMwMysL\nUZt+aYCk2yXNlfR6nX19JT0v6VVJkyXtn+yXpJ9LmiZpiqR9GmrfidvMDHI17rRLw+4Ejlhn30+A\nKyOiLzAi2QY4EuiTLEOBUQ017sRtZgZ57XFHxDPAR+vuBjom652AWcn6QOA3kfM80FlSr/rad43b\nzAyKMarkPOAxSdeR6zR/Ltm/FfBBnfNmJPtmb6gh97jNzKBRPW5JQ5M69ZplaIorfBc4PyJ6A+cD\nY5oaqnvcZmbQqFElETEaGN3IKwwGzk3W7wduS9ZnAr3rnLd1sm+D3OM2MwOISL80zSzg4GT9S8C7\nyfo44FvJ6JL+wKKI2GCZBNzjNjPLyWONW9K9wACgm6QZwI+AIcBNkloAH5MbQQLwKHAUMA1YDpza\nUPtO3GZmkNfEHREnbeDQvus5N4BhjWnfidvMDPzIu5lZ5tTUlDqC1Jy4zczAswOamWWOE7eZWca4\nxm1mli1R2+Tx2UXnxG1mBi6VmJlljkeVmJlljHvc1lSHnXoUXzzxMCTxzH1P8sTtj9CuU3u+c8v5\ndNu6B/NmzGXUsBtYvnhZqUO1Rmp37g9ptf+B1C5cwKJhn36qucWefelw+dXUzslNU7Hq2UmsuPeu\njbtoi5a0H34JLT6zE7VLFrP02iupnfshLfv2o+2pQ6FFS6hezbIxo6ie8srGXSvrMpS4PclUGdlq\np9588cTDGDnwIn505HD2/tK+9Nh2C4767jG8+ew/ufiQc3jz2X9y1FnHljpUa4KVT45n8YgL6z2n\neuoUFp1zBovOOaNRSbtZjy3oeM2Nn9rf+itfJZYuYeGQU/j4T/fT9tQzAahdvIjFV17MomGnsvSG\na+gw/NLG3UwlKvwkU3lTsMQtaRdJP0zepfbzZH3XQl2vEvT6zNa8/+q7rPp4FbU1tbz9whvsc8QB\nfPbw/fj7A08D8PcHnmafw/crbaDWJNVTpxBLljTps60OOZxON/yKTjffRruzh0OzdP/rtjrgIFZO\nfAyAVX/7Ky33zr3OsOa9d4mP5ufWp78PrVvnet+bsvy+uqygCpK4Jf0QuA8Q8GKyCLhX0kWFuGYl\nmPn2f+iz366069yeVm1asechn6VLr6507N6ZRVULAVhUtZCO3TuXOFIrlBa77E6nm8fQ4cqf0Hyb\n7QBo3ntbWn/hSyy6cBiLzjkDamtpNeDwVO0169qN2qq5uY3aGmL5MtSx01rntDroYKr/9Q5Ur87n\nrWRPbaRfSqxQNe7Tgd0jYq3fBEk3AFOBawt03Uyb/a+ZjP/Vnxh+9+WsXL6SD974N7Gev+5RBv9U\ns/yrmfYOC049AT5eQct+B9DhsqtZOPQUWu69Dy0+sxOdbvw1AGrVmtqFCwDocOlImm2xBbRoSfPu\nPeh0c25u/o8f+gMrnxzf4DWbb7MdbU89k8WXXVC4G8sKjyqhFtgSmL7O/l7JsfVKXv8zFOBzXT7L\nzh12KFB45WvS2KeYNPYpAL5+4cksmD2fxVUL6ZT0ujt178ySeYtKHKUVQqxY/sn66skvwFnNc71j\niZUTJ7D8rls/9ZklV18G5Grc7c+/iMUXn7fW8dr582jWvQe186ugWXPUth2xOPf706xrdzpcNpKl\n1/+Y2g9nfartTc36OknlqlA17vOAiZLGSxqdLBOAifz31T2fEhGjI6JfRPTbFJM2QIeuuZdAd9my\nG/secQDPj5vEK09O5qDjBgBw0HEDeOWJl0oYoRWKNu/yyXqLnXYBNSMWL2L1qy/T6qABqFOuRKb2\nHWjWvWeqNle98HdaH/oVAFp9/mBWJyNH1K49Ha64luV3/prqN1/P851k1KZeKomICZJ2AvYn97Zi\nyL1D7aWIyM6/R0pg2KgLab95e2qqa/jt5bexYvFyHh31IN/9xXC+MOhQ5s+sYtSwG0odpjVB+x+M\noOWefVHHTnS+635W3HMHNM/9L7hy/DhaH3QwrY8aCDU1xKqVLP3JlQDUfDCd5XffRseR14GaQU01\ny355I7VVcxq85srHH6XlBZfS+dZ7iCVLWJK02eboY2m+5VZsdtJgNjtpMACLL7uAWLSwQHefARma\nq0TlWi89bbvjyjMwK6mf7l5V6hCsDHV95K/a2DaW/d8pqXNOuxH3bPT1NoYfwDEzA6jOTjHAidvM\nDDJVKnHiNjODsvjSMS0nbjMzsjUc0InbzAzc4zYzyxwnbjOzjPEj72Zm2eJ3TpqZZY0Tt5lZxnhU\niZlZxrjHbWaWMU7cZmbZEjUulZiZZUsl9LglddnQMYCI+Cj/4ZiZlUalDAd8GQhyL/ldVwCb5itq\nzKwy5TFxS7odOBqYGxF7JPuuAIYAayaVvyQiHk2OXUzuXb01wPci4rH62t9g4o6I7Tc6ejOzrMhv\niftO4BbgN+vs/1lEXFd3h6TdgBOB3cm9q/dJSTvV97awBt85qZz/lXR5sr2NpP0bdw9mZuUtqmtT\nLw22FfEMkLacPBC4LyJWRsT7wDRyr33coDQvC/4lcCBwcrK9BPhFyoDMzLKhthFL050taYqk2yVt\nnuzbCvigzjkz+O+7etcrTeI+ICKGAR8DRMQCoFUTAjYzK1tRG6kXSUMlTa6zDE1xiVHAjkBfYDZw\nfVNjTTMccLWk5uS+kERSd/JdDTIzK7VGZLWIGA2MbkzzETFnzbqkW4GHk82ZQO86p26d7NugND3u\nnwMPAj0lXQ38DfhxYwI2Myt3jelxN4WkXnU2jwVeT9bHASdKai1pe6AP8GJ9bTXY446IeyS9DBya\n7DomIt5sfNhmZmUsj3UESfcCA4BukmYAPwIGSOpLrnrxb+BMgIiYKmks8AZQDQyrb0QJpH9ysi2w\nplyyWeNvw8ysvEV1HtuKOGk9u8fUc/7VwNVp208zHHAEcBfQBegG3CHpsrQXMDPLgqhNv5Ramh73\nKcDeEfExgKRrgVeBkYUMzMysqMogIaeVJnHPAtqQDAcEWtPAN55mZllTDj3ptOqbZOpmcjXtRcBU\nSU8k24fTwDeeZmZZUxGJG5ic/HyZ3HDANZ4uWDRmZiUSNeubT6881TfJ1F3FDMTMrJQqpccNgKQ+\nwDXAbuRq3QBEhKd1NbOKEbXZ6XGneXLyDnLP2FcDh5CbpvC3hQzKzKzYsjQcME3i3iwiJgKKiOkR\ncQXw1cKGZWZWXBFKvZRamuGAKyU1A96VdDa5oYDtCxuWmVlxlUNPOq00iftcco+8fw+4CvgSMLiQ\nQZmZFVttJYwqWSMiXkpWlwKnFjYcM7PSyNKXk/U9gPNnkjm41ycivlaQiMzMSqAiEjdwXT3HzMwq\nSuTvJe8FV98DOH8tZiBmZqVUKT1uM7NNRjkM80vLidvMDKippFElZmabgorocXtUiZltSiqlxr1m\nVMnXgS347/wkJwFz1vsJM7OMqqhRJZKuj4h+dQ79WdLkDXzMzCyTKqXHvUY7STtExHsAkrYH2hU2\nLDOz4qqpTTPnXnlIk7jPB56W9B4gYFvgzIJGZWZWZBVRKlkjIiYkL1PYJdn1VkSsLGxYZmbFVVsJ\no0rWkNQW+D6wbUQMkdRH0s4R8XDhwzMzK44sDQdM+wacVcCByfZMYGTBIjIzK4GI9Euppalx7xgR\nJ0g6CSAilksq+J+m38x6rtCXsAz69eRJpQ7BKlRFlUqAVZI2I3kYR9KOgGvcZlZRKm1UyRXABKC3\npHuAg/ALFcyswpRBBSS1NKNKHpf0MtCf3HDAcyNiXsEjMzMroooqlUiaGBGHAo+sZ5+ZWUXI0qiS\n+iaZakPuJcHdJG1OrrcN0BHYqgixmZkVTYZe8l5vj/tM4DxgS+Bl/pu4FwO3FDguM7OiCiqgxx0R\nNwE3STonIm4uYkxmZkVXnaFSSZrxL7WSOq/ZkLS5pLMKGJOZWdEFSr00RNLtkuZKer3Ovp9KekvS\nFEkPrpNXL5Y0TdLbkr7SUPtpEveQiFj4yc1FLACGpPicmVlm1DZiSeFO4Ih19j0B7BERewHvABcD\nSNoNOBHYPfnMLyU1r6/xNIm7ed0nJZMGW6WL3cwsG/LZ446IZ4CP1tn3eERUJ5vPA1sn6wOB+yJi\nZUS8D0wD9q+v/TSJewLwe0mHSjoUuDfZZ2ZWMRrT45Y0VNLkOsvQRl7uNGB8sr4V8EGdYzNoYORe\nmicnf0huhMl3k+0ngNsaF6OZWXmracSokogYDYxuynUkXQpUA/c05fOQ7snJWmBUspiZVaRivLlM\n0reBo4FDIz6ZZ3Am0LvOaVsn+zaovgdwxkbEIEn/ZD2P8ScFdjOzilBb4HHcko4AfgAcHBHL6xwa\nB/xO0g3knpvpA7xYX1v19bjPTX4evRGxmpllQj4nmZJ0LzCA3JPnM4AfkRtF0hp4Ihnv8XxEfCci\npkoaC7xBroQyLCJq6mu/vgdwZic/p+fjRszMylk+H3mPiJPWs3tMPedfDVydtv36SiVLqOePUER0\nTHsRM7NyV1v498PkTX097g4Akq4CZgN3k5uv5BSgV1GiMzMrknprE2UmzXDAr0XE3nW2R0l6DRhR\noJjMzIquGKNK8iXNAzjLJJ0iqbmkZpJOAZYVOjAzs2KqRamXUkuTuE8GBgFzkuX4ZJ+ZWcWIRiyl\nluYBnH+Te5bezKxiVVSpRNJOkiaumZ5Q0l6SLit8aGZmxZPn2QELKk2p5FZyA8dXA0TEFHJTEJqZ\nVYwapV9KLc2okrYR8aLWHuNYvaGTzcyyqBx60mmlSdzzJO1IUpOXdBy5cd1mZhWj0hL3MHLTF+4i\naSbwPrmHcMzMKkaGXjlZf+KW1AzoFxGHSWoHNIuIJcUJzcyseLLU4673y8lkLu4fJOvLnLTNrFLV\nNGIptTSlkiclXQD8njpPTEbERxv+iJlZtmRpHHeaxH1C8nNYnX0B7JD/cMzMSiNLpZI0T05uX4xA\nzMxKqaISt6Q2wFnA58n1tCcBv4qIjwscm5lZ0ZTDHCRppSmV/AZYAtycbJ9Mbm7u4wsVlJlZsVVa\njXuPiNitzvZfJL1RqIDMzEqhHEaLpJVmrpJ/SOq/ZkPSAcDkwoVkZlZ8tUTqpdTS9Lj3BZ6V9J9k\nexvgbUn/BCIi9ipYdGZmRVJRX04CRxQ8CjOzEit9Pzq9NMMBpxcjEDOzUqq0HreZWcWrVnb63E7c\nZmZUWKnEzGxT4FKJmVnGlMMwv7ScuM3McKnEzCxzXCoxM8uYmgz1uZ24zcxwj9vMLHPCPW4zs2xx\nj9s2yrR3nmfJ0qXU1NRSXV1N/wOP4hvfOJoRl3+fXXfpw4Gf+yov/2NKqcO0Rpg9p4pLrrqO+QsW\nIMRxA4/km4OOWeuciOCaG3/FpOdeok2b1lx96XB22/kzG3XdRYuXMPzya5j14Ry23KIn1191MZ06\nduDhx55izD33Q0Dbtptx+QVns0ufTftthPkcDijpXGAIIODWiLhRUhdy7+7dDvg3MCgiFjSl/TTT\nuloJHHb48fTb78v0P/AoAKZOfYvjBw1h0qTnSxyZNUWL5s258JwhjLtnNL8b/TPu++PD/Ov9tacB\nmvTcS/xnxiwe/f0YrvjB97jqultSt//iP6Zw6cjrP7X/trvH0r9fXx79/Rj69+vLmN+OBWCrLbfg\nzlt+woN3j+I73z6JK3/y8427wQoQjVjqI2kPckl7f2Bv4GhJnwEuAiZGRB9gYrLdJE7cGfHWW9N4\n551/lToMa6Lu3bp80ntu164tO2zbmzlV89c65y9/e56vHXEokth7j11ZsmQpVfM+AuD2ex7ghNO/\nx7Hf+i633HZ36uv+ZdJzDDzyMAAGHnkYTz3zHACf3XM3OnXsAMBeu+/CnLnzNvoes66aSL00YFfg\nhYhYHhHVwF+BrwMDgbuSc+4CjtnA5xtU9MQt6dRiXzNrIoLxj97LC8+P54zTTyl1OJZnM2fP4c13\n/8Veu++81v45VfPZoke3T7Z79ujGnKp5/P2Fl/nPjJncd9tN/OHOX/DG29OY/Oo/U11r/oKFdO/W\nBYBuXTdn/oKFnzrnjw8/xuf799uIO6oM0Yj/GvA68AVJXSW1BY4CegM9I2J2cs6HQM+mxlqKGveV\nwB3rOyBpKDAUQM070axZu2LGVTYOPuRYZs36kO7duzJh/H28/fY0Jv3thVKHZXmwfPkKzr90JD/8\n3pm0b5fu9/vZl/7Bsy/+g+O+fXaujRUrmP7BLPr13ZOThpzHqlWrWb5iBYsWL+Ebg4cB8P2zTuOg\nA/Zdqx1JSGu/WPHFl1/jjw8/zt2jrsvD3WVbY76crJurEqMjYjRARLwp6f8BjwPLgFdZ581oERFS\n06cjLEjilrShb85EPX9lkhsfDdCi1VbZGZuTZ7NmfQhAVdV8HnpoPPvt19eJuwKsrq7mvEtH8tUv\nH8LhAw761PGe3bvyYZ2SxZy58+jZvRsEnPHNExh0zFGf+sy9t94I5GrcDz36BFdfNnyt410370zV\nvI/o3q0LVfM+okvnTp8ce3va+4y49kZ+df1VdO7UMV+3mVmNGQ5YN1dt4PgYYAyApB8DM4A5knpF\nxGxJvYC5TY21UKWSnsC3gP9ZzzK/ns9t8tq23Yz27dt9sn74YQczderbJY7KNlZEMOKaG9lh294M\nPvHr6z1nwOf7M27CRCKC115/k/bt29G9Wxc+t/8+PPjI4yxfvgKAOVXz1lvy2FCbD41/EoCHxj/J\nIV84EIDZH87lvEuu4poRF7LdNlvn4Q6zr7YRS0Mk9Uh+bkOuvv07YBwwODllMPBQU2MtVKnkYaB9\nRLy67gFJTxfomhWhZ8/uPHD/GABatGjOfff9iccef5qBA4/gpp+NpHv3Lox76De89tpUjjra9e+s\neGXKVP48YSJ9dtzuk3LGuWcOZvacKgBOOParfPHA/Zj03EscOeg0NmvThqsuOR+Agw7Yl/emf8Ap\nZ34fgLabteGaERfSdfPODV73jG8OYvjlP+aPDz/Gllv04PqrLgFg1B2/Y9HiJYy87hcANG/enLG3\nb9ojS2oir//I/4OkrsBqYFhELJR0LTBW0unAdGBQUxtX5DfYvNmUSyW2YStmTSp1CFaGWnbbQQ2f\nVb+Ttz02dc753fQHN/p6G8MP4JiZ4Ufezcwyx4+8m5lljN+AY2aWMS6VmJllTJ5HlRSUE7eZGS6V\nmJlljr+cNDPLGNe4zcwyxqUSM7OMKdenyNfHidvMDKhxj9vMLFtcKjEzyxiXSszMMsY9bjOzjPFw\nQDOzjPEj72ZmGeNSiZlZxjhxm5lljEeVmJlljHvcZmYZ41ElZmYZUxPZmdjVidvMDNe4zcwyxzVu\nM7OMcY3bzCxjal0qMTPLFve4zcwyxqNKzMwyxqUSM7OMcanEzCxj3OM2M8sY97jNzDKmJmpKHUJq\nzUodgJlZOYiI1EtDJHWW9ICktyS9KelASV0kPSHp3eTn5k2N1YnbzIzcI+9plxRuAiZExC7A3sCb\nwEXAxIjoA0xMtpvEidvMjPz1uCV1Ar4IjEnaXRURC4GBwF3JaXcBxzQ1ViduMzNyo0rSLg3YHqgC\n7pD0iqTbJLUDekbE7OScD4GeTY3VidvMjNyokrT/SRoqaXKdZWidploA+wCjIuKzwDLWKYtErtve\n5GEsHlViZkbjHnmPiNHA6A0cngHMiIgXku0HyCXuOZJ6RcRsSb2AuU2N1T1uMzPyV+OOiA+BDyTt\nnOw6FHgDGAcMTvYNBh5qaqzucZuZkfcnJ88B7pHUCngPOJVcR3mspNOB6cCgpjbuxG1mRn5fXRYR\nrwL91nPo0Hy078RtZoZfXWZmljl+WbCZWcb4RQpmZhnjaV3NzDLGpRIzs4zxfNxmZhnjHreZWcZk\nqcatLP2V2VRJGprMjWD2Cf9ebLo8V0k2DG34FNsE+fdiE+XEbWaWMU7cZmYZ48SdDa5j2vr492IT\n5S8nzcwyxj1uM7OMceIuc5KOkPS2pGmSLmr4E1bpJN0uaa6k10sdi5WGE3cZk9Qc+AVwJLAbcJKk\n3UoblZWBO4EjSh2ElY4Td3nbH5gWEe9FxCrgPmBgiWOyEouIZ4CPSh2HlY4Td3nbCvigzvaMZJ+Z\nbcKcuM3MMsaJu7zNBHrX2d462WdmmzAn7vL2EtBH0vaSWgEnAuNKHJOZlZgTdxmLiGrgbOAx4E1g\nbERMLW1UVmqS7gWeA3aWNEPS6aWOyYrLT06amWWMe9xmZhnjxG1mljFO3GZmGePEbWaWMU7cZmYZ\n48RteSWps6SzCtj+tyXd0sA5V0i6oJHtLt24yMyKx4nb8q0zsN7ELalFkWMxq0hO3JZv1wI7SnpV\n0k8lDZA0SdI44A1J29WdR1rSBZKuSNZ3lDRB0svJZ3ap70KS/kfSC5JekfSkpJ51Du8t6TlJ70oa\nUuczF0p6SdIUSVfm99bNisM9IMu3i4A9IqIvgKQBwD7JvvclbVfPZ0cD34mIdyUdAPwS+FI95/8N\n6B8RIekM4AfA8OTYXkB/oB3wiqRHgD2APuSmyxUwTtIXk2lSzTLDiduK4cWIeL++EyS1Bz4H3C9p\nze7WDbS7NfB7Sb2AVkDdazwUESuAFZL+Qi5Zfx74MvBKck57concidsyxYnbimFZnfVq1i7RtUl+\nNgMWrumpp3QzcENEjEt69lfUObbuXA5Brpd9TUT8uhHXMCs7rnFbvi0BOtRzfA7QQ1JXSa2BowEi\nYjHwvqTjAZSzdwPX6sR/p7kdvM6xgZLaSOoKDCA30+JjwGlJ7x5JW0nqkf7WzMqDe9yWVxExX9Lf\nky8gxwOPrHN8taT/A14kl3TfqnP4FGCUpMuAluRe1fZaPZe7glxpZQHwFLB9nWNTgL8A3YCrImIW\nMEvSrsBzSTlmKfC/wNwm3q5ZSXh2QDOzjHGpxMwsY5y4zcwyxonbzCxjnLjNzDLGidvMLGOcuM3M\nMsaJ28wsY5y4zcwy5v8Dt3QtNDFC3CkAAAAASUVORK5CYII=\n",
            "text/plain": [
              "<Figure size 432x288 with 2 Axes>"
            ]
          },
          "metadata": {
            "tags": []
          }
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "gDZwih4d8TS7",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 170
        },
        "outputId": "5a89a084-707d-4c5c-80d4-2ef63e0b59bf"
      },
      "source": [
        "print(classification_report(y_test, yfit_dtc_best))"
      ],
      "execution_count": 250,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "              precision    recall  f1-score   support\n",
            "\n",
            "        -1.0       0.64      0.38      0.48       237\n",
            "         1.0       0.58      0.80      0.67       256\n",
            "\n",
            "    accuracy                           0.60       493\n",
            "   macro avg       0.61      0.59      0.58       493\n",
            "weighted avg       0.61      0.60      0.58       493\n",
            "\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "4bqIN-ua8TTB",
        "colab_type": "text"
      },
      "source": [
        "## XGBoost"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "ZE-9DqS78TTD",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "from xgboost import XGBClassifier"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "pH_YgrmTDeXM",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "xgb = XGBClassifier(n_estimators=100)\n",
        "xgb = xgb.fit(X_train, y_train)\n",
        "yfit_xgb = xgb.predict(X_test)"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "KVhiM1F5EDFZ",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 34
        },
        "outputId": "ad60bf90-0841-4d04-e2b5-051ca70a129c"
      },
      "source": [
        "xgb_score = accuracy_score(yfit_xgb, y_test)\n",
        "xgb_score"
      ],
      "execution_count": 253,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "0.6308316430020284"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 253
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "4tAbapcgEK6I",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 283
        },
        "outputId": "a249e7b2-7ca9-4cf6-e448-c82eca9e82f1"
      },
      "source": [
        "mat = confusion_matrix(y_test, yfit_xgb)\n",
        "sns.heatmap(mat , annot=True)\n",
        "plt.xlabel('true label')\n",
        "plt.ylabel('predicted label');"
      ],
      "execution_count": 254,
      "outputs": [
        {
          "output_type": "display_data",
          "data": {
            "image/png": "iVBORw0KGgoAAAANSUhEUgAAAW4AAAEKCAYAAAAyx7/DAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4zLCBo\ndHRwOi8vbWF0cGxvdGxpYi5vcmcvnQurowAAHUdJREFUeJzt3XeYFdX9x/H3Z4FVQBAQlaoCAhYU\nothLiN3EBEsSRZNYUCyYnyUWrFGxRUWNGkFULImiJsZoTMSCjRgbWFAUgqIoRZCiFBXY3e/vj3vR\nK7C7s7D33p3l8+KZZ++cmXvmO88zfPfsmTNnFBGYmVl6lBQ7ADMzqxknbjOzlHHiNjNLGSduM7OU\nceI2M0sZJ24zs5Rx4jYzSxknbjOzlHHiNjNLmYbFDqAyj7Y50o902kq+KlGxQ7A6qN+M+9b4wlg2\nZ0rinNOodeeiXohucZuZpUydbXGbmRVURXmxI0jMidvMDKC8rNgRJObEbWYGRFQUO4TEnLjNzAAq\nnLjNzNLFLW4zs5TxzUkzs5Rxi9vMLF3Co0rMzFLGNyfNzFLGXSVmZinjm5NmZinjFreZWcr45qSZ\nWcr45qSZWbpEuI/bzCxd3MdtZpYy7ioxM0sZt7jNzFKmfFmxI0jMidvMDNxVYmaWOu4qMTNLGbe4\nzcxSphYTt6QRwEHA7IjokS17EOie3aUF8EVE9JK0GfA+MCm77ZWIOKmq+p24zcyAqN2bk3cDtwD3\nflt/xOHLP0saAnyZs/+HEdEraeVO3GZmUKt93BHxYrYlvRJJAn4J7LW69Zes7hfNzOqViorky5rZ\nA5gVEZNzyjpJelPSC5L2qK4Ct7jNzKBGLW5JA4ABOUXDI2J4wq/3A0bmrM8ENomIuZK2B/4haeuI\nWFBZBU7cZmZQo5Z0NkknTdTfktQQOBTYPqeuJcCS7Odxkj4EugFjK6vHidvMDAo1jnsfYGJETFte\nIGlDYF5ElEvqDHQFplRViRO3mRlAWe29SEHSSKAP0FrSNOD3EXEncATf7yYB2BO4TNIyoAI4KSLm\nVVW/E7eZGdT2qJJ+lZQfs4qyh4GHa1K/E7eZGfjJSTOz1PFcJWZmKeMWt5lZyrjFbWaWMrU4qiTf\nnLjNzAAiih1BYk7cZmbgPm4zs9Rx4jYzSxnfnDQzS5ny8mJHkJgTt5kZuKvEzCx1nLjNzFLGfdxm\nZukSFR7HbWaWLu4qMTNLGY8qMTNLGbe41269bhhAm31/wJI5C3iuz7krbe9w6G5sfupPkaBs0Te8\nfe4IFrz3yRods6S0IdvdfDLrb9uJZfMX8fqJN/H1p3PYcM8ebHVBP0pKG1CxtJwJl93HnJfeW6Nj\n2erZ6foTaLfPD/hmzgKe2GvQSts3PWRXthr4U5BYtvhrxg66iy9q4brY+aaTabXNZiyZv4j/nnQz\ni6fNoc2ePeh5/hGUNGpIxbIy3hp8P7PW9usiRYm7pNgB1EefPvgiL/f7Q6XbF38ym5cOGcxzPxrE\npBseodd1xyeuu3HH1uz29wtXKt/kyD4s/WIxo3c5kw9ve4KtL8y8OWnpvIW8+ptree5Hg3jjtKFs\nd8spNT8hqxVTHhzD80ddU+n2xZ9+zjOHDeaJvQcx4YZ/sMM1/RPX3bRDa/b62wUrlXful7kuHt/t\nd0y6/Ql6Zq+LJfMW8uLR1/HE3oN45bRh7HzTyTU/ofomIvlSZHlrcUvaAugLtM8WTQcei4j383XM\numLuKxNp3LF1pdvnj5383edxH7Bu21bfrnc4bDc6H38AJY0aMP+ND3l70AhIcLe77f69mXhd5rV1\nMx5/lW2uPAaAL9+d+u0+CydOo8G6pZSUNqRiaXqmsKwvPn91Ik07VH5dzMm5Lua8MZkmOdfFZofu\nRrf++1NS2pC5b3zA2PPuSjQKosP+2/POkMx18enjr9H7imMAmJ9zXXw5ydcF4Ba3pHOBBwABr2UX\nASMlrfw34lpskyP7MPvZtwFYr2s72vfdhTE/vYTn9zmfqKig42G7J6pn3bYt+XrGXACivIKyhV9R\n2qrZ9/Zpe9COfPnOx2v3f86U6NKvDzOfy1wXzTdvxyZ9d+bpvpcyat/zifIKNj10t0T1NG7Tkq9m\nZF4YHuUVLF3wFaWt1vvePh1/siPz3/V1QUUkX4osXy3u/sDWEbEst1DS9cAE4Oo8HTdVWu+2FZv2\n68OYvpcCsOEePWixbSd+OGowAA3WLWXJnAUA7DjiDJpssiElpQ1p3L41fZ65EoApdzzJJw+8UO2x\nmnVvz9YX9uO/h1+Vp7Ox2rLRrlvRuV8fnjn4MgA23mNrWm7Tif2fWH5dNOKbuZnrYvc7T2e9TTai\npFFDmrTfgAOezlwXk+4YxUcPvljtsZp3a0/PC47g+X7+L+lRJVABtAOmrlDeNrttlSQNAAYAnNxs\nB/Zvsnmewiu+5lt2pNeQE3j5yD+wbP6iTKHgk4de5P0rH1xp/9eOuwHI9HFv98eTeOnQy7+3/ZuZ\n82ncbgO+mTkPNSihYbMmLJ23EIB127ZixxFn8sZvh/LV1Nn5PTFbIy227MiO1x3PC7+6hqXfXhfi\n47+O4e2rVr4u/tP/RiDTx73TjSfy7M+v+N72rz+bT5N2rfg6e12UNm/C0nmZehu3bcUed57BK6cN\nY5GvC2Jt7yoBTgdGS3pC0vDsMgoYDZxW2ZciYnhE9I6I3vU5aTduvwE7jDiDcafeyuIpn31bPmfM\nBNodtBOlrZsD0KhFUxpX0Sea67OnxtHxl3sA0O6gnZjz0gQAGjZvws5/OZv3rniAea//r5bPxGpT\nk/YbsPsdp/PK/w1lYc51MWvMBDr+ZEfW2SBzXZS2aEqT9smui+lPvUGnX+wJQMeDdmTWfzLXRaPm\nTfjhvWfx9pUPMMfXRcba3lUSEaMkdQN25Ps3J1+PiPT8PbKath96Kq133ZLSVs3Y742bmXjtw5Q0\nagDAx/eOpvuZh1Lashk9rz4WyPQ9vrD/hSz833Te/8ND7PrAICgpIZaVM/68u/h62pxqjzn1/ufZ\n7pZT2Pvl61n2xWLGnngzAJ2P24+mnTam+5mH0P3MQwD47xFXszTbBWOFs+utA9loly1Zp1Uz+o69\nmXeG/I2Shpn/gh/8eTQ9zjiEdVo2o/dVmeuioqycpw68iAWTpzP+mr/yowcGIYmKsnLGnn83X02v\n/rr4cOTz7HLTyRz00hCWfrGYl07OXBfdjt2PZp02pseZh9LjzEMBeO6Iq1kydy2+LlI0V4miDgxt\nWZVH2xxZNwOzovqqRMUOweqgfjPuW+MLY/FlRyXOOU0vXvPjrQk/gGNmBlCWns4AJ24zM0hVV4kT\nt5kZ1Imbjkk5cZuZka7hgE7cZmbgFreZWeo4cZuZpYwfeTczS5c0vXPS83GbmUGtPvIuaYSk2ZLe\nzSm7RNJ0SW9llx/nbDtP0geSJknav7r63eI2M4Pano/7buAW4N4Vym+IiOtyCyRtBRwBbE1mcr5n\nJHWranoQt7jNzKBWW9wR8SIwL+GR+wIPRMSSiPgI+IDMPE+VcuI2M4NCzQ54qqTx2a6Ultmy9sCn\nOftM47vJ+VbJidvMjMwsnUkXSQMkjc1ZBiQ4xFCgC9ALmAkMWd1Y3cdtZgY1aklHxHBgeE2qj4hZ\nyz9Luh14PLs6HeiYs2uHbFmlKk3cklpVti0bRNL+GzOzOi/fwwEltY2ImdnVQ4DlI04eA+7Pvtqx\nHdCVzHt6K1VVi3scEGRe8ruiADrXJGgzszqtFhO3pJFAH6C1pGnA74E+knqRyZ8fAycCRMQESQ8B\n7wFlwMDqXjhTaeKOiE61cQJmZqlQi6MBI6LfKorvrGL/K4ArKtu+omr7uCUJOAroFBGDJW0CtImI\nKpvyZmZpEmXpmR0wyaiSW4FdgCOz6wuBP+UtIjOzYqiowVJkSUaV7BQR20l6EyAi5ksqzXNcZmYF\nlaa5SpIk7mWSGpDpUEfShtSJ3zlmZrUoRVktSeK+CXgE2FjSFcDPgQvzGpWZWYHVqxZ3RNwnaRyw\nd7bo4Ih4P79hmZkVWD1rcQM0AZZ3lzTOXzhmZsURZcWOILlqR5VIuhi4B2gFtAbukuSuEjOrV6Ii\n+VJsSVrcRwE9I+IbAElXA28Bl+czMDOzgqoDCTmpJIl7BrAu8E12fR2qmQDFzCxt6kJLOqmqJpm6\nmUyf9pfABElPZ9f3pZoJUMzM0qZeJG5gbPbnODLDAZd7Pm/RmJkVSZSvaj69uqmqSabuKWQgZmbF\nVF9a3ABI6gpcBWxFpq8bgIjwtK5mVm9ERXpa3EkmmbqLzCt3yoAfkXlr8V/yGZSZWaGlaThgksTd\nOCJGA4qIqRFxCfCT/IZlZlZYEUq8FFuS4YBLJJUAkyWdSmYo4Hr5DcvMrLDqQks6qSSJ+zQyj7z/\nHzAY2As4Op9BmZkVWkV9GFWyXES8nv24CDg2v+GYmRVHmm5OVvUAzj/JzsG9KhHxs7xEZGZWBPUi\ncQPXFSwKM7Mii/RMx13lAzgvFDIQM7Niqi8tbjOztUZdGOaXlBO3mRlQXp9GlZiZrQ3qRYvbo0rM\nbG1SX/q4l48qORRow3fzk/QDZuUzKDOzQqtXo0okDYmI3jmb/ilpbCVfMzNLpfrS4l6uqaTOETEF\nQFInoGl+wzIzK6zyiiRz7tUNSRL3GcDzkqYAAjYFTsxrVGZmBVYvukqWi4hR2ZcpbJEtmhgRS/Ib\nlplZYVXUh1Ely0lqApwJbBoRJ0jqKql7RDye//DMzAojTcMBk74BZymwS3Z9OnB53iIyMyuCiORL\nsSXp4+4SEYdL6gcQEV9JyvuvpsPmeaoUW9nXM8YUOwSrp+pVVwmwVFJjsg/jSOoCuI/bzOqVNI0q\nSRLpJcAooKOk+4DRwLn5DMrMrNCiBkt1JI2QNFvSuzll10qaKGm8pEcktciWbybpa0lvZZdh1dVf\nbeKOiKfIPD15DDAS6B0RzyWI3cwsNSpCiZcE7gYOWKHsaaBHRGwL/A84L2fbhxHRK7ucVF3l1SZu\nSaMjYm5E/CsiHo+IOZJGJ4nczCwtavMt7xHxIjBvhbKnIqIsu/oK0GF1Y600cUtaV1IroLWklpJa\nZZfNgPare0Azs7qoogaLpAGSxuYsA2p4uOOAJ3LWO0l6U9ILkvao7stV3Zw8ETgdaAeMI/PUJMAC\n4JYaBmlmVqcFyUeVRMRwYPjqHEfSBUAZcF+2aCawSUTMlbQ98A9JW0fEgsrqqGqSqT8Cf5T024i4\neXUCNDNLi7ICDAeUdAxwELB3RGZEePZJ9CXZz+MkfQh0AyqdzC/JqJKK5Xc/swduKemUNYjdzKzO\nCZR4WR2SDgDOAX4WEV/llG8oqUH2c2egKzClqrqSJO4TIuKLb08uYj5wwuoEbmZWV9Wkj7s6kkYC\nLwPdJU2T1J9MF3Mz4OkVhv3tCYyX9BbwN+CkiJi3yoqzkjyA00CSljfrs78ZShN8z8wsNVa3Jb3K\nuiL6raL4zkr2fRh4uCb1J0nco4AHJd2WXT8xW2ZmVm8kaUnXFUkS97lkkvXJ2fWngTvyFpGZWRGU\n12KLO9+SzMddAQzNLmZm9VKK3lxW5VveH4qIX0p6h1U8np99bNPMrF6oqCct7tOyPw8qRCBmZsVU\nB6bZTqyqB3BmZn9OLVw4ZmbFUS9uTkpaSBW/hCKieV4iMjMrgor8vx+m1lTV4m4GIGkwmWfp/0xm\nvpKjgLYFic7MrEDKix1ADSQZDviziOiZsz5U0tvAxXmKycys4NI0qiTJI++LJR0lqYGkEklHAYvz\nHZiZWSFVoMRLsSVJ3EcCvwRmZZdfZMvMzOqN2nx1Wb4leQDnY6Bv/kMxMyueetVVIqmbpNHLX3op\naVtJF+Y/NDOzwqnN2QHzLUlXye1kXmq5DCAixgNH5DMoM7NCK1fypdiSjCppEhGv6ftjHMsq29nM\nLI3qQks6qSSJe46kLmT75CX9nMy4bjOzeqO+Je6BZF6KuYWk6cBHZB7CMTOrNwrwyslaU2XillQC\n9I6IfSQ1BUoiYmFhQjMzK5w0tbirvDmZnYv7nOznxU7aZlZflddgKbYkXSXPSDoLeJCcJyare5ml\nmVmapGkcd5LEfXj258CcsgA61344ZmbFkaaukiRPTnYqRCBmZsVUrxK3pHWBU4DdybS0xwDDIuKb\nPMdmZlYwdWEOkqSSdJXcCywEbs6uH0lmbu5f5CsoM7NCq2993D0iYquc9eckvZevgMzMiqEujBZJ\nKslcJW9I2nn5iqSdgLH5C8nMrPAqiMRLsSVpcW8P/FfSJ9n1TYBJkt4BIiK2zVt0ZmYFUq9uTgIH\n5D0KM7MiK347OrkkwwGnFiIQM7Niqm8tbjOzeq9M6WlzO3GbmVHPukrMzNYG7ioxM0uZujDMLykn\nbjMz0tVVkuQBHDOzeq823/IuaYSk2ZLezSlrJelpSZOzP1tmyyXpJkkfSBovabvq6nfiNjMDyonE\nSwJ3s/IzMIOA0RHRFRidXQc4EOiaXQYAQ6ur3InbzIzabXFHxIvAii+b6Qvck/18D3BwTvm9kfEK\n0EJS26rqd+I2MwOiBv8kDZA0NmcZkOAQG0fEzOznz4CNs5/bA5/m7DctW1Yp35w0M6NmwwEjYjgw\nfHWPFREhrf4TP07cddD66zdn+G3XsfXW3YkITjjhd+y33w/pf9yRfD4n89fXRRddzROjni1ypFYT\nF155PS++9BqtWrbgH38ZttL2Lxcs5KKrbuDT6TNZp7SUweefQdfOm63RMZcuXcp5g4fw3qTJtFi/\nOddddh7t227Mf197gxuH3cWyZWU0atSQ3w3sz07b91qjY6VdAYYDzpLUNiJmZrtCZmfLpwMdc/br\nkC2rlLtK6qAbrr+MJ598jh7b/JDttt+X9ydOBuCPN91O7x32o/cO+zlpp9DBP96XYddfXun22+99\nkC26duGRe4dy5UVncfWNKyf3ykyfOYtjTj1npfK/P/4UzZutxxMPjeDXhx/M9beOAKBli+bc8odL\neOTPQ7niwt9x3mXX1fyE6pmowbKaHgOOzn4+Gng0p/w32dElOwNf5nSprJITdx3TvHkz9th9J0bc\nNRKAZcuW8eWXC4ocldWG3r22Yf3mzSrd/uHHn7DTdj0B6LxpR6bPnMWcefMB+OeTz3LE8adx2NED\nufSamygvTzbt/7NjXqbvj/cBYL8+e/DquLeICLbstjkbbbgBAJt32pRvlixh6dKla3J6qVdGJF6q\nI2kk8DLQXdI0Sf2Bq4F9JU0G9smuA/wbmAJ8ANxO5lWRVSp44pZ0bKGPmSadOm3CnDlzufOOG3j9\ntSe5bdi1NGnSGIBTTj6WN8Y9ze3Dh9CixfpFjtRqW/fNO/PMCy8B8M57k5g5azazZs/hw48/YdTo\nF/jzsCE8fM+fKCkp4fGnnktU5+zP59Jmo9YANGzYgPWaNuGLFRoCTz//H7bqvjmlpaW1e0IpU5Ob\nk9XWFdEvItpGRKOI6BARd0bE3IjYOyK6RsQ+ETEvu29ExMCI6BIR20REtS+qKUaL+9LKNuTeqa2o\nWFzImOqMhg0a8IMfbMNtt93LDjvuz+LFX3HuOacy7LZ76bbFrmzfez8++2w2115zcbFDtVp2/K9/\nwcJFizns6IHc97fH2KJrFxqUlPDq2Ld4b+IHHNE/0+J+dexbTJvxGQD/d95lHHb0QE4+6yImTJzM\nYUcP5LCjB/LIv55KdMwPpkzl+ltHcPHZv83nqaVCbQ4HzLe83JyUNL6yTXw3BGYluXdqG5a2T9MT\nqLVm2vSZTJs2k9defxOAv//9X5xz9qnMnj3n233uuPM+Hv3HPZVVYSm1XtOmXH7BmQBEBPv//Bg6\ntG/DuLff5WcH7sMZJ6/8x+pNV2V+gU+fOYsLrhjC3bdc873tG224AZ/NnkObjTakrKycRYu/osX6\nzQH4bPbnnHb+YK686Cw26dAuz2dX9yVpSdcV+Wpxbwz8BvjpKpa5eTpmvTBr1udMmzaDbt26ALDX\nXrvz/vv/o02bjb7d5+C+BzJhwqRihWh5smDhIpYtWwbAw/8cxfa9tmG9pk3ZuXcvnn7+P8yd/wWQ\nGX0y47NZier80e478+i/nwHgqefHsNP2PZHEgoWLOOXs33P6Scey3bZb5+eEUmatb3EDjwPrRcRb\nK26Q9HyejllvnHbGRdx7z82Uljbio48+of/xZ3LjDYPp2XMrIoKpU6dx8innFjtMq6Gzf381r785\nni++WMDeB/+KU/r/mrKyMgAOP+QnTJn6KRdcPgQBXTptymXnnQ7Zz7894TcMOP0CKqKCRg0bcsGZ\np9CuTaV/vH7r0IP257zB13LgL49j/ebNuPbSzFPWIx/+J59Om8Gwu+5n2F33AzD8xivYoGWL/Jx8\nCpRHelrcijoa7NraVWJV+3rGmGKHYHVQo9adtaZ1HLnpIYlzzv1TH1nj460JP4BjZka6+riduM3M\nqBt910k5cZuZ4TfgmJmljrtKzMxSJk2jSpy4zcxwV4mZWer45qSZWcq4j9vMLGXcVWJmljJ19Sny\nVXHiNjMDyt3iNjNLF3eVmJmljLtKzMxSxi1uM7OU8XBAM7OU8SPvZmYp464SM7OUceI2M0sZjyox\nM0sZt7jNzFLGo0rMzFKmPNIzsasTt5kZ7uM2M0sd93GbmaWM+7jNzFKmwl0lZmbp4ha3mVnKeFSJ\nmVnKuKvEzCxlaqurRFJ34MGcos7AxUAL4ATg82z5+RHx79U5hhO3mRm11+KOiElALwBJDYDpwCPA\nscANEXHdmh7DidvMjLzdnNwb+DAipkqqtUpLaq0mM7MUK4/yxEsNHAGMzFk/VdJ4SSMktVzdWJ24\nzczIPPKedJE0QNLYnGXAivVJKgV+Bvw1WzQU6EKmG2UmMGR1Y3VXiZkZNXvkPSKGA8Or2e1A4I2I\nmJX9zqzlGyTdDjy+GmECTtxmZkBeJpnqR043iaS2ETEzu3oI8O7qVuzEbWZG7Y7jltQU2Bc4Maf4\nGkm9gAA+XmFbjThxm5lRu6NKImIxsMEKZb+urfqduM3M8CPvZmap4xcpmJmljOcqMTNLGbe4zcxS\nxq8uMzNLGbe4zcxSxqNKzMxSxjcnzcxSxl0lZmYp45cFm5mljFvcZmYpk6Y+bqXpt8zaStKA7Py/\nZt/ydbH28htw0mGlt2uY4etireXEbWaWMk7cZmYp48SdDu7HtFXxdbGW8s1JM7OUcYvbzCxlnLjr\nOEkHSJok6QNJg4odjxWfpBGSZkta7beEW7o5cddhkhoAfwIOBLYC+knaqrhRWR1wN3BAsYOw4nHi\nrtt2BD6IiCkRsRR4AOhb5JisyCLiRWBeseOw4nHirtvaA5/mrE/LlpnZWsyJ28wsZZy467bpQMec\n9Q7ZMjNbizlx122vA10ldZJUChwBPFbkmMysyJy467CIKANOBZ4E3gceiogJxY3Kik3SSOBloLuk\naZL6FzsmKyw/OWlmljJucZuZpYwTt5lZyjhxm5mljBO3mVnKOHGbmaWME7fVKkktJJ2Sx/qPkXRL\nNftcIumsGta7aM0iMyscJ26rbS2AVSZuSQ0LHItZveTEbbXtaqCLpLckXSupj6Qxkh4D3pO0We48\n0pLOknRJ9nMXSaMkjct+Z4uqDiTpp5JelfSmpGckbZyzuaeklyVNlnRCznfOlvS6pPGSLq3dUzcr\nDLeArLYNAnpERC8ASX2A7bJlH0narIrvDgdOiojJknYCbgX2qmL//wA7R0RIOh44B/hddtu2wM5A\nU+BNSf8CegBdyUyXK+AxSXtmp0k1Sw0nbiuE1yLio6p2kLQesCvwV0nLi9eppt4OwIOS2gKlQO4x\nHo2Ir4GvJT1HJlnvDuwHvJndZz0yidyJ21LFidsKYXHO5zK+30W3bvZnCfDF8pZ6QjcD10fEY9mW\n/SU521acyyHItLKviojbanAMszrHfdxW2xYCzarYPgvYSNIGktYBDgKIiAXAR5J+AaCMntUca32+\nm+b26BW29ZW0rqQNgD5kZlp8Ejgu27pHUntJGyU/NbO6wS1uq1URMVfSS9kbkE8A/1ph+zJJlwGv\nkUm6E3M2HwUMlXQh0IjMq9reruJwl5DpWpkPPAt0ytk2HngOaA0MjogZwAxJWwIvZ7tjFgG/Amav\n5umaFYVnBzQzSxl3lZiZpYwTt5lZyjhxm5mljBO3mVnKOHGbmaWME7eZWco4cZuZpYwTt5lZyvw/\n+UO98DYGlNkAAAAASUVORK5CYII=\n",
            "text/plain": [
              "<Figure size 432x288 with 2 Axes>"
            ]
          },
          "metadata": {
            "tags": []
          }
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "ohN0RCm2ESt5",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 170
        },
        "outputId": "5c370466-ca44-4278-b8da-c6db94e1bbd7"
      },
      "source": [
        "print(classification_report(y_test, yfit_xgb))"
      ],
      "execution_count": 255,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "              precision    recall  f1-score   support\n",
            "\n",
            "        -1.0       0.65      0.51      0.57       237\n",
            "         1.0       0.62      0.75      0.68       256\n",
            "\n",
            "    accuracy                           0.63       493\n",
            "   macro avg       0.63      0.63      0.62       493\n",
            "weighted avg       0.63      0.63      0.63       493\n",
            "\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "RVl5IutuKk-u",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "xgb2 = XGBClassifier(ax_depth=5, learning_rate=0.01, n_estimators=100, gamma=0, \n",
        "                        min_child_weight=1, subsample=0.8, colsample_bytree=0.8, reg_alpha=0.005)\n",
        "xgb2 = xgb2.fit(X_train, y_train)\n",
        "yfit_xgb_2 = xgb2.predict(X_test)"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "YVk5nC0AKw_V",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 34
        },
        "outputId": "56f03b4b-57b2-4783-8c44-b58fc640f50d"
      },
      "source": [
        "xgb_score = accuracy_score(y_test,yfit_xgb_2)\n",
        "xgb_score"
      ],
      "execution_count": 257,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "0.6389452332657201"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 257
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "TRBMeyAyEpLk",
        "colab_type": "text"
      },
      "source": [
        "## KNN (K-Nearest Neighbors)"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "AEe7di9BEony",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "from sklearn.neighbors import KNeighborsClassifier\n",
        "\n",
        "knn = KNeighborsClassifier()\n",
        "knn = knn.fit(X_train, y_train)\n",
        "yfit_knn = knn.predict(X_test)"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "nPus8EjPE_mo",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 34
        },
        "outputId": "313ca13c-6c4a-49ae-d60b-d86f148a4952"
      },
      "source": [
        "knn_score = accuracy_score(yfit_knn, y_test)\n",
        "knn_score"
      ],
      "execution_count": 259,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "0.5963488843813387"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 259
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "vNaycgS7FDPB",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 283
        },
        "outputId": "5d2b3658-abd5-4999-ad43-9c8e034b55d6"
      },
      "source": [
        "mat = confusion_matrix(y_test, yfit_knn)\n",
        "sns.heatmap(mat , annot=True)\n",
        "plt.xlabel('true label')\n",
        "plt.ylabel('predicted label');"
      ],
      "execution_count": 260,
      "outputs": [
        {
          "output_type": "display_data",
          "data": {
            "image/png": "iVBORw0KGgoAAAANSUhEUgAAAW4AAAEKCAYAAAAyx7/DAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4zLCBo\ndHRwOi8vbWF0cGxvdGxpYi5vcmcvnQurowAAHUtJREFUeJzt3XecFdX9//HXmyZSFwEFsVBE7KJg\nyS/qF2s0sfcaTRQ0ahR7jL1FEwuxIya2FNTYNZYosUYTECHEKAYUlCZNqSKwu5/fH/eurrBlFvaW\nubyfPuaxd87MnvncxwM/HD5z5owiAjMzS48mhQ7AzMwaxonbzCxlnLjNzFLGidvMLGWcuM3MUsaJ\n28wsZZy4zcxSxonbzCxlnLjNzFKmWaEDqM0l3Y/1I522kuObzyt0CFaENp/wvFa3j+VzPkmcc5p3\n6rna11sdHnGbmaVM0Y64zczyqrKi0BEk5sRtZgZQUV7oCBJz4jYzAyIqCx1CYk7cZmYAlU7cZmbp\n4hG3mVnK+OakmVnKeMRtZpYu4VklZmYp45uTZmYp41KJmVnK+OakmVnKeMRtZpYyvjlpZpYyvjlp\nZpYuEa5xm5mli2vcZmYp41KJmVnKeMRtZpYyFcsLHUFiTtxmZuBSiZlZ6jRiqUTSfcD+wKyI2Crb\n9gjQJ3tKGTAvIvpK6g58CHyUPfbPiDitrv6duM3MoLFH3A8AdwAPVTVExFFVnyXdDMyvdv7HEdE3\naedO3GZm0KiJOyLeyI6kVyJJwJHAHqvaf5NV/UUzs1ISFcsTb5IGSXq32jaoAZfaFZgZEROqtfWQ\nNEbS65J2ra8Dj7jNzKBBNe6IGAYMW8UrHQMMr7Y/A9goIuZK6gc8JWnLiFhQWwdO3GZmkJdZJZKa\nAYcC/araImIpsDT7ebSkj4FNgXdr68eJ28wM8vUAzl7A+IiYWtUgqTPwRURUSOoJ9AY+qasT17jN\nzCAz4k661UPScOAdoI+kqZJOzh46mu+WSQB2A8ZJGgs8BpwWEV/U1b9H3GZm0Kgj7og4ppb2k2po\nexx4vCH9O3GbmQGU+0UKZmbp4kWmzMxSxmuVmJmljEfcZmYp4xG3mVnKeMRtZpYynlViZpYyEYWO\nIDEnbjMzcI3bzCx1nLjNzFLGNyfNzFKmoqLQESTmxG1mBi6VmJmljhO3mVnKuMZtZpYuUel53GZm\n6eJSiZlZynhWiZlZynjEvWY79DeD6LPHdiyeu4DbfnBRjef86Iof02f3vixfsozHzx/K9P9OXq1r\nrt2+NUffcRZlG3Rm3tTZDD/jNr5esJhtD/o+u512AAiWLv6aZy69j88//Gy1rmWrpuv1g2mz+46U\nz53HpB+dvtLxNnvuTOfBJ0BUEuWVzLzuHpaM/mC1rtmkfRu63XoxLbqty7Jps5h21vVULlhEuwMH\n0HHgESBRufgrPr/iTpaOn7Ra10q9FCVuv+U9B9577A0ePPHXtR7fdEBfOvXowi0DzuWpX/6OA6/7\naeK+e+y8OYfddOpK7bv97EA+fvt9hux+Lh+//T7/d/oBAHw5ZRb3HnUNt+/7C167/UkOvv6Uhn8h\naxTznniFKT+9rNbji98Zy6QDzmDSgT9nxsVD6Hrd2Yn7brXj1nT99TkrtXc69Ui+enssH+89kK/e\nHkvHU48AYPmUmXx63EVM2v905tz5MF2vPavhX6jURCTfCixniVvSZpIuknRbdrtI0ua5ul4xmTxy\nPF/NX1Tr8c336ceYJ94EYMqYibRs24q2ncsA2GXQ/vzs6Wv4+Qs3sOc5hyW+5uZ792PMY5k+xzz2\nJpvv3R+Az96bwNcLFmc/T6R9l3VW6TvZ6lsy6n0q5i+s9Xh89fU3n5us3RL4NkGsc8phdH/8t/R4\n9k46nXVc4mu22XNn5j/5CgDzn3yFtnt9LxPLmA+pXJD5M7pk7HiardexIV+lNFVWJt8KLCelEkkX\nAccADwMjs80bAMMlPRwRN+TiumnRbr0OzJ/+xTf7Cz7/gnZdOrDeZhvSqXsX7j7oMiRx/O/Oo/uO\nmzF55Ph6+2zTuT0LZ88DYOHsebTp3H6lc/ofNYD/vfbvxvsi1uja7v09Op93Es06ljFl4BUAtN5l\nO1psvD6TDxsMEhvccwVr77AVS0a9X29/zTqVUT77SwDKZ39Js05lK51TdsQ+LH5jdON+kTTydEBO\nBraMiOXVGyXdAvwXWKMTd2022XVrNtlta858/lcAtGjVko7duzB55HhOe+pqmrVoRotWLVm7rM03\n57x4w8NMfGPcyp2t8Gewx/e2oN9RAxh2+FW5/hq2Gha+/A4LX36HtXfYis6DT+Czky6h9fe3p/Uu\n29PjmdsBaNJqbVpsvD5LRr1P98eGoBbNaNJqbZq2b0vL7DmzfnM/i996b+ULrPDP/FY7bUPZEfvw\n6dEX5Py7FT3PKqESWB/4dIX2rtljNZI0CBgEsN86O7Bd201yFF5hLZj5Je3X/7Zk0a7LOiz4/Esk\n8fpdTzPqz39f6XeGHnw5kKlxb3/4bjx+/j3fOb5o9nzadi5j4ex5tO1cxqI58785tt5mG3LIDQN5\n8KRfs2Re7SUcKx5LRr1P84260LRDO5CYe8+jzHv4hZXOm3x4pq7dasetaX/YXsy4aMh3jpfPmUez\nzh0yo+3OHSif++2fi7X6dKfrr85mysmXUzGv9hLOmiKKoASSVK5q3IOBEZJekDQsu70IjABqveMS\nEcMion9E9C/VpA0w/uXRbHforgBsuN0mLF24hIWz5zHhjXH0O3IALVqtBWRKKq07tkvW5yvvsd3h\nmT63O3xXPnw580/f9ut35Lih5/DYOXcxd9LnOfg21liab9T1m88tt+iFmjen4ssFLH5rNGWH74Na\ntQSg2XodabrOyqWwmiz6+z9pf8heALQ/ZC8Wjfhnpo+undngzkuZfv5NLJs8rZG/SUpVRvKtwHIy\n4o6IFyVtCuwIdMs2TwNGRUR6/j2yio687Ux67rw5rTq05cJ3bmfEkMdp2rwpACP/NIKPXh3Lprv3\n5dzXh7B8yVKeuCAzep745n/ovEk3Tn0iU85Y9tVS/jL4ThbPXVDvNV+/+xmOufMs+h25O/OmzeHh\nM24FYI+zDqVVh7YceO1PAKgsr+SuAy/Nxde2eqw/5EJa77gNTTu0Y5M3H2L2rX9EzTP/C84b/jzt\n9v0+7Q/ekygvp/LrZUwbnKkoLn5rDC16bUT3R28BoPKrJUw//0Yqvphf67WqzL3nL3S79WLKjtiH\n5dNmMfXs6wHofOaxNC1rS5erMtMSo7ySyYcmn8VSklK0VomiCKa21OSS7scWZ2BWUMc3n1foEKwI\nbT7hea1uH4uvPi5xzml9+Z9W+3qrww/gmJkBlKenGODEbWYGqSqVOHGbmUFR3HRMyonbzIx0TQd0\n4jYzA4+4zcxSx4nbzCxlUvTIu5d1NTMj887JpFt9JN0naZak96u1XSlpmqSx2e2H1Y5dLGmipI8k\n/aC+/j3iNjODxi6VPADcATy0QvuQiLipeoOkLYCjgS3JrPH0iqRN63rK3CNuMzNo1PW4I+IN4It6\nT8w4CHg4IpZGxCRgIpnlQmrlxG1mBvlaZOpMSeOypZQO2bZuwJRq50zl2zWeauTEbWYGDUrckgZJ\nerfaNijBFe4GegF9gRnAzasaqmvcZmZAVCR/ACcihgHDGtR/xMyqz5LuBZ7L7k4DNqx26gbZtlp5\nxG1mBjkvlUjqWm33EKBqxskzwNGS1pLUA+jNt698rFGtI25Jdb5VNiKSFt7NzIpekml+SUkaDgwA\nOkmaClwBDJDUl8yLBScDpwJExH8lPQp8AJQDZ9T33oK6SiWjsxeoad3ZAHo26JuYmRWzRkzcEXFM\nDc2/r+P864DrkvZfa+KOiB5JOzEzS730rDFV/81JSQKOA3pExDWSNgK6RESdNRgzszSJ8vRk7iQ3\nJ+8Cvgccm91fCNyZs4jMzAqhsgFbgSWZDrhTRGwvaQxARHwpqUWO4zIzy6vGvDmZa0kS93JJTcnc\nkERSZ4ri7xwzs0aUoqyWJHHfBjwJrCfpOuBw4NKcRmVmlmclNeKOiD9JGg3smW06OCI+zG1YZmZ5\nVmIjboBWQFW5ZO3chWNmVhhRXugIkqt3Vomky4EHgXWATsD9klwqMbOSEpXJt0JLMuI+Dtg2Ir4G\nkHQDMBa4NpeBmZnlVREk5KSSJO7pQEvg6+z+WtSzcpWZWdoUw0g6qboWmbqdTE17PvBfSS9n9/em\nnpWrzMzSpiQSN/Bu9udoMtMBq7yWs2jMzAokKmpaT6841bXI1IP5DMTMrJBKZcQNgKTewPXAFmRq\n3QBEhJd1NbOSEZXpGXEnWWTqfjLvSisHdifzuvk/5jIoM7N8S9N0wCSJe+2IGAEoIj6NiCuBH+U2\nLDOz/IpQ4q3QkkwHXCqpCTBB0plkpgK2yW1YZmb5VQwj6aSSJO6zyTzyfhZwDbAHcGIugzIzy7fK\nUphVUiUiRmU/LgJ+kttwzMwKI003J+t6AOdZsmtw1yQiDsxJRGZmBVASiRu4KW9RmJkVWKRnOe46\nH8B5PZ+BmJkVUqmMuM3M1hjFMM0vKSduMzOgopRmlZiZrQlKYsTtWSVmtiYplRp31aySQ4EufLs+\nyTHAzFwGZWaWbyU1q0TSzRHRv9qhZyW9W8uvmZmlUqmMuKu0ltQzIj4BkNQDaJ3bsMzM8quiMsma\ne8UhSeI+B3hN0ieAgI2BU3MalZlZnpVEqaRKRLyYfZnCZtmm8RGxNLdhmZnlV2UpzCqpIqkVcC6w\ncUQMlNRbUp+IeC734ZmZ5UeapgMmfQPOMuB72f1pwLU5i8jMrAAikm+FlqTG3SsijpJ0DEBEfCUp\n5381/Xq6l0qxlV05/c1Ch2AlqqRKJcAySWuTfRhHUi/ANW4zKylpmlWSJNIrgReBDSX9CRgBXJTL\noMzM8i0asNVH0n2SZkl6v1rbjZLGSxon6UlJZdn27pKWSBqb3YbW13+9iTsi/kbm6cmTgOFA/4h4\nNUHsZmapURlKvCXwALDvCm0vA1tFxDbA/4CLqx37OCL6ZrfT6uu83sQtaUREzI2Iv0bEcxExR9KI\nJJGbmaVFY77lPSLeAL5Yoe1vEVGe3f0nsMGqxlpr4pbUUtI6QCdJHSStk926A91W9YJmZsWosgGb\npEGS3q22DWrg5X4KvFBtv4ekMZJel7Rrfb9c183JU4HBwPrAaDJPTQIsAO5oYJBmZkUtSD6rJCKG\nAcNW5TqSLgHKgT9lm2YAG0XEXEn9gKckbRkRC2rro65Fpm4FbpX084i4fVUCNDNLi/I8TAeUdBKw\nP7BnRGZGePZJ9KXZz6MlfQxsCtS6mF+SWSWVVXc/sxfuIOn01YjdzKzoBEq8rQpJ+wIXAgdGxFfV\n2jtLapr93BPoDXxSV19JEvfAiJj3zZeL+BIYuCqBm5kVq4bUuOsjaTjwDtBH0lRJJ5MpMbcFXl5h\n2t9uwDhJY4HHgNMi4osaO85K8gBOU0mqGtZn/2ZokeD3zMxSY1VH0jX2FXFMDc2/r+Xcx4HHG9J/\nksT9IvCIpHuy+6dm28zMSkaSkXSxSJK4LyKTrH+W3X8Z+F3OIjIzK4CKRhxx51qS9bgrgbuzm5lZ\nSUrRm8vqfMv7oxFxpKT/UMPj+dnHNs3MSkJliYy4z87+3D8fgZiZFVIRLLOdWF0P4MzI/vw0f+GY\nmRVGSdyclLSQOv4Sioh2OYnIzKwAKnP/fphGU9eIuy2ApGvIPEv/BzLrlRwHdM1LdGZmeVJR6AAa\nIMl0wAMjYttq+3dL+jdweY5iMjPLuzTNKknyyPtiScdJaiqpiaTjgMW5DszMLJ8qUeKt0JIk7mOB\nI4GZ2e2IbJuZWclozFeX5VqSB3AmAwflPhQzs8IpqVKJpE0ljah66aWkbSRdmvvQzMzypzFXB8y1\nJKWSe8m81HI5QESMA47OZVBmZvlWoeRboSWZVdIqIkbqu3Mcy2s72cwsjYphJJ1UksQ9R1IvsjV5\nSYeTmddtZlYySi1xn0HmpZibSZoGTCLzEI6ZWcnIwysnG02diVtSE6B/ROwlqTXQJCIW5ic0M7P8\nSdOIu86bk9m1uC/Mfl7spG1mpaqiAVuhJSmVvCLpfOARqj0xWd/LLM3M0iRN87iTJO6jsj/PqNYW\nQM/GD8fMrDDSVCpJ8uRkj3wEYmZWSCWVuCW1BE4HdiEz0n4TGBoRX+c4NjOzvCmGNUiSSlIqeQhY\nCNye3T+WzNrcR+QqKDOzfCu1GvdWEbFFtf1XJX2Qq4DMzAqhGGaLJJVkrZL3JO1ctSNpJ+Dd3IVk\nZpZ/lUTirdCSjLj7AW9L+iy7vxHwkaT/ABER2+QsOjOzPCmpm5PAvjmPwsyswAo/jk4uyXTAT/MR\niJlZIZXaiNvMrOSVKz1jbiduMzNKrFRiZrYmcKnEzCxlimGaX1JO3GZmuFRiZpY6aSqVJHly0sys\n5FUQibf6SLpP0ixJ71drW0fSy5ImZH92yLZL0m2SJkoaJ2n7+vp34jYzIzPiTrol8AArP7z4C2BE\nRPQGRmT3AfYDeme3QcDd9XXuxG1mBkQD/qu3r4g3gBXfEnYQ8GD284PAwdXaH4qMfwJlkrrW1b8T\nt5kZjT7irsl6ETEj+/lzYL3s527AlGrnTc221co3J4tQ+/btGHbPTWy5ZR8igoEDz+Oss05h0017\nAVDWvh3z5i+g/w77FDhSa4hLf3ULb/xjJOt0KOOpPw5d6fj8BQu57PohTJk2g7VatOCaX55D757d\nV+uay5Yt4+JrbuaDjyZQ1r4dN119Md26rsfbI9/jt0PvZ/nycpo3b8Z5Z5zMTv36rta10q4h0wEl\nDSJT1qgyLCKGJf39iAhp1R/V9Ii7CA255WpeeulVttr6/9i+3958OH4Cxx73M/rvsA/9d9iHJ598\nnqeeer7QYVoDHfzDvRl6y7W1Hr/3oUfYrHcvnnzobn512fnc8NuVk3ttps2YyUlnXrhS+xPP/Y12\nbdvwwqP3ccJRB3PLXfcB0KGsHXf8+kqe/MPdXHfpeVx89U0N/0IlJhqyRQyLiP7VtiRJe2ZVCST7\nc1a2fRqwYbXzNsi21cqJu8i0a9eWXXfZifvuHw7A8uXLmT9/wXfOOfzwA3j4kacLEZ6thv59t6Z9\nu7a1Hv948mfstP22APTceEOmzZjJnC++BODZl/7O0aeczWEnnsFVv7mNiopky/7//c13OOiHewGw\nz4Bd+dfosUQEm2+6Cet27gjAJj025uulS1m2bNnqfL3UKycSb6voGeDE7OcTgaertf84O7tkZ2B+\ntZJKjfKeuCX9JN/XTJMePTZizpy5/P53Qxg18iXuGXojrVqt/c3xXXfZiZmzZjNx4qQCRmm50GeT\nnrzy+j8A+M8HHzFj5ixmzprDx5M/48URr/OHoTfz+IN30qRJE57726uJ+pw1ey5d1u0EQLNmTWnT\nuhXzVhgIvPzaW2zRZxNatGjRuF8oZRrz5qSk4cA7QB9JUyWdDNwA7C1pArBXdh/geeATYCJwL5l3\n/NapEDXuq4D7azpQvW6kpu1p0qR1PuMqCs2aNmW77bbm7MGXMXLUGG65+SouuvBMrrjyRgCOOupg\nHvFouySdcsIR3PDbezjsxDPo3as7m/XuRdMmTfjXu2P5YPxEjj75bACWLl3KOh3KADjr4quZNn0m\ny8uXM2PmbA478QwAjj/yIA75Uf33QCZ+8im33HUfw4Zcl7svlhKN+QBORBxTy6E9azg3gDMa0n9O\nErekcbUd4ts7qSvJ1omGATRr0S1NT6A2mqnTZjB16gxGjhoDwBNP/JULLzgTgKZNm3LIwfux4877\nFTJEy5E2rVtz7SXnAhAR/ODwk9igWxdG//t9DtxvL8752cr/WL3t+suBTI37kutu5oE7fvOd4+t2\n7sjns+bQZd3OlJdXsGjxV5S1bwfA57Nmc/Yvr+FXl53PRhusn+NvV/ySjKSLRa5KJesBPwYOqGGb\nm6NrloSZM2czder0b2aQ7LHHLnz44f8A2GvPXfnoo4lMm1Zn+ctSasHCRSxfvhyAx599kX59t6ZN\n69bs3L8vL7/2FnO/nAdkZp9M/3xmoj5332Vnnn7+FQD+9tqb7NRvWySxYOEiTr/gCgaf9hO232bL\n3HyhlMnDdMBGk6tSyXNAm4gYu+IBSa/l6Jol4+xzLuOhB2+nRYvmTJr0GSefkhmFHXnkQb4pmWIX\nXHEDo8aMY968Bex58PGcfvIJlJeXA3DUIT/ik0+ncMm1NyOgV4+NufriwZD9/POBP2bQ4EuojEqa\nN2vGJeeezvpdav3H6zcO3f8HXHzNjex35E9p364tN16VeVhv+OPPMmXqdIbe/2eG3v9nAIb99jo6\nZkswa6KKSM+IW1Gkwa6ppRKr25LpbxY6BCtCzTv11Or2cezGhyTOOX/+9MnVvt7q8AM4Zmakq8bt\nxG1mRnHUrpNy4jYzw2/AMTNLHZdKzMxSJk2zSpy4zcxwqcTMLHV8c9LMLGVc4zYzSxmXSszMUqZY\nnyKviRO3mRlQ4RG3mVm6uFRiZpYyLpWYmaWMR9xmZinj6YBmZinjR97NzFLGpRIzs5Rx4jYzSxnP\nKjEzSxmPuM3MUsazSszMUqYi0rOwqxO3mRmucZuZpY5r3GZmKeMat5lZylS6VGJmli4ecZuZpYxn\nlZiZpYxLJWZmKeNSiZlZynjEbWaWMh5xm5mlTEVUNEo/kvoAj1Rr6glcDpQBA4HZ2fZfRsTzq3IN\nJ24zMxrvkfeI+AjoCyCpKTANeBL4CTAkIm5a3Ws4cZuZkbNH3vcEPo6ITyU1WqdNGq0nM7MUi4jE\nWwMcDQyvtn+mpHGS7pPUYVVjdeI2MyMzqyTpJmmQpHerbYNW7E9SC+BA4C/ZpruBXmTKKDOAm1c1\nVpdKzMxo2KySiBgGDKvntP2A9yJiZvZ3ZlYdkHQv8NwqhAk4cZuZATl55P0YqpVJJHWNiBnZ3UOA\n91e1YyduMzMa90UKkloDewOnVmv+jaS+QACTVzjWIE7cZmY07pOTEbEY6LhC2wmN1b8Tt5kZfnWZ\nmVnq+NVlZmYp4xG3mVnK+EUKZmYp42VdzcxSxqUSM7OU8XrcZmYp4xG3mVnKpKnGrTT9LbOmkjQo\nu6iN2Tf852LN5WVd02GlJSPN8J+LNZYTt5lZyjhxm5mljBN3OriOaTXxn4s1lG9OmpmljEfcZmYp\n48Rd5CTtK+kjSRMl/aLQ8VjhZd8QPkvSKr/6ytLNibuISWoK3EnmpaNbAMdI2qKwUVkReADYt9BB\nWOE4cRe3HYGJEfFJRCwDHgYOKnBMVmAR8QbwRaHjsMJx4i5u3YAp1fanZtvMbA3mxG1mljJO3MVt\nGrBhtf0Nsm1mtgZz4i5uo4DeknpIagEcDTxT4JjMrMCcuItYRJQDZwIvAR8Cj0bEfwsblRWapOHA\nO0AfSVMlnVzomCy//OSkmVnKeMRtZpYyTtxmZinjxG1mljJO3GZmKePEbWaWMk7c1qgklUk6PYf9\nnyTpjnrOuVLS+Q3sd9HqRWaWP07c1tjKgBoTt6RmeY7FrCQ5cVtjuwHoJWmspBslDZD0pqRngA8k\nda++jrSk8yVdmf3cS9KLkkZnf2ezui4k6QBJ/5I0RtIrktardnhbSe9ImiBpYLXfuUDSKEnjJF3V\nuF/dLD88ArLG9gtgq4joCyBpALB9tm2SpO51/O4w4LSImCBpJ+AuYI86zn8L2DkiQtIpwIXAedlj\n2wA7A62BMZL+CmwF9CazXK6AZyTtll0m1Sw1nLgtH0ZGxKS6TpDUBvh/wF8kVTWvVU+/GwCPSOoK\ntACqX+PpiFgCLJH0KplkvQuwDzAme04bMoncidtSxYnb8mFxtc/lfLdE1zL7swkwr2qkntDtwC0R\n8Ux2ZH9ltWMrruUQZEbZ10fEPQ24hlnRcY3bGttCoG0dx2cC60rqKGktYH+AiFgATJJ0BIAytq3n\nWu35dpnbE1c4dpCklpI6AgPIrLT4EvDT7OgeSd0krZv8q5kVB4+4rVFFxFxJ/8jegHwB+OsKx5dL\nuhoYSSbpjq92+DjgbkmXAs3JvKrt33Vc7koypZUvgb8DPaodGwe8CnQCromI6cB0SZsD72TLMYuA\n44FZq/h1zQrCqwOamaWMSyVmZinjxG1mljJO3GZmKePEbWaWMk7cZmYp48RtZpYyTtxmZinjxG1m\nljL/H57smJ/ONH86AAAAAElFTkSuQmCC\n",
            "text/plain": [
              "<Figure size 432x288 with 2 Axes>"
            ]
          },
          "metadata": {
            "tags": []
          }
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "qOxbK6q-FB7f",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 170
        },
        "outputId": "3437376d-7198-4d74-8b29-52a9612904e2"
      },
      "source": [
        "print(classification_report(y_test, yfit_knn))"
      ],
      "execution_count": 261,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "              precision    recall  f1-score   support\n",
            "\n",
            "        -1.0       0.61      0.44      0.51       237\n",
            "         1.0       0.59      0.74      0.66       256\n",
            "\n",
            "    accuracy                           0.60       493\n",
            "   macro avg       0.60      0.59      0.58       493\n",
            "weighted avg       0.60      0.60      0.59       493\n",
            "\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "tu7FT_4uFJXK",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        ""
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "oQ_idGXdLgUM",
        "colab_type": "text"
      },
      "source": [
        "## MLP (Multilayer Perceptron)"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "hg-zacmNLhUH",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "from sklearn.neural_network import MLPClassifier\n",
        "mlp = MLPClassifier(solver='lbfgs')\n",
        "mlp = mlp.fit(X_train, y_train)\n",
        "yfit_mlp = mlp.predict(X_test)"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "4VfdhA4qL7P_",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 34
        },
        "outputId": "7ab12f55-4010-41d8-fe6b-0f8711f4f104"
      },
      "source": [
        "mlp_score = accuracy_score(yfit_mlp, y_test)\n",
        "mlp_score"
      ],
      "execution_count": 263,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "0.5537525354969574"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 263
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "lOtfap7jMATp",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 283
        },
        "outputId": "6b52e3f7-a42f-4e43-9fad-4f8c6f0b4fa4"
      },
      "source": [
        "mat = confusion_matrix(y_test, yfit_mlp)\n",
        "sns.heatmap(mat , annot=True)\n",
        "plt.xlabel('true label')\n",
        "plt.ylabel('predicted label');"
      ],
      "execution_count": 264,
      "outputs": [
        {
          "output_type": "display_data",
          "data": {
            "image/png": "iVBORw0KGgoAAAANSUhEUgAAAW4AAAEKCAYAAAAyx7/DAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4zLCBo\ndHRwOi8vbWF0cGxvdGxpYi5vcmcvnQurowAAHqRJREFUeJzt3XecFdX5x/HPd2EXBQQEVAREsMea\nGGIvxBYVI4IloiZYsYvGWDHGbuwGOzbUGCwx+cWGQmyADVEUsRuMCqj0Ihpgd5/fH/eiK7C7s7K3\nzOX75jWv3Xtm7pnn6vLs4ZkzZxQRmJlZepQVOgAzM2sYJ24zs5Rx4jYzSxknbjOzlHHiNjNLGSdu\nM7OUceI2M0sZJ24zs5Rx4jYzS5mmhQ6gNn/teJhv6bSlDOLzQodgRWjMlBe0vH0smj4xcc4pb7/O\ncp9veXjEbWaWMkU74jYzy6vqqkJHkJgTt5kZQFVloSNIzInbzAyIqC50CIk5cZuZAVQ7cZuZpYtH\n3GZmKeOLk2ZmKeMRt5lZuoRnlZiZpYwvTpqZpYxLJWZmKeOLk2ZmKeMRt5lZyvjipJlZyvjipJlZ\nukS4xm1mli6ucZuZpYxLJWZmKeMRt5lZylQtKnQEiTlxm5mBSyVmZqmTolKJn/JuZgaZEXfSrR6S\n7pI0VdKEZew7XVJIar9E+y8kVUo6oL7+nbjNzKBREzcwBNhzyUZJawF7AJ8t0d4EuAIYnqRzJ24z\nMyCqFiXe6u0rYiQwcxm7rgPOBGKJ9pOBR4CpSWJ14jYzg0yNO+Emqb+ksTW2/vV1L6kXMDki3lqi\nvRPQG7glaai+OGlmBg2aVRIRg4HBSY+X1Bw4l0yZZEnXA2dFRLWkRP05cZuZQa5nlawLdAPeyibn\nzsAbkrYCugMPZNvbA3tLqoyI/6utMyduMzPI6TzuiHgbWH3xa0n/BbpHxHQyCX1x+xDg8bqSNrjG\nbWaW0YAad30kDQVeBjaUNEnSUY0ZqkfcZmYAlY33IIWI6FvP/q61tB+epH8nbjMzSNWdk07cZmbg\ntUrMzFLHI24zs5TxiNvMLGU84jYzS5lGnFWSa07cZmYAseS6T8XLidvMDFzjNjNLHSduM7OU8cVJ\nM7OUqaoqdASJOXGbmYFLJWZmqePEbWaWMq5xm5mlS1R7HreZWbq4VGJmljKeVWJmljIeca/Ytrn2\nGDrv9lP+N30uj+9yzlL7u/bejk1O3AckKud/y6tnD2H2u58t1znLKpqy3aDjaLdZNxbMmseo425k\n/qTpdNhpU3527m8oK29K9aJK3rh4KF+9+O5ynct+nPOuPYsddtuWWdNn0XeXI5bav/Z6XTj/2rPZ\ncLP1ueWKO7j/1geX+5zlFeVcMOhcNtpsA+bMmsvA4y7ki0lfstVO3Tnx3P6Ul5ezaNEibrj4Fsa+\nOG65z5dqKUrcflhwDkx8cCTPHnpVrfu//nwaI/a/hCd2PYe3r/s/trnyyMR9t+jcnt3/PnCp9vX6\n9mDh7Pn8a/vTee/2p/jZeQcDsGDmPJ7vdw1P7HoOLw24je0HHdfwD2SN4okHhzHg0DNq3T931lyu\n/uOgH5Ww1+zcgVv+fv1S7fv27cm82fPYf/tDGXr7w5x03rEAzJ45h9P7ncMhux7BhQMu54JBS/9M\nrXAikm8FlrMRt6SNgF5Ap2zTZODRiHgvV+csFlNf/YAWndvXun/62I++//6Nj2m+ZtvvXnfrsz0b\nHrUHZRVNmfHGfxhzzt2JrnZ3/tWWjL/mHwB89vgYfnFpPwBmTfj0u2PmfDCJJitVUFbRlOqF6VnC\nslSMe3U8a3buUOv+WTNmM2vGbHbYbZul9u3ZZ3d+c9T+lFc0ZcIb73HlOddRnWCEuPOvtuf2a4YA\n8OzjL3DGpQMA+HDC9z+DEz/4hGYrNaO8opxFCxc18FOVkBV9xC3pLOABQMCY7CZgqKSzc3HOtFq3\nbw+mPDcegFbrdWTtXlvzdK+LeHL3gVRXVdO1z/aJ+mneYVW+mTITgKiqZtHcb2jWtuUPjunS8xfM\nnPBfJ+2U6bre2uzeaxeO7nUih+1+NNVV1ezZZ/dE712tQ3u+mjIVgKqqKr6eO5/WbVv/4Jhdeu7M\nBxM+XLGTNkB1JN8KLFcj7qOATSLiBz8Jkq4F3gH+nKPzpsoa2/2E9fruzNP7XQxAhx03oe1m3dhr\n2EUANF2pggUz5gKw052n0rLLapSVN6VFp3bsPeJSAN6/42kmPjiy3nO13qATPxt4MM/0vSJHn8Zy\n5Rc7bslGm23APcNuA6DZSs2YNWMWAFfeeQkdu3SgaXk5HTqtzl9H3AHAA3c8wuMPDqu373U26MpJ\nA4/l5L5/yN0HSAvPKqEa6Ah8ukT7mtl9yySpP9Af4IjWW7FL8/VzFF7htfnJWmxz9dE8e9hVLJz1\nNQASTHx4FG9e/tBSx488KlO/bNG5PdtdfywjDrj0B/u/+XIWzTu25ZsvZqImZZS3as6CmZl+m6/Z\nlp3vPJWXBtzK159OzfEns8YmiScefoqbL799qX1nHnUekKlxn3/92Rx/wKk/2D/ty+ms0XF1pn4x\njSZNmtCyVQvmzJwDwOprrsaVd17CBQMuY/KnU3L/QYpcrOilEuBU4BlJwyQNzm5PAc8AA2p7U0QM\njojuEdG9lJN2807t2PmOU3nxlFuZN/HL79q/HPUOXXpuRbN2rQCoaNOCFp3aJepz0vA3WOfAHQHo\nss9WfDU6M3OkvFVzfnnv6Yy77EGmvfZRXV1YkXpt1Ovs0rMHq7ZrA0CrNqvQodMaid47cviL9Dzw\nVwDsss/OjB2dmTnSslVLrrv3z9x42W2Mf21CbgJPmxW9VBIRT0naANiKH16cfC0i0vPvkR9ph5tP\nZI1tf0Kzti3pPXYQ4695hLKmTQD46L5n2fy03lSs2pKtLj8cgKisYthe5zPnoym8deXD7PrAWUii\nurKK184dwvzJM+o958dDX2D7QcfR68VrWDD7a0YffyMAGx6xO6t0W4PNft+bzX7fG4BnDr7iuxKM\n5c/FN5/Pz7f9KW3atuaxsQ9z+zV307Rp5q/gP+57lHartWXIsNtosUoLorqag48+gIN79OOTjz7l\n1ivv4IYHrkYqo7KykqvOvZ4vJ39V7zkfHfokFw4ayCMv3s/c2fMYePyFABx0RG86d+vE0b/vx9G/\nz1zIPvngPzBrxuzc/Qcodilaq0RRBFNbluWvHQ8rzsCsoAbxeaFDsCI0ZsoLWt4+5l90aOKc0+L8\n+5f7fMvDN+CYmQFUpqcY4MRtZgapKpU4cZuZQVFcdEzKidvMjHRNB3TiNjODVI24vciUmRk06jxu\nSXdJmippQo22iyWNl/SmpOGSOtbY1yPb/o6kF+rr34nbzAwyt7wn3eo3BNhzibarImLziPgp8Dhw\nPoCkNsDNwL4RsQlwYH2du1RiZkbjPnMyIkZK6rpEW8273loAi094CPCPiPgse1y961I4cZuZQV5q\n3JIuBX4HzAF+mW3eACiX9DywCvCXiLi3rn5cKjEzg8x63Ak3Sf0lja2x9U9yiogYGBFrAfcDJ2Wb\nmwI/B3oCvwL+mF0ypFYecZuZQYNG3BExGBi8HGe7H3gS+BMwCZgREfOB+ZJGAlsAH9b2Zo+4zcwg\n56sDSqq55Gkv4P3s9/8CdpDUVFJzYGugzieFecRtZkbmyVGNRdJQoAfQXtIkMiPrvSVtSOaZBJ8C\nxwFExHvZZa/HZ/fdERF1rrXrxG1mBo16cTIi+i6j+c46jr8KqP0J40uoNXFLalvbvuyJZiY9iZlZ\nsWvM6YC5VteI+3Uy8wyXte5sAOvkJCIzs0IohcQdEd3yGYiZWUGlZ42p+mvckgQcCnSLiIsldQE6\nRMSYnEdnZpYnUZmezJ1kOuDNwLZkbssEmAfclLOIzMwKoboBW4ElmVWydURsKWkcQETMklSR47jM\nzPKqVC5OLrZIUhOyC6JIWo2i+J1jZtaIUpTVkiTuQcA/gTWyC6QcAJyX06jMzPKspEbcEXG/pNeB\nXbNN+0VEnbdjmpmlTomNuAGaA4vLJSvnLhwzs8KIykJHkFy9s0oknQ/cA7QF2gN3S3KpxMxKSlQn\n3wotyYj7UGCLiPgfgKQ/A28Cl+QyMDOzvCqChJxUksQ9BVgJ+F/2dTNgcs4iMjMrgGIYSSdV1yJT\nN5Cpac8B3pE0Ivt6d8B3TZpZSSmJxA2MzX59ncx0wMWez1k0ZmYFElXLWk+vONW1yNQ9+QzEzKyQ\nSmXEDXz3uJ3LgY3J1LoBiAgv62pmJSOq0zPiTrLI1N3ALUAlmcfJ3wv8NZdBmZnlW5qmAyZJ3CtH\nxDOAIuLTiLiAzGPkzcxKRoQSb4WWZDrgAkllwEeSTiIzFbBlbsMyM8uvYhhJJ5UkcQ8gc8v7KcDF\nwC5Av1wGZWaWb9WlMKtksYh4Lfvt18ARuQ3HzKww0nRxsq4bcB4juwb3skTEvjmJyMysAEoicQNX\n5y0KM7MCi/Qsx13nDTgv5DMQM7NCKpURt5nZCqMYpvkl5cRtZgZUldKsEjOzFUFJjLg9q8TMViSl\nUuNePKukD9CB79cn6Qt8lcugzMzyraRmlUi6JiK619j1mKSxtbzNzCyVSmXEvVgLSetExEQASd2A\nFrkNy8wsv6qqk6y5VxySRHoa8Lyk5yW9ADwHnJrbsMzM8isi+VYfSXdJmippQo22qyS9L2m8pH9K\napNtL5d0j6S3Jb0n6Zz6+q83cUfEU8D6ZBabOgXYMCKerj90M7P0qA4l3hIYAuy5RNsIYNOI2Bz4\nEFicoA8EmkXEZsDPgWMlda2r83oTt6TmwBnASRHxFtBF0j5JIjczS4vGXI87IkYCM5doGx4RldmX\nrwCdF+8iU5JuCqwMLATm1tV/0ifgLAS2zb6eDFyS4H1mZqnRmKWSBI4EhmW//zswH/gC+Ay4OiJm\n1vZGSHZxct2I+I2kvgAR8Y2knF9+PXz6c7k+haXQt1NGFToEK1EJSyAASOoP9K/RNDgiBid870Ay\nj4K8P9u0FVAFdARWBUZJ+vfiCSHLkiRxL5S0MtmbcSStCyxIEqCZWVo0ZFZJNkknStQ1SToc2AfY\nNeK7sfshwFMRsQiYKulFoDtQa+JOEukFwFPAWpLuB54BzmpowGZmxSwasP0YkvYEzgT2jYhvauz6\njMyTxZDUAtgGeL+uvpI8AWe4pNeznQkYEBHTf2TsZmZFqSGlkvpIGgr0ANpLmgT8icwskmbAiGy1\n+ZWIOA64Cbhb0jtkcuzdETG+rv7rTdySnomIXYEnltFmZlYSGnORqYjou4zmO2s59msyUwITq2uR\nqZXIPCS4vaRVyfwmAGgFdGrISczMil2KHvJe54j7WDJ3SHYEXuf7xD0XuDHHcZmZ5VVQAmuVRMRf\ngL9IOjkibshjTGZmeVeZovW4k8wqqV58Tz2ApFUlnZDDmMzM8i5Q4q3QkiTuYyJi9uIXETELOCZ3\nIZmZ5V91A7ZCS3IDThNJWjxZXFIToCK3YZmZ5VcxjKSTSpK4nwIelHRb9vWx2TYzs5JRDCPppJIk\n7rPIJOvjs69HAHfkLCIzswKoKqURd0RUA7dkNzOzkpSiJ5fVeQPOQxFxkKS3Wcbt+dnFwM3MSkJ1\niYy4B2S/+qEJZlbyUvSQ9zpvwPki+/XT/IVjZlYYJXFxUtI86vglFBGtchKRmVkBVOf++TCNpq4R\n9yoAki4m80id+8isV3IosGZeojMzy5OqQgfQAEmmA+4bEVvUeH2LpLeA83MUk5lZ3qVpVkmSW97n\nSzpUUhNJZZIOJfNgSzOzklGNEm+FliRxHwIcBHyV3Q7MtpmZlYxcP7qsMSW5Aee/QK/ch2JmVjgl\nVSqRtIGkZyRNyL7eXNJ5uQ/NzCx/0rQ6YJJSye1kHnK5CCD7EMuDcxmUmVm+VSn5VmhJZpU0j4gx\n+uEcx8ocxWNmVhDFMJJOKknini5pXbI1eUkHkJnXbWZWMkotcZ8IDAY2kjQZ+ITMTThmZiUjRY+c\nrDtxSyoDukfEbpJaAGURMS8/oZmZ5U+aRtx1XpzMrsV9Zvb7+U7aZlaqqhqwFVqSUsm/Jf0BeJAa\nd0xGxMycRWVmlmdpmsedJHH/Jvv1xBptAazT+OGYmRVGmkolSe6c7JaPQMzMCqmkEreklYATgB3I\njLRHAbdGxP9yHJuZWd4UwxokSSUpldwLzANuyL4+hMza3AfmKigzs3wrtRr3phGxcY3Xz0l6N1cB\nmZkVQjHMFkkqyVolb0jaZvELSVsDY3MXkplZ/lUTibdCSzLi/jnwkqTPsq+7AB9IehuIiNg8Z9GZ\nmeVJSV2cBPbMeRRmZgXWmONoSXcB+wBTI2LTbNtVwK+BhcB/gCMiYnZ23znAUWQqNqdExNN19V9v\nqSQiPq1rW65PZ2ZWJBp5Pe4hLD3oHUHmmuHmwIdklstG0sZklsreJPuemyU1qavzJDVuM7OSV6lI\nvNUnIkYCM5doGx4Ri5fEfgXonP2+F/BARCyIiE+Aj4Gt6urfidvMjIY9c1JSf0lja2z9G3i6I4Fh\n2e87AZ/X2Dcp21arJDVuM7OS15CLkxExmMxy1w0maSCZh9Hc/2PeD07cZmYAeZnmJ+lwMhctd42I\nxSecDKxV47DO2bZauVRiZkbDSiU/hqQ9ySyTvW9EfFNj16PAwZKaSeoGrA+Mqasvj7jNzGjcedyS\nhgI9gPaSJgF/IjOLpBkwIvsM31ci4riIeEfSQ8C7ZEooJ0ZEnTdyOnGbmQFVjVgqiYi+y2i+s47j\nLwUuTdq/E7eZGaV356SZWcmLIliDJCknbjMz0jXi9qySHLh98DVMmfQWb457Zpn7N9xwXUaPfJT5\n8yby+9OObZRzVlRU8Lf7b+H9d0fz0ujHWHvtzE1Zu+26I6++Moxxb/ybV18Zxi97bN8o57OGO++y\na9mp58Hsd9hxy9w/5o3xbLPH/uzf70T273cit9z1o6f5fmfhwoWc/sfL2eugI+l7zKlM/uIrAF4a\n8wYHHXkyvX97PAcdeTKvvv7mcp8r7dK0OqATdw7ce+9D9Nzn0Fr3z5w5m1NP+yPXXndbg/tee+3O\nPDPi4aXajzyiL7NmzWGjjXfg+kG3c/llAwGYPmMm+/U+nJ9tuRtHHnUqQ+7+S4PPaY1jv71359Zr\nL6nzmC232JRH7rmJR+65ieOPrP1naEmTv/iKw086c6n2fzw+nFartGTYQ3fx29/sx7U33wXAqm1a\nceMVF/DP+27h0vNO55yLrm7YhylBuZ4O2JicuHNg1OhXmTlrdq37p02bwdjX32LRokVL7TvkkD68\n/OLjjH1tODffdAVlZcn+F+376z24775MQn/kkSfY5Zc7APDmm+/wRXaU9c47H7DyyitRUVHR0I9k\njaD7TzejdatVftR7H3v6WQ4+egD79zuRC68cRFVVsmX/nx31Mr323g2APXrsyKuvv0lE8JMN1mP1\n1doBsF63tfnfggUsXLjwR8VWKiqJxFuh5T1xSzoi3+dMi402Wo+DDtyXHXfej+6/2IOqqioOOaRP\novd27NSBzydNAaCqqoo5c+bSrt2qPzimT5+ejBs3YYX/C1rM3prwHn36ncBxp/+RjydmFt/8z38/\n46lnXuC+W6/hkXtuoqysjMeHP5eov6nTZtBh9fYANG3ahJYtmjN7ztwfHDPi+dFsvOF6K/wv9GjA\nn0IrxMXJC4G7l7Uju1BLfwA1aU1ZWYt8xlVwu/xyB7b82Wa88vKTAKy88kpMmzYdgL8/fAddu3ah\noqKcLmt1YuxrwwG44YY7uOfeh+rte+ONN+DyS89lr56H5O4D2HLZeMN1GfHIPTRvvjIjXxrDKedc\nxJMP3smrY9/k3fc/5uCjBgCwYMEC2q7aBoBTzrmIyVO+YlHlIr74ahr79zsRgMMO6kXvnnvUe86P\nJ37KtTffxeDrEk8hLllpujiZk8QtaXxtu4A1antfzYVbmlZ0KvyvtTyTxH1/fZiB5/15qX0HHHg0\nkKlx33XHdey6+w+f1Txl8pes1bkjkyd/QZMmTWjduhUzZswCoFOnNfn7w3dyxJEDmDjRS6gXq5Yt\nvh+o7LTdVlxyzU3Mmj2HiGDfvXbjtOOX/sfqoMvPBzI17oGXXsOQG6/8wf7VV2vHl1On02H11ais\nrOLr+d/QpnUrAL6cOo0B517MZX/8A106d8zhJ0uHYhhJJ5WrUskawO/IPO1hyW1Gjs6Zes8+N5o+\nvfdhtWztcdVV29ClS52rO37nsceH89vfZpL5/vv35LnnXwSgdetWPPqvezl34GW89LIfFVrMps+Y\nyeJ1h95+9wOqI2jTuhXbdP8pI54fzYzsdZM5c+cx5cuvEvX5yx224V9P/huA4c+PYuufb4Ek5s77\nmhPO+BOnHncEW26+SW4+UMo08oMUcipXpZLHgZYRsdQcI0nP5+icReOv993EzjttS/v2bfnvxLFc\neNHVlJeXAzD49vtYY43VePXlYbRq1ZLq6mpOOfkYNtuiB++99xHnX3Alw54cSlmZWLSoklNOGchn\nn9W5UBgAd939APcMGcT7745m1qzZHHLYCQCceMIRrLduV84beBrnDTwNgL327su0af79mW9n/OnP\nvDZuPLNnz2XX/Q7jhKN+S2VlZl393/TuyfDnRvPgP5+gSdMmrFRRwVUXno0k1u22Nicf8zv6nzqQ\n6qimvGlTBv7+BDp2qPUfr9/ps8+vOOfiq9jroCNp3WoVrrrwbACGPvIYn0+awq13/41b7/4bAIOv\nv5R22RLMiqgq0jPiVhRpsCtiqcTq9+2UUYUOwYpQeft1tLx9HLJ278Q552+f/nO5z7c8fOekmRnp\nqnE7cZuZURy166ScuM3MyM8TcBqLE7eZGS6VmJmlTppmlThxm5nhUomZWer44qSZWcq4xm1mljIu\nlZiZpUyx3kW+LE7cZmZAlUfcZmbp4lKJmVnKuFRiZpYyHnGbmaWMpwOamaWMb3k3M0sZl0rMzFLG\nidvMLGU8q8TMLGXSNOIuK3QAZmbFIBrwpz6S7pI0VdKEGm0HSnpHUrWk7jXad5f0uqS3s193qa9/\nJ24zM6AqqhNvCQwB9lyibQLQBxi5RPt04NcRsRnQD7ivvs5dKjEzo3Fr3BExUlLXJdreA5C05LHj\narx8B1hZUrOIWFBb/07cZmYUTY17f+CNupI2OHGbmQENu3NSUn+gf42mwRExeHnOL2kT4Apgj/qO\ndeI2MwOqG1AqySbp5UrUNUnqDPwT+F1E/Ke+4524zcwo3FolktoATwBnR8SLSd7jWSVmZjTurBJJ\nQ4GXgQ0lTZJ0lKTekiYB2wJPSHo6e/hJwHrA+ZLezG6r19l/sd4t1LSiU3EGZgX17ZRRhQ7BilB5\n+3VU/1F122C17olzzofTxi73+ZaHSyVmZnhZVzOz1GnIxclCc+I2M8MjbjOz1KmKqkKHkJgTt5kZ\nXtbVzCx1iuSW90ScuM3M8IjbzCx1PKvEzCxlPKvEzCxlEj4goSg4cZuZ4Rq3mVnquMZtZpYyHnGb\nmaWM53GbmaWMR9xmZinjWSVmZinji5NmZinjUomZWcr4zkkzs5TxiNvMLGXSVOMu2qe82/ck9Y+I\nwYWOw4qLfy5WXGWFDsAS6V/oAKwo+ediBeXEbWaWMk7cZmYp48SdDq5j2rL452IF5YuTZmYp4xG3\nmVnKOHEXOUl7SvpA0seSzi50PFZ4ku6SNFXShELHYoXhxF3EJDUBbgL2AjYG+krauLBRWREYAuxZ\n6CCscJy4i9tWwMcRMTEiFgIPAL0KHJMVWESMBGYWOg4rHCfu4tYJ+LzG60nZNjNbgTlxm5mljBN3\ncZsMrFXjdedsm5mtwJy4i9trwPqSukmqAA4GHi1wTGZWYE7cRSwiKoGTgKeB94CHIuKdwkZlhSZp\nKPAysKGkSZKOKnRMll++c9LMLGU84jYzSxknbjOzlHHiNjNLGSduM7OUceI2M0sZJ25rVJLaSDoh\nh/0fLunGeo65QNIfGtjv18sXmVn+OHFbY2sDLDNxS2qa51jMSpITtzW2PwPrSnpT0lWSekgaJelR\n4F1JXWuuIy3pD5IuyH6/rqSnJL2efc9GdZ1I0q8lvSppnKR/S1qjxu4tJL0s6SNJx9R4zxmSXpM0\nXtKFjfvRzfLDIyBrbGcDm0bETwEk9QC2zLZ9IqlrHe8dDBwXER9J2hq4GdiljuNHA9tEREg6GjgT\nOD27b3NgG6AFME7SE8CmwPpklssV8KiknbLLpJqlhhO35cOYiPikrgMktQS2Ax6WtLi5WT39dgYe\nlLQmUAHUPMe/IuJb4FtJz5FJ1jsAewDjsse0JJPInbgtVZy4LR/m1/i+kh+W6FbKfi0DZi8eqSd0\nA3BtRDyaHdlfUGPfkms5BJlR9uURcVsDzmFWdFzjtsY2D1iljv1fAatLaiepGbAPQETMBT6RdCCA\nMrao51yt+X6Z235L7OslaSVJ7YAeZFZafBo4Mju6R1InSasn/2hmxcEjbmtUETFD0ovZC5DDgCeW\n2L9I0kXAGDJJ9/0auw8FbpF0HlBO5lFtb9VxugvIlFZmAc8C3WrsGw88B7QHLo6IKcAUST8BXs6W\nY74GDgOm/siPa1YQXh3QzCxlXCoxM0sZJ24zs5Rx4jYzSxknbjOzlHHiNjNLGSduM7OUceI2M0sZ\nJ24zs5T5f+YlW4gngnCQAAAAAElFTkSuQmCC\n",
            "text/plain": [
              "<Figure size 432x288 with 2 Axes>"
            ]
          },
          "metadata": {
            "tags": []
          }
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "vxrK8jpFMDSZ",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 170
        },
        "outputId": "76e43212-8d86-47d2-edbb-66e90eb8dd59"
      },
      "source": [
        "print(classification_report(y_test, yfit_mlp))"
      ],
      "execution_count": 265,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "              precision    recall  f1-score   support\n",
            "\n",
            "        -1.0       0.54      0.52      0.53       237\n",
            "         1.0       0.57      0.58      0.58       256\n",
            "\n",
            "    accuracy                           0.55       493\n",
            "   macro avg       0.55      0.55      0.55       493\n",
            "weighted avg       0.55      0.55      0.55       493\n",
            "\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "tAsKCIbQMFbo",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        ""
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "d8DgvG-HM3c5",
        "colab_type": "text"
      },
      "source": [
        "## Deep Neural Network"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "2flCevZAM7M4",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 34
        },
        "outputId": "e2934e5d-dac6-43b7-df02-2aac860b054a"
      },
      "source": [
        "# tensorflow 활용\n",
        "import tensorflow as tf\n",
        "tf.version"
      ],
      "execution_count": 266,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "<module 'tensorflow._api.v1.version' from '/usr/local/lib/python3.6/dist-packages/tensorflow/_api/v1/version/__init__.py'>"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 266
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "wCMeGY6KhJ0U",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 34
        },
        "outputId": "d1050c63-812d-4554-a1dc-c78059aa815e"
      },
      "source": [
        "tf.keras"
      ],
      "execution_count": 267,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "<module 'tensorflow.python.keras.api._v1.keras' from '/usr/local/lib/python3.6/dist-packages/tensorflow/python/keras/api/_v1/keras/__init__.py'>"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 267
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "TZ-X92JPNOC0",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        ""
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "ieife-tZS_Xa",
        "colab_type": "text"
      },
      "source": [
        "## accuracy score"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "4IquQi9fUrF8",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "accuracy_score=[svc_score, pca_svm_score, gnb_score, tree_score, rf_score, knn_score, abc_score, gbc_score, xgb_score, mlp_score]"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "DOmuaEqJTmFo",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 359
        },
        "outputId": "58e0fa28-4e21-4839-bb40-5fe5c45aa457"
      },
      "source": [
        "index = ['SVM', 'PCA-SVM', 'GNB', 'Decision Tree','Random Forest','KNN','Adaboost','Gradient Boost','XGBoost','MLP']\n",
        "table = pd.DataFrame(data=accuracy_score, index=index, columns=['accuracy score'])\n",
        "table"
      ],
      "execution_count": 269,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>accuracy score</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>SVM</th>\n",
              "      <td>0.561866</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>PCA-SVM</th>\n",
              "      <td>0.574037</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>GNB</th>\n",
              "      <td>0.598377</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>Decision Tree</th>\n",
              "      <td>0.598377</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>Random Forest</th>\n",
              "      <td>0.608519</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>KNN</th>\n",
              "      <td>0.596349</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>Adaboost</th>\n",
              "      <td>0.561866</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>Gradient Boost</th>\n",
              "      <td>0.624746</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>XGBoost</th>\n",
              "      <td>0.638945</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>MLP</th>\n",
              "      <td>0.553753</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "                accuracy score\n",
              "SVM                   0.561866\n",
              "PCA-SVM               0.574037\n",
              "GNB                   0.598377\n",
              "Decision Tree         0.598377\n",
              "Random Forest         0.608519\n",
              "KNN                   0.596349\n",
              "Adaboost              0.561866\n",
              "Gradient Boost        0.624746\n",
              "XGBoost               0.638945\n",
              "MLP                   0.553753"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 269
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "cUvR1-Us-hg-",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 359
        },
        "outputId": "08013a73-3a14-4beb-c700-1b62245ff2ff"
      },
      "source": [
        "table.sort_values(by='accuracy score',ascending=False)"
      ],
      "execution_count": 270,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>accuracy score</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>XGBoost</th>\n",
              "      <td>0.638945</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>Gradient Boost</th>\n",
              "      <td>0.624746</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>Random Forest</th>\n",
              "      <td>0.608519</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>GNB</th>\n",
              "      <td>0.598377</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>Decision Tree</th>\n",
              "      <td>0.598377</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>KNN</th>\n",
              "      <td>0.596349</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>PCA-SVM</th>\n",
              "      <td>0.574037</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>SVM</th>\n",
              "      <td>0.561866</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>Adaboost</th>\n",
              "      <td>0.561866</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>MLP</th>\n",
              "      <td>0.553753</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "                accuracy score\n",
              "XGBoost               0.638945\n",
              "Gradient Boost        0.624746\n",
              "Random Forest         0.608519\n",
              "GNB                   0.598377\n",
              "Decision Tree         0.598377\n",
              "KNN                   0.596349\n",
              "PCA-SVM               0.574037\n",
              "SVM                   0.561866\n",
              "Adaboost              0.561866\n",
              "MLP                   0.553753"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 270
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "3_lbhD8C8TTH",
        "colab_type": "text"
      },
      "source": [
        " # 부록 ( classification report) \n",
        "### from https://muthu.co/understanding-the-classification-report-in-sklearn/"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "LMo6wU5m8TTI",
        "colab_type": "text"
      },
      "source": [
        "what is that?"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "b-Fa9hPz8TTJ",
        "colab_type": "text"
      },
      "source": [
        "### Precision: What percent of your predictions were correct?\n",
        "\n",
        "Precision is the ability of a classifier not to label an instance positive that is actually negative. For each class it is defined as the ratio of true positives to the sum of true and false positives.\n",
        "\n",
        "- TP – True Positives\n",
        "- FP – False Positives\n",
        "\n",
        "* Precision – Accuracy of positive predictions.\n",
        "* Precision = TP/(TP + FP)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "72RBDx7F8TTK",
        "colab_type": "text"
      },
      "source": [
        "### Recall: What percent of the positive cases did you catch? \n",
        "\n",
        "Recall is the ability of a classifier to find all positive instances. For each class it is defined as the ratio of true positives to the sum of true positives and false negatives.\n",
        "\n",
        "- FN – False Negatives\n",
        "\n",
        "- Recall: Fraction of positives that were correctly identified.\n",
        "- Recall = TP/(TP+FN)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "bmNVNKsX8TTL",
        "colab_type": "text"
      },
      "source": [
        "### F1 score: What percent of positive predictions were correct? \n",
        "\n",
        "The F1 score is a weighted harmonic mean of precision and recall such that the best score is 1.0 and the worst is 0.0. Generally speaking, F1 scores are lower than accuracy measures as they embed precision and recall into their computation. As a rule of thumb, the weighted average of F1 should be used to compare classifier models, not global accuracy.\n",
        "\n",
        "- F1 Score = 2$*$(Recall $*$ Precision) / (Recall + Precision)"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "ytQdPAXv8TTP",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        ""
      ],
      "execution_count": 0,
      "outputs": []
    }
  ]
}