0_nearest-neighbors-features-and-metrics_blank.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Nearest Neighbors \n",
    "## author: 申恒恒"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "When exploring a large set of documents -- such as Wikipedia, news articles, StackOverflow, etc. -- it can be useful to get a list of related material. To find relevant documents you typically\n",
    "* Decide on a notion of similarity\n",
    "* Find the documents that are most similar \n",
    "\n",
    "In the assignment you will\n",
    "* Gain intuition for different notions of similarity and practice finding similar documents. \n",
    "* Explore the tradeoffs with representing documents using raw word counts and TF-IDF\n",
    "* Explore the behavior of different distance metrics by looking at the Wikipedia pages most similar to President Obama’s page."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Note to Amazon EC2 users**: To conserve memory, make sure to stop all the other notebooks before running this notebook."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Import necessary packages"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As usual we need to first import the Python packages that we will need."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "[INFO] graphlab.cython.cy_server: GraphLab Create v2.1 started. Logging: /tmp/graphlab_server_1506511067.log\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "This non-commercial license of GraphLab Create for academic use is assigned to heng960509@outlook.com and will expire on September 28, 2018.\n"
     ]
    }
   ],
   "source": [
    "import graphlab\n",
    "import matplotlib.pyplot as plt\n",
    "import numpy as np\n",
    "%matplotlib inline"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Load Wikipedia dataset"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We will be using the same dataset of Wikipedia pages that we used in the Machine Learning Foundations course (Course 1). Each element of the dataset consists of a link to the wikipedia article, the name of the person, and the text of the article (in lowercase).  "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "wiki = graphlab.SFrame('people_wiki.gl')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div style=\"max-height:1000px;max-width:1500px;overflow:auto;\"><table frame=\"box\" rules=\"cols\">\n",
       "    <tr>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">URI</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">name</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">text</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">&lt;http://dbpedia.org/resou<br>rce/Digby_Morrell&gt; ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Digby Morrell</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">digby morrell born 10<br>october 1979 is a former ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">&lt;http://dbpedia.org/resou<br>rce/Alfred_J._Lewy&gt; ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Alfred J. Lewy</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">alfred j lewy aka sandy<br>lewy graduated from ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">&lt;http://dbpedia.org/resou<br>rce/Harpdog_Brown&gt; ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Harpdog Brown</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">harpdog brown is a singer<br>and harmonica player who ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">&lt;http://dbpedia.org/resou<br>rce/Franz_Rottensteiner&gt; ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Franz Rottensteiner</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">franz rottensteiner born<br>in waidmannsfeld lower ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">&lt;http://dbpedia.org/resou<br>rce/G-Enka&gt; ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">G-Enka</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">henry krvits born 30<br>december 1974 in tallinn ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">&lt;http://dbpedia.org/resou<br>rce/Sam_Henderson&gt; ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Sam Henderson</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">sam henderson born<br>october 18 1969 is an ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">&lt;http://dbpedia.org/resou<br>rce/Aaron_LaCrate&gt; ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Aaron LaCrate</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">aaron lacrate is an<br>american music producer ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">&lt;http://dbpedia.org/resou<br>rce/Trevor_Ferguson&gt; ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Trevor Ferguson</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">trevor ferguson aka john<br>farrow born 11 november ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">&lt;http://dbpedia.org/resou<br>rce/Grant_Nelson&gt; ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Grant Nelson</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">grant nelson born 27<br>april 1971 in london  ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">&lt;http://dbpedia.org/resou<br>rce/Cathy_Caruth&gt; ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Cathy Caruth</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">cathy caruth born 1955 is<br>frank h t rhodes ...</td>\n",
       "    </tr>\n",
       "</table>\n",
       "[59071 rows x 3 columns]<br/>Note: Only the head of the SFrame is printed.<br/>You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns.\n",
       "</div>"
      ],
      "text/plain": [
       "Columns:\n",
       "\tURI\tstr\n",
       "\tname\tstr\n",
       "\ttext\tstr\n",
       "\n",
       "Rows: 59071\n",
       "\n",
       "Data:\n",
       "+-------------------------------+---------------------+\n",
       "|              URI              |         name        |\n",
       "+-------------------------------+---------------------+\n",
       "| <http://dbpedia.org/resour... |    Digby Morrell    |\n",
       "| <http://dbpedia.org/resour... |    Alfred J. Lewy   |\n",
       "| <http://dbpedia.org/resour... |    Harpdog Brown    |\n",
       "| <http://dbpedia.org/resour... | Franz Rottensteiner |\n",
       "| <http://dbpedia.org/resour... |        G-Enka       |\n",
       "| <http://dbpedia.org/resour... |    Sam Henderson    |\n",
       "| <http://dbpedia.org/resour... |    Aaron LaCrate    |\n",
       "| <http://dbpedia.org/resour... |   Trevor Ferguson   |\n",
       "| <http://dbpedia.org/resour... |     Grant Nelson    |\n",
       "| <http://dbpedia.org/resour... |     Cathy Caruth    |\n",
       "+-------------------------------+---------------------+\n",
       "+-------------------------------+\n",
       "|              text             |\n",
       "+-------------------------------+\n",
       "| digby morrell born 10 octo... |\n",
       "| alfred j lewy aka sandy le... |\n",
       "| harpdog brown is a singer ... |\n",
       "| franz rottensteiner born i... |\n",
       "| henry krvits born 30 decem... |\n",
       "| sam henderson born october... |\n",
       "| aaron lacrate is an americ... |\n",
       "| trevor ferguson aka john f... |\n",
       "| grant nelson born 27 april... |\n",
       "| cathy caruth born 1955 is ... |\n",
       "+-------------------------------+\n",
       "[59071 rows x 3 columns]\n",
       "Note: Only the head of the SFrame is printed.\n",
       "You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns."
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "wiki"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'<http://dbpedia.org/resource/Alfred_J._Lewy>'"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "wiki['URI'][1]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Extract word count vectors"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As we have seen in Course 1, we can extract word count vectors using a GraphLab utility function.  We add this as a column in `wiki`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "wiki['word_count'] = graphlab.text_analytics.count_words(wiki['text'])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div style=\"max-height:1000px;max-width:1500px;overflow:auto;\"><table frame=\"box\" rules=\"cols\">\n",
       "    <tr>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">URI</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">name</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">text</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">word_count</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">&lt;http://dbpedia.org/resou<br>rce/Digby_Morrell&gt; ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Digby Morrell</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">digby morrell born 10<br>october 1979 is a former ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">{'selection': 1,<br>'carltons': 1, 'being': ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">&lt;http://dbpedia.org/resou<br>rce/Alfred_J._Lewy&gt; ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Alfred J. Lewy</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">alfred j lewy aka sandy<br>lewy graduated from ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">{'precise': 1, 'thomas':<br>1, 'closely': 1, ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">&lt;http://dbpedia.org/resou<br>rce/Harpdog_Brown&gt; ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Harpdog Brown</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">harpdog brown is a singer<br>and harmonica player who ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">{'just': 1, 'issued': 1,<br>'mainly': 1, 'nominat ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">&lt;http://dbpedia.org/resou<br>rce/Franz_Rottensteiner&gt; ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Franz Rottensteiner</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">franz rottensteiner born<br>in waidmannsfeld lower ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">{'all': 1,<br>'bauforschung': 1, ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">&lt;http://dbpedia.org/resou<br>rce/G-Enka&gt; ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">G-Enka</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">henry krvits born 30<br>december 1974 in tallinn ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">{'they': 1,<br>'gangstergenka': 1, ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">&lt;http://dbpedia.org/resou<br>rce/Sam_Henderson&gt; ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Sam Henderson</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">sam henderson born<br>october 18 1969 is an ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">{'currently': 1, 'less':<br>1, 'being': 1, ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">&lt;http://dbpedia.org/resou<br>rce/Aaron_LaCrate&gt; ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Aaron LaCrate</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">aaron lacrate is an<br>american music producer ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">{'exclusive': 2,<br>'producer': 1, 'show' ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">&lt;http://dbpedia.org/resou<br>rce/Trevor_Ferguson&gt; ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Trevor Ferguson</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">trevor ferguson aka john<br>farrow born 11 november ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">{'taxi': 1, 'salon': 1,<br>'gangs': 1, 'being': 1, ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">&lt;http://dbpedia.org/resou<br>rce/Grant_Nelson&gt; ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Grant Nelson</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">grant nelson born 27<br>april 1971 in london  ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">{'houston': 1, 'frankie':<br>1, 'labels': 1, ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">&lt;http://dbpedia.org/resou<br>rce/Cathy_Caruth&gt; ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Cathy Caruth</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">cathy caruth born 1955 is<br>frank h t rhodes ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">{'phenomenon': 1,<br>'deborash': 1, 'both' ...</td>\n",
       "    </tr>\n",
       "</table>\n",
       "[59071 rows x 4 columns]<br/>Note: Only the head of the SFrame is printed.<br/>You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns.\n",
       "</div>"
      ],
      "text/plain": [
       "Columns:\n",
       "\tURI\tstr\n",
       "\tname\tstr\n",
       "\ttext\tstr\n",
       "\tword_count\tdict\n",
       "\n",
       "Rows: 59071\n",
       "\n",
       "Data:\n",
       "+-------------------------------+---------------------+\n",
       "|              URI              |         name        |\n",
       "+-------------------------------+---------------------+\n",
       "| <http://dbpedia.org/resour... |    Digby Morrell    |\n",
       "| <http://dbpedia.org/resour... |    Alfred J. Lewy   |\n",
       "| <http://dbpedia.org/resour... |    Harpdog Brown    |\n",
       "| <http://dbpedia.org/resour... | Franz Rottensteiner |\n",
       "| <http://dbpedia.org/resour... |        G-Enka       |\n",
       "| <http://dbpedia.org/resour... |    Sam Henderson    |\n",
       "| <http://dbpedia.org/resour... |    Aaron LaCrate    |\n",
       "| <http://dbpedia.org/resour... |   Trevor Ferguson   |\n",
       "| <http://dbpedia.org/resour... |     Grant Nelson    |\n",
       "| <http://dbpedia.org/resour... |     Cathy Caruth    |\n",
       "+-------------------------------+---------------------+\n",
       "+-------------------------------+-------------------------------+\n",
       "|              text             |           word_count          |\n",
       "+-------------------------------+-------------------------------+\n",
       "| digby morrell born 10 octo... | {'selection': 1, 'carltons... |\n",
       "| alfred j lewy aka sandy le... | {'precise': 1, 'thomas': 1... |\n",
       "| harpdog brown is a singer ... | {'just': 1, 'issued': 1, '... |\n",
       "| franz rottensteiner born i... | {'all': 1, 'bauforschung':... |\n",
       "| henry krvits born 30 decem... | {'they': 1, 'gangstergenka... |\n",
       "| sam henderson born october... | {'currently': 1, 'less': 1... |\n",
       "| aaron lacrate is an americ... | {'exclusive': 2, 'producer... |\n",
       "| trevor ferguson aka john f... | {'taxi': 1, 'salon': 1, 'g... |\n",
       "| grant nelson born 27 april... | {'houston': 1, 'frankie': ... |\n",
       "| cathy caruth born 1955 is ... | {'phenomenon': 1, 'deboras... |\n",
       "+-------------------------------+-------------------------------+\n",
       "[59071 rows x 4 columns]\n",
       "Note: Only the head of the SFrame is printed.\n",
       "You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns."
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "wiki"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Find nearest neighbors"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Let's start by finding the nearest neighbors of the Barack Obama page using the word count vectors to represent the articles and Euclidean distance to measure distance.  For this, again will we use a GraphLab Create implementation of nearest neighbor search."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<pre>Starting brute force nearest neighbors model training.</pre>"
      ],
      "text/plain": [
       "Starting brute force nearest neighbors model training."
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "model = graphlab.nearest_neighbors.create(wiki, label='name', features=['word_count'],\n",
    "                                          method='brute_force', distance='euclidean')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Let's look at the top 10 nearest neighbors by performing the following query:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {
    "collapsed": false,
    "scrolled": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<pre>Starting pairwise querying.</pre>"
      ],
      "text/plain": [
       "Starting pairwise querying."
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>+--------------+---------+-------------+--------------+</pre>"
      ],
      "text/plain": [
       "+--------------+---------+-------------+--------------+"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>| Query points | # Pairs | % Complete. | Elapsed Time |</pre>"
      ],
      "text/plain": [
       "| Query points | # Pairs | % Complete. | Elapsed Time |"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>+--------------+---------+-------------+--------------+</pre>"
      ],
      "text/plain": [
       "+--------------+---------+-------------+--------------+"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>| 0            | 1       | 0.00169288  | 19.191ms     |</pre>"
      ],
      "text/plain": [
       "| 0            | 1       | 0.00169288  | 19.191ms     |"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>| Done         |         | 100         | 479.795ms    |</pre>"
      ],
      "text/plain": [
       "| Done         |         | 100         | 479.795ms    |"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>+--------------+---------+-------------+--------------+</pre>"
      ],
      "text/plain": [
       "+--------------+---------+-------------+--------------+"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<div style=\"max-height:1000px;max-width:1500px;overflow:auto;\"><table frame=\"box\" rules=\"cols\">\n",
       "    <tr>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">query_label</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">reference_label</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">distance</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">rank</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">0.0</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Joe Biden</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">33.0756708171</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">George W. Bush</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">34.3947670438</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Lawrence Summers</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">36.1524549651</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Mitt Romney</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">36.1662826401</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Francisco Barrio</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">36.3318042492</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Walter Mondale</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">36.4005494464</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">7</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Wynn Normington Hugh-<br>Jones ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">36.4965751818</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">8</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Don Bonker</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">36.633318168</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">9</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Andy Anstett</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">36.9594372252</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">10</td>\n",
       "    </tr>\n",
       "</table>\n",
       "[10 rows x 4 columns]<br/>\n",
       "</div>"
      ],
      "text/plain": [
       "Columns:\n",
       "\tquery_label\tstr\n",
       "\treference_label\tstr\n",
       "\tdistance\tfloat\n",
       "\trank\tint\n",
       "\n",
       "Rows: 10\n",
       "\n",
       "Data:\n",
       "+--------------+----------------------------+---------------+------+\n",
       "| query_label  |      reference_label       |    distance   | rank |\n",
       "+--------------+----------------------------+---------------+------+\n",
       "| Barack Obama |        Barack Obama        |      0.0      |  1   |\n",
       "| Barack Obama |         Joe Biden          | 33.0756708171 |  2   |\n",
       "| Barack Obama |       George W. Bush       | 34.3947670438 |  3   |\n",
       "| Barack Obama |      Lawrence Summers      | 36.1524549651 |  4   |\n",
       "| Barack Obama |        Mitt Romney         | 36.1662826401 |  5   |\n",
       "| Barack Obama |      Francisco Barrio      | 36.3318042492 |  6   |\n",
       "| Barack Obama |       Walter Mondale       | 36.4005494464 |  7   |\n",
       "| Barack Obama | Wynn Normington Hugh-Jones | 36.4965751818 |  8   |\n",
       "| Barack Obama |         Don Bonker         |  36.633318168 |  9   |\n",
       "| Barack Obama |        Andy Anstett        | 36.9594372252 |  10  |\n",
       "+--------------+----------------------------+---------------+------+\n",
       "[10 rows x 4 columns]"
      ]
     },
     "execution_count": 16,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "model.query(wiki[wiki['name']=='Barack Obama'], label='name', k=10)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "All of the 10 people are politicians, but about half of them have rather tenuous connections with Obama, other than the fact that they are politicians.\n",
    "\n",
    "* Francisco Barrio is a Mexican politician, and a former governor of Chihuahua.\n",
    "* Walter Mondale and Don Bonker are Democrats who made their career in late 1970s.\n",
    "* Wynn Normington Hugh-Jones is a former British diplomat and Liberal Party official.\n",
    "* Andy Anstett is a former politician in Manitoba, Canada.\n",
    "\n",
    "Nearest neighbors with raw word counts got some things right, showing all politicians in the query result, but missed finer and important details.\n",
    "\n",
    "For instance, let's find out why Francisco Barrio was considered a close neighbor of Obama.  To do this, let's look at the most frequently used words in each of Barack Obama and Francisco Barrio's pages:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div style=\"max-height:1000px;max-width:1500px;overflow:auto;\"><table frame=\"box\" rules=\"cols\">\n",
       "    <tr>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">word</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">count</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">the</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">40</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">in</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">30</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">and</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">21</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">of</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">to</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">14</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">his</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">11</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">9</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">act</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">8</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">he</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">7</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">a</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">7</td>\n",
       "    </tr>\n",
       "</table>\n",
       "[273 rows x 2 columns]<br/>Note: Only the head of the SFrame is printed.<br/>You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns.\n",
       "</div>"
      ],
      "text/plain": [
       "Columns:\n",
       "\tword\tstr\n",
       "\tcount\tint\n",
       "\n",
       "Rows: 273\n",
       "\n",
       "Data:\n",
       "+-------+-------+\n",
       "|  word | count |\n",
       "+-------+-------+\n",
       "|  the  |   40  |\n",
       "|   in  |   30  |\n",
       "|  and  |   21  |\n",
       "|   of  |   18  |\n",
       "|   to  |   14  |\n",
       "|  his  |   11  |\n",
       "| obama |   9   |\n",
       "|  act  |   8   |\n",
       "|   he  |   7   |\n",
       "|   a   |   7   |\n",
       "+-------+-------+\n",
       "[273 rows x 2 columns]\n",
       "Note: Only the head of the SFrame is printed.\n",
       "You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns."
      ]
     },
     "execution_count": 27,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "wiki[wiki['name'] == 'Barack Obama'][['word_count']].stack('word_count', new_column_name=['word','count']).sort('count',ascending=False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "def top_words(name):\n",
    "    \"\"\"\n",
    "    Get a table of the most frequent words in the given person's wikipedia page.\n",
    "    \"\"\"\n",
    "    row = wiki[wiki['name'] == name]\n",
    "    word_count_table = row[['word_count']].stack('word_count', new_column_name=['word','count'])\n",
    "    return word_count_table.sort('count', ascending=False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div style=\"max-height:1000px;max-width:1500px;overflow:auto;\"><table frame=\"box\" rules=\"cols\">\n",
       "    <tr>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">word</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">count</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">the</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">40</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">in</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">30</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">and</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">21</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">of</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">to</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">14</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">his</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">11</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">9</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">act</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">8</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">he</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">7</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">a</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">7</td>\n",
       "    </tr>\n",
       "</table>\n",
       "[273 rows x 2 columns]<br/>Note: Only the head of the SFrame is printed.<br/>You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns.\n",
       "</div>"
      ],
      "text/plain": [
       "Columns:\n",
       "\tword\tstr\n",
       "\tcount\tint\n",
       "\n",
       "Rows: 273\n",
       "\n",
       "Data:\n",
       "+-------+-------+\n",
       "|  word | count |\n",
       "+-------+-------+\n",
       "|  the  |   40  |\n",
       "|   in  |   30  |\n",
       "|  and  |   21  |\n",
       "|   of  |   18  |\n",
       "|   to  |   14  |\n",
       "|  his  |   11  |\n",
       "| obama |   9   |\n",
       "|  act  |   8   |\n",
       "|   he  |   7   |\n",
       "|   a   |   7   |\n",
       "+-------+-------+\n",
       "[273 rows x 2 columns]\n",
       "Note: Only the head of the SFrame is printed.\n",
       "You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns."
      ]
     },
     "execution_count": 29,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "obama_words = top_words('Barack Obama')\n",
    "obama_words"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div style=\"max-height:1000px;max-width:1500px;overflow:auto;\"><table frame=\"box\" rules=\"cols\">\n",
       "    <tr>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">word</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">count</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">the</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">36</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">of</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">24</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">and</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">in</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">17</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">he</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">10</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">to</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">9</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">chihuahua</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">7</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">governor</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">a</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">his</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">5</td>\n",
       "    </tr>\n",
       "</table>\n",
       "[225 rows x 2 columns]<br/>Note: Only the head of the SFrame is printed.<br/>You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns.\n",
       "</div>"
      ],
      "text/plain": [
       "Columns:\n",
       "\tword\tstr\n",
       "\tcount\tint\n",
       "\n",
       "Rows: 225\n",
       "\n",
       "Data:\n",
       "+-----------+-------+\n",
       "|    word   | count |\n",
       "+-----------+-------+\n",
       "|    the    |   36  |\n",
       "|     of    |   24  |\n",
       "|    and    |   18  |\n",
       "|     in    |   17  |\n",
       "|     he    |   10  |\n",
       "|     to    |   9   |\n",
       "| chihuahua |   7   |\n",
       "|  governor |   6   |\n",
       "|     a     |   6   |\n",
       "|    his    |   5   |\n",
       "+-----------+-------+\n",
       "[225 rows x 2 columns]\n",
       "Note: Only the head of the SFrame is printed.\n",
       "You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns."
      ]
     },
     "execution_count": 30,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "barrio_words = top_words('Francisco Barrio')\n",
    "barrio_words"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Let's extract the list of most frequent words that appear in both Obama's and Barrio's documents. We've so far sorted all words from Obama and Barrio's articles by their word frequencies. We will now use a dataframe operation known as **join**. The **join** operation is very useful when it comes to playing around with data: it lets you combine the content of two tables using a shared column (in this case, the word column). See [the documentation](https://dato.com/products/create/docs/generated/graphlab.SFrame.join.html) for more details.\n",
    "\n",
    "For instance, running\n",
    "```\n",
    "obama_words.join(barrio_words, on='word')\n",
    "```\n",
    "will extract the rows from both tables that correspond to the common words."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 31,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div style=\"max-height:1000px;max-width:1500px;overflow:auto;\"><table frame=\"box\" rules=\"cols\">\n",
       "    <tr>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">word</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">count</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">count.1</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">the</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">40</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">36</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">in</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">30</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">17</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">and</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">21</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">of</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">18</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">24</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">to</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">14</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">9</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">his</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">11</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">he</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">7</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">10</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">a</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">7</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">as</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">6</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">was</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">5</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">4</td>\n",
       "    </tr>\n",
       "</table>\n",
       "[56 rows x 3 columns]<br/>Note: Only the head of the SFrame is printed.<br/>You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns.\n",
       "</div>"
      ],
      "text/plain": [
       "Columns:\n",
       "\tword\tstr\n",
       "\tcount\tint\n",
       "\tcount.1\tint\n",
       "\n",
       "Rows: 56\n",
       "\n",
       "Data:\n",
       "+------+-------+---------+\n",
       "| word | count | count.1 |\n",
       "+------+-------+---------+\n",
       "| the  |   40  |    36   |\n",
       "|  in  |   30  |    17   |\n",
       "| and  |   21  |    18   |\n",
       "|  of  |   18  |    24   |\n",
       "|  to  |   14  |    9    |\n",
       "| his  |   11  |    5    |\n",
       "|  he  |   7   |    10   |\n",
       "|  a   |   7   |    6    |\n",
       "|  as  |   6   |    5    |\n",
       "| was  |   5   |    4    |\n",
       "+------+-------+---------+\n",
       "[56 rows x 3 columns]\n",
       "Note: Only the head of the SFrame is printed.\n",
       "You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns."
      ]
     },
     "execution_count": 31,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "combined_words = obama_words.join(barrio_words, on='word')\n",
    "combined_words"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Since both tables contained the column named `count`, SFrame automatically renamed one of them to prevent confusion. Let's rename the columns to tell which one is for which. By inspection, we see that the first column (`count`) is for Obama and the second (`count.1`) for Barrio."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 32,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div style=\"max-height:1000px;max-width:1500px;overflow:auto;\"><table frame=\"box\" rules=\"cols\">\n",
       "    <tr>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">word</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">Obama</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">Barrio</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">the</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">40</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">36</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">in</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">30</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">17</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">and</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">21</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">of</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">18</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">24</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">to</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">14</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">9</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">his</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">11</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">he</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">7</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">10</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">a</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">7</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">as</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">6</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">was</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">5</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">4</td>\n",
       "    </tr>\n",
       "</table>\n",
       "[56 rows x 3 columns]<br/>Note: Only the head of the SFrame is printed.<br/>You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns.\n",
       "</div>"
      ],
      "text/plain": [
       "Columns:\n",
       "\tword\tstr\n",
       "\tObama\tint\n",
       "\tBarrio\tint\n",
       "\n",
       "Rows: 56\n",
       "\n",
       "Data:\n",
       "+------+-------+--------+\n",
       "| word | Obama | Barrio |\n",
       "+------+-------+--------+\n",
       "| the  |   40  |   36   |\n",
       "|  in  |   30  |   17   |\n",
       "| and  |   21  |   18   |\n",
       "|  of  |   18  |   24   |\n",
       "|  to  |   14  |   9    |\n",
       "| his  |   11  |   5    |\n",
       "|  he  |   7   |   10   |\n",
       "|  a   |   7   |   6    |\n",
       "|  as  |   6   |   5    |\n",
       "| was  |   5   |   4    |\n",
       "+------+-------+--------+\n",
       "[56 rows x 3 columns]\n",
       "Note: Only the head of the SFrame is printed.\n",
       "You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns."
      ]
     },
     "execution_count": 32,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "combined_words = combined_words.rename({'count':'Obama', 'count.1':'Barrio'})\n",
    "combined_words"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Note**. The **join** operation does not enforce any particular ordering on the shared column. So to obtain, say, the five common words that appear most often in Obama's article, sort the combined table by the Obama column. Don't forget `ascending=False` to display largest counts first."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div style=\"max-height:1000px;max-width:1500px;overflow:auto;\"><table frame=\"box\" rules=\"cols\">\n",
       "    <tr>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">word</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">Obama</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">Barrio</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">the</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">40</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">36</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">in</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">30</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">17</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">and</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">21</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">of</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">18</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">24</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">to</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">14</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">9</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">his</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">11</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">he</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">7</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">10</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">a</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">7</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">as</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">6</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">was</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">5</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">4</td>\n",
       "    </tr>\n",
       "</table>\n",
       "[56 rows x 3 columns]<br/>Note: Only the head of the SFrame is printed.<br/>You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns.\n",
       "</div>"
      ],
      "text/plain": [
       "Columns:\n",
       "\tword\tstr\n",
       "\tObama\tint\n",
       "\tBarrio\tint\n",
       "\n",
       "Rows: 56\n",
       "\n",
       "Data:\n",
       "+------+-------+--------+\n",
       "| word | Obama | Barrio |\n",
       "+------+-------+--------+\n",
       "| the  |   40  |   36   |\n",
       "|  in  |   30  |   17   |\n",
       "| and  |   21  |   18   |\n",
       "|  of  |   18  |   24   |\n",
       "|  to  |   14  |   9    |\n",
       "| his  |   11  |   5    |\n",
       "|  he  |   7   |   10   |\n",
       "|  a   |   7   |   6    |\n",
       "|  as  |   6   |   5    |\n",
       "| was  |   5   |   4    |\n",
       "+------+-------+--------+\n",
       "[56 rows x 3 columns]\n",
       "Note: Only the head of the SFrame is printed.\n",
       "You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns."
      ]
     },
     "execution_count": 33,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "combined_words.sort('Obama', ascending=False)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Quiz Question**. Among the words that appear in both Barack Obama and Francisco Barrio, take the 5 that appear most frequently in Obama. How many of the articles in the Wikipedia dataset contain all of those 5 words?\n",
    "\n",
    "**Answer**.answer is 56066\n",
    "\n",
    "Hint:\n",
    "* Refer to the previous paragraph for finding the words that appear in both articles. Sort the common words by their frequencies in Obama's article and take the largest five.\n",
    "* Each word count vector is a Python dictionary. For each word count vector in SFrame, you'd have to check if the set of the 5 common words is a subset of the keys of the word count vector. Complete the function `has_top_words` to accomplish the task.\n",
    "  - Convert the list of top 5 words into set using the syntax\n",
    "```\n",
    "set(common_words)\n",
    "```\n",
    "    where `common_words` is a Python list. See [this link](https://docs.python.org/2/library/stdtypes.html#set) if you're curious about Python sets.\n",
    "  - Extract the list of keys of the word count dictionary by calling the [`keys()` method](https://docs.python.org/2/library/stdtypes.html#dict.keys).\n",
    "  - Convert the list of keys into a set as well.\n",
    "  - Use [`issubset()` method](https://docs.python.org/2/library/stdtypes.html#set) to check if all 5 words are among the keys.\n",
    "* Now apply the `has_top_words` function on every row of the SFrame.\n",
    "* Compute the sum of the result column to obtain the number of articles containing all the 5 top words."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "obama_words = top_words('Barack Obama')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 35,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'and', 'in', 'of', 'the', 'to'}"
      ]
     },
     "execution_count": 35,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "common_words = list(obama_words[:5]['word'])\n",
    "type(common_words)\n",
    "#mmon_words\n",
    "set(common_words)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 39,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "['the', 'in', 'and', 'of', 'to']\n",
      "[1, 1, 1, 1, 0, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, ... ]\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "56066"
      ]
     },
     "execution_count": 39,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "common_words = list(top_words('Barack Obama')[:5]['word'])  # Barack Obama 5 largest words\n",
    "print common_words\n",
    "def has_top_words(word_count_vector):\n",
    "    # extract the keys of word_count_vector and convert it to a set\n",
    "    unique_words = set(word_count_vector.keys())  #using keys() method and using set() method convert list to set\n",
    "    # return True if common_words is a subset of unique_words\n",
    "    # return False otherwise\n",
    "    return set(common_words).issubset(unique_words)  # YOUR CODE HERE\n",
    "\n",
    "wiki['has_top_words'] = wiki['word_count'].apply(has_top_words)\n",
    "\n",
    "# use has_top_words column to answer the quiz question\n",
    "print wiki['has_top_words']\n",
    "sum(wiki['has_top_words'])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Checkpoint**. Check your `has_top_words` function on two random articles:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 40,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Output from your function: True\n",
      "Correct output: True\n",
      "Also check the length of unique_words. It should be 167\n"
     ]
    }
   ],
   "source": [
    "print 'Output from your function:', has_top_words(wiki[32]['word_count'])\n",
    "print 'Correct output: True'\n",
    "print 'Also check the length of unique_words. It should be 167'"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 41,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Output from your function: False\n",
      "Correct output: False\n",
      "Also check the length of unique_words. It should be 188\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "dict"
      ]
     },
     "execution_count": 41,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "print 'Output from your function:', has_top_words(wiki[33]['word_count'])\n",
    "print 'Correct output: False'\n",
    "print 'Also check the length of unique_words. It should be 188'\n",
    "type(wiki[33])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Quiz Question**. Measure the pairwise distance between the Wikipedia pages of Barack Obama, George W. Bush, and Joe Biden. Which of the three pairs has the smallest distance?\n",
    "\n",
    "**Answer**. Biden and Bush\n",
    "\n",
    "Hint: To compute the Euclidean distance between two dictionaries, use `graphlab.toolkits.distances.euclidean`. Refer to [this link](https://dato.com/products/create/docs/generated/graphlab.toolkits.distances.euclidean.html) for usage."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 42,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "a = graphlab.SFrame(wiki[wiki['name']=='Barack Obama']['word_count'])[0]['X1']\n",
    "b = graphlab.SFrame(wiki[wiki['name']=='George W. Bush']['word_count'])[0]['X1']\n",
    "c = graphlab.SFrame(wiki[wiki['name']=='Joe Biden']['word_count'])[0]['X1']\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 43,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "34.39476704383968"
      ]
     },
     "execution_count": 43,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "graphlab.toolkits.distances.euclidean(a,b) # Obama and Bush"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 44,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "33.075670817082454"
      ]
     },
     "execution_count": 44,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "graphlab.toolkits.distances.euclidean(a,c) # Obama and Joe"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 45,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "32.7566787083184"
      ]
     },
     "execution_count": 45,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "graphlab.toolkits.distances.euclidean(b,c) # Bush and Joe+++++++++++++"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Quiz Question**. Collect all words that appear both in Barack Obama and George W. Bush pages.  Out of those words,\n",
    "find the 10 words that show up most often in Obama's page. \n",
    "\n",
    "**Answer**. 3th\n",
    "\n",
    "the', 'in', 'and', 'of', 'to', 'his', 'act', 'he', 'a', 'as'"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true
   },
   "source": [
    "### obama_words.join()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 46,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "bush_words = top_words('George W. Bush')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 47,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div style=\"max-height:1000px;max-width:1500px;overflow:auto;\"><table frame=\"box\" rules=\"cols\">\n",
       "    <tr>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">word</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">Obama</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">Bush</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">the</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">40</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">39</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">in</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">30</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">22</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">and</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">21</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">14</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">of</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">18</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">14</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">to</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">14</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">11</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">his</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">11</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">act</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">8</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">he</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">7</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">8</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">a</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">7</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">as</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">6</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">6</td>\n",
       "    </tr>\n",
       "</table>\n",
       "[86 rows x 3 columns]<br/>Note: Only the head of the SFrame is printed.<br/>You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns.\n",
       "</div>"
      ],
      "text/plain": [
       "Columns:\n",
       "\tword\tstr\n",
       "\tObama\tint\n",
       "\tBush\tint\n",
       "\n",
       "Rows: 86\n",
       "\n",
       "Data:\n",
       "+------+-------+------+\n",
       "| word | Obama | Bush |\n",
       "+------+-------+------+\n",
       "| the  |   40  |  39  |\n",
       "|  in  |   30  |  22  |\n",
       "| and  |   21  |  14  |\n",
       "|  of  |   18  |  14  |\n",
       "|  to  |   14  |  11  |\n",
       "| his  |   11  |  6   |\n",
       "| act  |   8   |  3   |\n",
       "|  he  |   7   |  8   |\n",
       "|  a   |   7   |  6   |\n",
       "|  as  |   6   |  6   |\n",
       "+------+-------+------+\n",
       "[86 rows x 3 columns]\n",
       "Note: Only the head of the SFrame is printed.\n",
       "You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns."
      ]
     },
     "execution_count": 47,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "obama_words.join(bush_words, on='word') \\\n",
    "            .rename({'count' : 'Obama', 'count.1' : 'Bush'}) \\\n",
    "            .sort('Obama', ascending = False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 49,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "dtype: str\n",
       "Rows: 10\n",
       "['the', 'in', 'and', 'of', 'to', 'his', 'act', 'he', 'a', 'as']"
      ]
     },
     "execution_count": 49,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "obama_words.join(bush_words, on='word') \\\n",
    "            .rename({'count' : 'Obama', 'count.1' : 'Bush'}) \\\n",
    "            .sort('Obama', ascending = False)['word'][:10]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Note.** Even though common words are swamping out important subtle differences, commonalities in rarer political words still matter on the margin. This is why politicians are being listed in the query result instead of musicians, for example. In the next subsection, we will introduce a different metric that will place greater emphasis on those rarer words."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## TF-IDF to the rescue"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Much of the perceived commonalities between Obama and Barrio were due to occurrences of extremely frequent words, such as \"the\", \"and\", and \"his\". So nearest neighbors is recommending plausible results sometimes for the wrong reasons. \n",
    "\n",
    "To retrieve articles that are more relevant, we should focus more on rare words that don't happen in every article. **TF-IDF** (term frequency–inverse document frequency) is a feature representation that penalizes words that are too common.  Let's use GraphLab Create's implementation of TF-IDF and repeat the search for the 10 nearest neighbors of Barack Obama:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 50,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "wiki['tf_idf'] = graphlab.text_analytics.tf_idf(wiki['word_count'])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": 54,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<pre>Starting brute force nearest neighbors model training.</pre>"
      ],
      "text/plain": [
       "Starting brute force nearest neighbors model training."
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "model_tf_idf = graphlab.nearest_neighbors.create(wiki, label='name', features=['tf_idf'],\n",
    "                                                 method='brute_force', distance='euclidean')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 55,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<pre>Starting pairwise querying.</pre>"
      ],
      "text/plain": [
       "Starting pairwise querying."
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>+--------------+---------+-------------+--------------+</pre>"
      ],
      "text/plain": [
       "+--------------+---------+-------------+--------------+"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>| Query points | # Pairs | % Complete. | Elapsed Time |</pre>"
      ],
      "text/plain": [
       "| Query points | # Pairs | % Complete. | Elapsed Time |"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>+--------------+---------+-------------+--------------+</pre>"
      ],
      "text/plain": [
       "+--------------+---------+-------------+--------------+"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>| 0            | 1       | 0.00169288  | 22.927ms     |</pre>"
      ],
      "text/plain": [
       "| 0            | 1       | 0.00169288  | 22.927ms     |"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>| Done         |         | 100         | 643.678ms    |</pre>"
      ],
      "text/plain": [
       "| Done         |         | 100         | 643.678ms    |"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>+--------------+---------+-------------+--------------+</pre>"
      ],
      "text/plain": [
       "+--------------+---------+-------------+--------------+"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<div style=\"max-height:1000px;max-width:1500px;overflow:auto;\"><table frame=\"box\" rules=\"cols\">\n",
       "    <tr>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">query_label</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">reference_label</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">distance</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">rank</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">0.0</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Phil Schiliro</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">106.861013691</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Jeff Sessions</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">108.871674216</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Jesse Lee (politician)</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">109.045697909</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Samantha Power</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">109.108106165</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Bob Menendez</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">109.781867105</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Eric Stern (politician)</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">109.95778808</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">7</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">James A. Guest</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">110.413888718</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">8</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Roland Grossenbacher</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">110.4706087</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">9</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Tulsi Gabbard</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">110.696997999</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">10</td>\n",
       "    </tr>\n",
       "</table>\n",
       "[10 rows x 4 columns]<br/>\n",
       "</div>"
      ],
      "text/plain": [
       "Columns:\n",
       "\tquery_label\tstr\n",
       "\treference_label\tstr\n",
       "\tdistance\tfloat\n",
       "\trank\tint\n",
       "\n",
       "Rows: 10\n",
       "\n",
       "Data:\n",
       "+--------------+-------------------------+---------------+------+\n",
       "| query_label  |     reference_label     |    distance   | rank |\n",
       "+--------------+-------------------------+---------------+------+\n",
       "| Barack Obama |       Barack Obama      |      0.0      |  1   |\n",
       "| Barack Obama |      Phil Schiliro      | 106.861013691 |  2   |\n",
       "| Barack Obama |      Jeff Sessions      | 108.871674216 |  3   |\n",
       "| Barack Obama |  Jesse Lee (politician) | 109.045697909 |  4   |\n",
       "| Barack Obama |      Samantha Power     | 109.108106165 |  5   |\n",
       "| Barack Obama |       Bob Menendez      | 109.781867105 |  6   |\n",
       "| Barack Obama | Eric Stern (politician) |  109.95778808 |  7   |\n",
       "| Barack Obama |      James A. Guest     | 110.413888718 |  8   |\n",
       "| Barack Obama |   Roland Grossenbacher  |  110.4706087  |  9   |\n",
       "| Barack Obama |      Tulsi Gabbard      | 110.696997999 |  10  |\n",
       "+--------------+-------------------------+---------------+------+\n",
       "[10 rows x 4 columns]"
      ]
     },
     "execution_count": 55,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "model_tf_idf.query(wiki[wiki['name'] == 'Barack Obama'], label='name', k=10)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Let's determine whether this list makes sense.\n",
    "* With a notable exception of Roland Grossenbacher, the other 8 are all American politicians who are contemporaries of Barack Obama.\n",
    "* Phil Schiliro, Jesse Lee, Samantha Power, and Eric Stern worked for Obama.\n",
    "\n",
    "Clearly, the results are more plausible with the use of TF-IDF. Let's take a look at the word vector for Obama and Schilirio's pages. Notice that TF-IDF representation assigns a weight to each word. This weight captures relative importance of that word in the document. Let us sort the words in Obama's article by their TF-IDF weights; we do the same for Schiliro's article as well."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 56,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "def top_words_tf_idf(name):\n",
    "    row = wiki[wiki['name'] == name]\n",
    "    word_count_table = row[['tf_idf']].stack('tf_idf', new_column_name=['word','weight'])\n",
    "    return word_count_table.sort('weight', ascending=False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 57,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div style=\"max-height:1000px;max-width:1500px;overflow:auto;\"><table frame=\"box\" rules=\"cols\">\n",
       "    <tr>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">word</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">weight</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">43.2956530721</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">act</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">27.678222623</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">iraq</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">17.747378588</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">control</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">14.8870608452</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">law</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">14.7229357618</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">ordered</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">14.5333739509</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">military</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">13.1159327785</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">involvement</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">12.7843852412</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">response</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">12.7843852412</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">democratic</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">12.4106886973</td>\n",
       "    </tr>\n",
       "</table>\n",
       "[273 rows x 2 columns]<br/>Note: Only the head of the SFrame is printed.<br/>You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns.\n",
       "</div>"
      ],
      "text/plain": [
       "Columns:\n",
       "\tword\tstr\n",
       "\tweight\tfloat\n",
       "\n",
       "Rows: 273\n",
       "\n",
       "Data:\n",
       "+-------------+---------------+\n",
       "|     word    |     weight    |\n",
       "+-------------+---------------+\n",
       "|    obama    | 43.2956530721 |\n",
       "|     act     |  27.678222623 |\n",
       "|     iraq    |  17.747378588 |\n",
       "|   control   | 14.8870608452 |\n",
       "|     law     | 14.7229357618 |\n",
       "|   ordered   | 14.5333739509 |\n",
       "|   military  | 13.1159327785 |\n",
       "| involvement | 12.7843852412 |\n",
       "|   response  | 12.7843852412 |\n",
       "|  democratic | 12.4106886973 |\n",
       "+-------------+---------------+\n",
       "[273 rows x 2 columns]\n",
       "Note: Only the head of the SFrame is printed.\n",
       "You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns."
      ]
     },
     "execution_count": 57,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "obama_tf_idf = top_words_tf_idf('Barack Obama')\n",
    "obama_tf_idf"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 58,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div style=\"max-height:1000px;max-width:1500px;overflow:auto;\"><table frame=\"box\" rules=\"cols\">\n",
       "    <tr>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">word</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">weight</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">schiliro</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">21.9729907785</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">staff</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">15.8564416352</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">congressional</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">13.5470876563</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">daschleschiliro</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">10.9864953892</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">9.62125623824</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">waxman</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">9.04058524017</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">president</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">9.03358661416</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">2014from</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">8.68391029623</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">law</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">7.36146788088</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">consultant</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">6.91310403725</td>\n",
       "    </tr>\n",
       "</table>\n",
       "[119 rows x 2 columns]<br/>Note: Only the head of the SFrame is printed.<br/>You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns.\n",
       "</div>"
      ],
      "text/plain": [
       "Columns:\n",
       "\tword\tstr\n",
       "\tweight\tfloat\n",
       "\n",
       "Rows: 119\n",
       "\n",
       "Data:\n",
       "+-----------------+---------------+\n",
       "|       word      |     weight    |\n",
       "+-----------------+---------------+\n",
       "|     schiliro    | 21.9729907785 |\n",
       "|      staff      | 15.8564416352 |\n",
       "|  congressional  | 13.5470876563 |\n",
       "| daschleschiliro | 10.9864953892 |\n",
       "|      obama      | 9.62125623824 |\n",
       "|      waxman     | 9.04058524017 |\n",
       "|    president    | 9.03358661416 |\n",
       "|     2014from    | 8.68391029623 |\n",
       "|       law       | 7.36146788088 |\n",
       "|    consultant   | 6.91310403725 |\n",
       "+-----------------+---------------+\n",
       "[119 rows x 2 columns]\n",
       "Note: Only the head of the SFrame is printed.\n",
       "You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns."
      ]
     },
     "execution_count": 58,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "schiliro_tf_idf = top_words_tf_idf('Phil Schiliro')\n",
    "schiliro_tf_idf"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Using the **join** operation we learned earlier, try your hands at computing the common words shared by Obama's and Schiliro's articles. Sort the common words by their TF-IDF weights in Obama's document."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 60,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div style=\"max-height:1000px;max-width:1500px;overflow:auto;\"><table frame=\"box\" rules=\"cols\">\n",
       "    <tr>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">word</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">weight</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">weight.1</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">43.2956530721</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">9.62125623824</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">law</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">14.7229357618</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">7.36146788088</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">democratic</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">12.4106886973</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">6.20534434867</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">senate</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">10.1642881797</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">3.3880960599</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">presidential</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">7.3869554189</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">3.69347770945</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">president</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">7.22686929133</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">9.03358661416</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">policy</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">6.09538628214</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">3.04769314107</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">states</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">5.47320098963</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">1.82440032988</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">office</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">5.24817282322</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">2.62408641161</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">2011</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">5.10704127031</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">3.40469418021</td>\n",
       "    </tr>\n",
       "</table>\n",
       "[47 rows x 3 columns]<br/>Note: Only the head of the SFrame is printed.<br/>You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns.\n",
       "</div>"
      ],
      "text/plain": [
       "Columns:\n",
       "\tword\tstr\n",
       "\tweight\tfloat\n",
       "\tweight.1\tfloat\n",
       "\n",
       "Rows: 47\n",
       "\n",
       "Data:\n",
       "+--------------+---------------+---------------+\n",
       "|     word     |     weight    |    weight.1   |\n",
       "+--------------+---------------+---------------+\n",
       "|    obama     | 43.2956530721 | 9.62125623824 |\n",
       "|     law      | 14.7229357618 | 7.36146788088 |\n",
       "|  democratic  | 12.4106886973 | 6.20534434867 |\n",
       "|    senate    | 10.1642881797 |  3.3880960599 |\n",
       "| presidential |  7.3869554189 | 3.69347770945 |\n",
       "|  president   | 7.22686929133 | 9.03358661416 |\n",
       "|    policy    | 6.09538628214 | 3.04769314107 |\n",
       "|    states    | 5.47320098963 | 1.82440032988 |\n",
       "|    office    | 5.24817282322 | 2.62408641161 |\n",
       "|     2011     | 5.10704127031 | 3.40469418021 |\n",
       "+--------------+---------------+---------------+\n",
       "[47 rows x 3 columns]\n",
       "Note: Only the head of the SFrame is printed.\n",
       "You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns."
      ]
     },
     "execution_count": 60,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "combination2_words = obama_tf_idf.join(schiliro_tf_idf,on='word').sort('weight',ascending=False)\n",
    "combination2_words"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 61,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div style=\"max-height:1000px;max-width:1500px;overflow:auto;\"><table frame=\"box\" rules=\"cols\">\n",
       "    <tr>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">word</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">Obama</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">Schiliro</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">43.2956530721</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">9.62125623824</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">law</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">14.7229357618</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">7.36146788088</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">democratic</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">12.4106886973</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">6.20534434867</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">senate</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">10.1642881797</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">3.3880960599</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">presidential</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">7.3869554189</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">3.69347770945</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">president</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">7.22686929133</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">9.03358661416</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">policy</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">6.09538628214</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">3.04769314107</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">states</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">5.47320098963</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">1.82440032988</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">office</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">5.24817282322</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">2.62408641161</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">2011</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">5.10704127031</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">3.40469418021</td>\n",
       "    </tr>\n",
       "</table>\n",
       "[47 rows x 3 columns]<br/>Note: Only the head of the SFrame is printed.<br/>You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns.\n",
       "</div>"
      ],
      "text/plain": [
       "Columns:\n",
       "\tword\tstr\n",
       "\tObama\tfloat\n",
       "\tSchiliro\tfloat\n",
       "\n",
       "Rows: 47\n",
       "\n",
       "Data:\n",
       "+--------------+---------------+---------------+\n",
       "|     word     |     Obama     |    Schiliro   |\n",
       "+--------------+---------------+---------------+\n",
       "|    obama     | 43.2956530721 | 9.62125623824 |\n",
       "|     law      | 14.7229357618 | 7.36146788088 |\n",
       "|  democratic  | 12.4106886973 | 6.20534434867 |\n",
       "|    senate    | 10.1642881797 |  3.3880960599 |\n",
       "| presidential |  7.3869554189 | 3.69347770945 |\n",
       "|  president   | 7.22686929133 | 9.03358661416 |\n",
       "|    policy    | 6.09538628214 | 3.04769314107 |\n",
       "|    states    | 5.47320098963 | 1.82440032988 |\n",
       "|    office    | 5.24817282322 | 2.62408641161 |\n",
       "|     2011     | 5.10704127031 | 3.40469418021 |\n",
       "+--------------+---------------+---------------+\n",
       "[47 rows x 3 columns]\n",
       "Note: Only the head of the SFrame is printed.\n",
       "You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns."
      ]
     },
     "execution_count": 61,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "combination2_words = combination2_words.rename({'weight':'Obama', 'weight.1':'Schiliro'})\n",
    "combination2_words\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 62,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div style=\"max-height:1000px;max-width:1500px;overflow:auto;\"><table frame=\"box\" rules=\"cols\">\n",
       "    <tr>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">word</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">Obama</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">Schiliro</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">43.2956530721</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">9.62125623824</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">law</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">14.7229357618</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">7.36146788088</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">democratic</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">12.4106886973</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">6.20534434867</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">senate</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">10.1642881797</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">3.3880960599</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">presidential</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">7.3869554189</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">3.69347770945</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">president</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">7.22686929133</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">9.03358661416</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">policy</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">6.09538628214</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">3.04769314107</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">states</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">5.47320098963</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">1.82440032988</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">office</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">5.24817282322</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">2.62408641161</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">2011</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">5.10704127031</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">3.40469418021</td>\n",
       "    </tr>\n",
       "</table>\n",
       "[47 rows x 3 columns]<br/>Note: Only the head of the SFrame is printed.<br/>You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns.\n",
       "</div>"
      ],
      "text/plain": [
       "Columns:\n",
       "\tword\tstr\n",
       "\tObama\tfloat\n",
       "\tSchiliro\tfloat\n",
       "\n",
       "Rows: 47\n",
       "\n",
       "Data:\n",
       "+--------------+---------------+---------------+\n",
       "|     word     |     Obama     |    Schiliro   |\n",
       "+--------------+---------------+---------------+\n",
       "|    obama     | 43.2956530721 | 9.62125623824 |\n",
       "|     law      | 14.7229357618 | 7.36146788088 |\n",
       "|  democratic  | 12.4106886973 | 6.20534434867 |\n",
       "|    senate    | 10.1642881797 |  3.3880960599 |\n",
       "| presidential |  7.3869554189 | 3.69347770945 |\n",
       "|  president   | 7.22686929133 | 9.03358661416 |\n",
       "|    policy    | 6.09538628214 | 3.04769314107 |\n",
       "|    states    | 5.47320098963 | 1.82440032988 |\n",
       "|    office    | 5.24817282322 | 2.62408641161 |\n",
       "|     2011     | 5.10704127031 | 3.40469418021 |\n",
       "+--------------+---------------+---------------+\n",
       "[47 rows x 3 columns]\n",
       "Note: Only the head of the SFrame is printed.\n",
       "You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns."
      ]
     },
     "execution_count": 62,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "combination2_words = combination2_words.sort('Obama', ascending=False)\n",
    "combination2_words"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The first 10 words should say: Obama, law, democratic, Senate, presidential, president, policy, states, office, 2011."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Quiz Question**. Among the words that appear in both Barack Obama and Phil Schiliro, take the 5 that have largest weights in Obama. How many of the articles in the Wikipedia dataset contain all of those 5 words?\n",
    "\n",
    "**Answer**.14"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 65,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'democratic', 'law', 'obama', 'presidential', 'senate'}"
      ]
     },
     "execution_count": 65,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "common_words = set(list(combination2_words[:5]['word']))\n",
    "common_words\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 67,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, ... ]\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "14"
      ]
     },
     "execution_count": 67,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# common_words = common_words\n",
    "\n",
    "def has_top_words(word_count_vector):\n",
    "    # extract the keys of word_count_vector and convert it to a set\n",
    "    unique_words = set(word_count_vector.keys())   \n",
    "    # return True if common_words is a subset of unique_words\n",
    "    # return False otherwise\n",
    "    return common_words.issubset(unique_words)  # YOUR CODE HERE\n",
    "\n",
    "wiki['has_top_words'] = wiki['word_count'].apply(has_top_words)\n",
    "\n",
    "# use has_top_words column to answer the quiz question\n",
    "print wiki['has_top_words']  # YOUR CODE HERE\n",
    "sum(wiki['has_top_words'])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Notice the huge difference in this calculation using TF-IDF scores instead  of raw word counts. We've eliminated noise arising from extremely common words."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Choosing metrics"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "You may wonder why Joe Biden, Obama's running mate in two presidential elections, is missing from the query results of `model_tf_idf`. Let's find out why. First, compute the distance between TF-IDF features of Obama and Biden."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "-"
    }
   },
   "source": [
    "**Quiz Question**. Compute the Euclidean distance between TF-IDF features of Obama and Biden. Hint: When using Boolean filter in SFrame/SArray, take the index 0 to access the first match.\n",
    "\n",
    "**Answer**. 123.297"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 68,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "obama = wiki[wiki['name'] == 'Barack Obama']['tf_idf'][0]\n",
    "biden = wiki[wiki['name'] == 'Joe Biden']['tf_idf'][0]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 69,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "123.29745600964296"
      ]
     },
     "execution_count": 69,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "graphlab.toolkits.distances.euclidean(obama, biden)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The distance is larger than the distances we found for the 10 nearest neighbors, which we repeat here for readability:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 71,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<pre>Starting pairwise querying.</pre>"
      ],
      "text/plain": [
       "Starting pairwise querying."
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>+--------------+---------+-------------+--------------+</pre>"
      ],
      "text/plain": [
       "+--------------+---------+-------------+--------------+"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>| Query points | # Pairs | % Complete. | Elapsed Time |</pre>"
      ],
      "text/plain": [
       "| Query points | # Pairs | % Complete. | Elapsed Time |"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>+--------------+---------+-------------+--------------+</pre>"
      ],
      "text/plain": [
       "+--------------+---------+-------------+--------------+"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>| 0            | 1       | 0.00169288  | 20.975ms     |</pre>"
      ],
      "text/plain": [
       "| 0            | 1       | 0.00169288  | 20.975ms     |"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>| Done         |         | 100         | 642.279ms    |</pre>"
      ],
      "text/plain": [
       "| Done         |         | 100         | 642.279ms    |"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>+--------------+---------+-------------+--------------+</pre>"
      ],
      "text/plain": [
       "+--------------+---------+-------------+--------------+"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<div style=\"max-height:1000px;max-width:1500px;overflow:auto;\"><table frame=\"box\" rules=\"cols\">\n",
       "    <tr>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">query_label</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">reference_label</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">distance</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">rank</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">0.0</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Phil Schiliro</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">106.861013691</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Jeff Sessions</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">108.871674216</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Jesse Lee (politician)</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">109.045697909</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Samantha Power</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">109.108106165</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Bob Menendez</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">109.781867105</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Eric Stern (politician)</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">109.95778808</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">7</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">James A. Guest</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">110.413888718</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">8</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Roland Grossenbacher</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">110.4706087</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">9</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Tulsi Gabbard</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">110.696997999</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">10</td>\n",
       "    </tr>\n",
       "</table>\n",
       "[10 rows x 4 columns]<br/>\n",
       "</div>"
      ],
      "text/plain": [
       "Columns:\n",
       "\tquery_label\tstr\n",
       "\treference_label\tstr\n",
       "\tdistance\tfloat\n",
       "\trank\tint\n",
       "\n",
       "Rows: 10\n",
       "\n",
       "Data:\n",
       "+--------------+-------------------------+---------------+------+\n",
       "| query_label  |     reference_label     |    distance   | rank |\n",
       "+--------------+-------------------------+---------------+------+\n",
       "| Barack Obama |       Barack Obama      |      0.0      |  1   |\n",
       "| Barack Obama |      Phil Schiliro      | 106.861013691 |  2   |\n",
       "| Barack Obama |      Jeff Sessions      | 108.871674216 |  3   |\n",
       "| Barack Obama |  Jesse Lee (politician) | 109.045697909 |  4   |\n",
       "| Barack Obama |      Samantha Power     | 109.108106165 |  5   |\n",
       "| Barack Obama |       Bob Menendez      | 109.781867105 |  6   |\n",
       "| Barack Obama | Eric Stern (politician) |  109.95778808 |  7   |\n",
       "| Barack Obama |      James A. Guest     | 110.413888718 |  8   |\n",
       "| Barack Obama |   Roland Grossenbacher  |  110.4706087  |  9   |\n",
       "| Barack Obama |      Tulsi Gabbard      | 110.696997999 |  10  |\n",
       "+--------------+-------------------------+---------------+------+\n",
       "[10 rows x 4 columns]"
      ]
     },
     "execution_count": 71,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "model_tf_idf.query(wiki[wiki['name'] == 'Barack Obama'], label='name', k=10)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "But one may wonder, is Biden's article that different from Obama's, more so than, say, Schiliro's? It turns out that, when we compute nearest neighbors using the Euclidean distances, we unwittingly favor short articles over long ones. Let us compute the length of each Wikipedia document, and examine the document lengths for the 100 nearest neighbors to Obama's page."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 72,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "def compute_length(row):\n",
    "    return len(row['text'])\n",
    "\n",
    "wiki['length'] = wiki.apply(compute_length) "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 75,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<pre>Starting pairwise querying.</pre>"
      ],
      "text/plain": [
       "Starting pairwise querying."
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>+--------------+---------+-------------+--------------+</pre>"
      ],
      "text/plain": [
       "+--------------+---------+-------------+--------------+"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>| Query points | # Pairs | % Complete. | Elapsed Time |</pre>"
      ],
      "text/plain": [
       "| Query points | # Pairs | % Complete. | Elapsed Time |"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>+--------------+---------+-------------+--------------+</pre>"
      ],
      "text/plain": [
       "+--------------+---------+-------------+--------------+"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>| 0            | 1       | 0.00169288  | 25.927ms     |</pre>"
      ],
      "text/plain": [
       "| 0            | 1       | 0.00169288  | 25.927ms     |"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>| Done         |         | 100         | 658.686ms    |</pre>"
      ],
      "text/plain": [
       "| Done         |         | 100         | 658.686ms    |"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>+--------------+---------+-------------+--------------+</pre>"
      ],
      "text/plain": [
       "+--------------+---------+-------------+--------------+"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "nearest_neighbors_euclidean = model_tf_idf.query(wiki[wiki['name'] == 'Barack Obama'], label='name', k=100)\n",
    "nearest_neighbors_euclidean = nearest_neighbors_euclidean.join(wiki[['name', 'length']], on={'reference_label':'name'})"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 76,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div style=\"max-height:1000px;max-width:1500px;overflow:auto;\"><table frame=\"box\" rules=\"cols\">\n",
       "    <tr>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">query_label</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">reference_label</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">distance</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">rank</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">length</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">0.0</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">1</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">3278</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Phil Schiliro</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">106.861013691</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">2</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">1288</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Jeff Sessions</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">108.871674216</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">3</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">1398</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Jesse Lee (politician)</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">109.045697909</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">4</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">1374</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Samantha Power</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">109.108106165</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">5</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">1911</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Bob Menendez</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">109.781867105</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">6</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">1222</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Eric Stern (politician)</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">109.95778808</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">7</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">1589</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">James A. Guest</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">110.413888718</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">8</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">1251</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Roland Grossenbacher</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">110.4706087</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">9</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">1099</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Tulsi Gabbard</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">110.696997999</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">10</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">1352</td>\n",
       "    </tr>\n",
       "</table>\n",
       "[100 rows x 5 columns]<br/>Note: Only the head of the SFrame is printed.<br/>You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns.\n",
       "</div>"
      ],
      "text/plain": [
       "Columns:\n",
       "\tquery_label\tstr\n",
       "\treference_label\tstr\n",
       "\tdistance\tfloat\n",
       "\trank\tint\n",
       "\tlength\tint\n",
       "\n",
       "Rows: 100\n",
       "\n",
       "Data:\n",
       "+--------------+-------------------------+---------------+------+--------+\n",
       "| query_label  |     reference_label     |    distance   | rank | length |\n",
       "+--------------+-------------------------+---------------+------+--------+\n",
       "| Barack Obama |       Barack Obama      |      0.0      |  1   |  3278  |\n",
       "| Barack Obama |      Phil Schiliro      | 106.861013691 |  2   |  1288  |\n",
       "| Barack Obama |      Jeff Sessions      | 108.871674216 |  3   |  1398  |\n",
       "| Barack Obama |  Jesse Lee (politician) | 109.045697909 |  4   |  1374  |\n",
       "| Barack Obama |      Samantha Power     | 109.108106165 |  5   |  1911  |\n",
       "| Barack Obama |       Bob Menendez      | 109.781867105 |  6   |  1222  |\n",
       "| Barack Obama | Eric Stern (politician) |  109.95778808 |  7   |  1589  |\n",
       "| Barack Obama |      James A. Guest     | 110.413888718 |  8   |  1251  |\n",
       "| Barack Obama |   Roland Grossenbacher  |  110.4706087  |  9   |  1099  |\n",
       "| Barack Obama |      Tulsi Gabbard      | 110.696997999 |  10  |  1352  |\n",
       "+--------------+-------------------------+---------------+------+--------+\n",
       "[100 rows x 5 columns]\n",
       "Note: Only the head of the SFrame is printed.\n",
       "You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns."
      ]
     },
     "execution_count": 76,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "nearest_neighbors_euclidean.sort('rank')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "To see how these document lengths compare to the lengths of other documents in the corpus, let's make a histogram of the document lengths of Obama's 100 nearest neighbors and compare to a histogram of document lengths for all documents."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 77,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAt4AAAEuCAYAAAC57hXbAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzs3XmcjWX/wPHP9wzGGDszRnZKE5LsS8zYIsqSpXpatNIi\nKZJQDVlSD8qjVUWLikjSgyhLMcaSXwstesRE1lCWYTQz398f95nT2WYfM8r3/Xrdr5lz3d9rue9z\nzsx1rnPd1y2qijHGGGOMMebschV2A4wxxhhjjDkfWMfbGGOMMcaYAmAdb2OMMcYYYwqAdbyNMcYY\nY4wpANbxNsYYY4wxpgBYx9sYY4wxxpgCYB1vYwwAInKriKSJyC2FUHeMu+7H/dLTRGRlQbfHq/7V\nIpJWWPXnlYh0F5EEEfnDfS6n5qGsQn0uzncisktEfi7sduTFP+EYjMkr63gb8w8iIjXcHSTv7YSI\n7BGR5SIyWkSqZJBd3Vtu685rxyxP9eeGiMS5290ukzb9LTveIlIbWABUBV4G4oBlhdkmk6cPc+f8\nTTey+X4y5rxWpLAbYIw5K7YD77h/Lw5EAa2AccAYEXlUVZ/1y/MBsB7YV2Ct/MsG4BLgtwKuN6vO\n/s1AiQJqS37rABQFHlTV9wu7McajwD9gFqB/8rEZky+s423MP9N2VR3nnygiVwGzgCkiclxVX0vf\np6rHgeMF2EYPVT2N82GhoElmO1V1T0E15Cy4wP3zQKG2wpxPMn0/GWNsqokx5xVVXQr0xfkHOUlE\nwtL3iciAYHO8RaSTe5rKXhE5LSL7RGSliFzn3h/j/upcgVi/aS63uGM888dFpKeIrBOR4yKyxbsM\n/zneXm2oLiLvi8hh99SZz0SkWZC4DOeQ+n/FLyKrgPT6Vnu1+eeM8nilR4jIDHd9ye5zM1tEambU\nJhEJF5HnRORX93n8WkT6BGtrRrJTb/p0I5ypJeJ1bKkiUj0bdfQTkf8TkVPuKUrPiEjxTOIbisgC\nETnoPq7tIjJeRMIziO8gIou94neKyFsiUs8rJsPpGO7jTfM+Fu/Xrvv1tVFETrrP00NecQ+723dK\nRLaJyNUZ1FFJRKaLyA53G/e721gzSGya+/0QKSJvuI8rSUTWi0iMfyzQzvnV533yekbnNysiUsp9\nvr93H9dvIrJQRBoGic3xa1FEGovICvf79Yj7fVg9N+8nr9g8vxeM+buyEW9jzjOqulZEPgfaAh2B\nj713e8e6OyaLcKafLAIO40xbaQr0AeYCu3A6eXHu32d7FfGVV7kKXO+u8yPgc7L3N6gc8AXwK/AS\nzpzl64A1ItJBVRMyar8f/6/BZ7l/tnO3eZf78e+Z5EFEIoCNQHVgBTAHuBhnWko3EblCVbf7lVEU\nWA6UBebjTF+5HpgrIl1V9dNM2p3Ten/HeS5igRjgDfexqd+xBavjduBV4Ij752ngWiA6g/gYYAnO\nIM5cYC/QHhgFXCkibVU12St+GPAMcAxY6I6vhjMtZhPwnTs0sykLGe1TnNdkB3fZa91tf0ZEkoAG\nQA+c17sLuAlYICL1VHWHVxsvBNYAke5jm+9uYz+gi4i0UNWdfnWXddf3O/CWO+/1wDIRaaKq6ccV\nB9yG8xzG8dcI8VfkgohUwHlvXAysch9bBfd56CwiHVV1g985yvZrUUQux3mfFsV5fnfjvF/W4rxG\ncvp+Iif1G/OPpKq22WbbP2QDauBcDPhRFnFjgVQgzittgDvtFq+0BcApoEKQMsr5PU4DVmZQ3wD3\n/j+BtkH2x7j3Px6kzFTgdb/0Du59X/ml7wR+zqANq4BUv7Qn3OW3y0Ge2e48o/3Sb3W36bMgbUp1\nn8siQY5hSTaf25zWm+mxBSm/NPAHcBSo7pVeAtjqLmulV7oL2AGkAFf4lTXLHf+YV9pl7tifgSi/\neBcQkdl5D1K2dxvTX1+ngIZe6Re40466j6Gs175r3Xmm+5W/3p2njV96C+AMfu8tr9eofzm3u/e9\nkNVrKpvPT8BrG3jXXXd/v/TaOB3er/PyWgTWueO7+aW/mn7cOXw/5ct7wTbb/s6bTTUx5vy0F2e0\nrWI2Yv/E+WfpQ1WP5qLeD1T1ixzmSQUe86t7Jc6o76Uiclku2pErIlIM6A8cxBm59W7TbJzOXayI\nVA2S/UFVTfGKXwkkAgFTZvK53uzqCZQCXlHVX7zKTwImEDh/9wqgFk5HdK3fvlE4r5sBXml3u8sY\nrar7/Y4hTVUP5aHt6d5S1W+8yt2LMzpbGpioqt6jrwtxOtKXpie4R3hbAK+p6jq/Nm7A+dbnKhEp\n5VfvSWCkX9obOB80snx+c8M92t0PWKqq8/za+jMwE2jgPYXHS5avRRGpgXNB9gZVXeKX/wmcY8ut\nXL8XjPm7s6kmxpjMzAV6AVtF5F1gJbBOVY/lsrwvc5EnUVV/DZK+FuiEM5L6dS7bk1MX46wSs1xV\nzwTZvwao726T94WZv3t3Zr3sAVqexXpz4jKcqQPrguzz71h7x3/uv0NV94nIT0A9EQlX1ZM405PA\n+cB0tnwTJG1fsH2qqiJyiL8uQgWn0w1QVUSeCFJWZZzR+YuALV7p290fULzLTxWRAzhTKs6GZu62\nhGfQ1kvcP6P5awoPZP+1mP6BNsE/UFV/FZFfcD545VRe3wvG/K1Zx9uY81N6ZyPTUUZVnSciZ4CH\ngKHun6kisgxn1GpHZvmDyM0KGwczKUuAMrkoM7dKe9UdzH6/uHR/ZBCfQvYucs9tvTmRfh6DvSaC\n1ZudNtVzx510l5+iqmdryUjFmTvuL/3bmmD7UnDmHKcr7/55jXvLqB7/C0cz+iCaAoRksC+v0tva\nzr1lxL+t2X0tpo/qZ/Q34iC563jn9b1gzN+avciNOT/F4HQgNmcVqKofqmo7nH/0V+Nc1Hc1sERE\ncvLhPbdr/EZmkF7JXZ73P/I0Mh5QyI8OenoHq1ImbfKOyy8FUW/6eYzIpHz/NkkO2vQ7UEREsjO9\nKQ1ARIL9jzqbH7TS23q3qoZksBXJxXSpsyG9rZMzaWuIqr6Vy/LTlxYN9nqAjN+XxphMWMfbmPOM\niLTFGSE7hDN1JFtU9biqLlXV23Dmul7IX19ng9NZOhujezUk+N0227p/ek8zOQpE+nfYRKQEzvQA\nf+mjodlt9484K300F5GiQfanjzzm99SXgqj3a5yO9BVB9rUNkpa+EkfAaKuIRAF1cS4GPOlO3uT+\neWU22pJ+/YDP8y4iwl9TIM6Gje6frc5iHangOZa82ITzwfNsTc9Ify0FlC8iF+CszOIvp+8nY847\n1vE25jwiIt1wVhRQYJSqnsoi/oognVjhr1Gw0167juAs9ZffQoDxfm3oiDO/+1tV9e5sbsKZOnCj\nXxlPEfiVOzhtFpzl4rLknl89F2c0d5hfmwYADYFVms833imgej/CGeW8S3zXBS+Jc7Gk/7cVa3FW\nKOkhIm389k3EeR7e8Ep7xV3GBHfHzfsYQtzLJabbhPO83OpX7jByN70hW1R1I07n+2YR6em/X0SK\nBDnWnDri/pmt11xGVPUAznJ8MSIyOFiMZHzr9uyUn4gzv7uFODfe8jaW4N8s5ej9ZMz5qFDmeLuv\nvH8W5x+nAJ8CQ1V1dzbyhuL8E74R56KVr4BH/L/6c3cORgIDcdYd/hEYp6ofZFJ2a5x/JgoUVdU0\nv/29cG4QcAnOvMaZwCT/OGPOAXW9LrgKxXkPtMYZhTyNMz872E07/Efh/gNEicg6nHV5BWed5suA\nxar6k1fsSqCfiCwE/g9n9GuRqm7NoOzs+gZoLyLxwGr+WlP5FDDIL3YGzjrJr4nIlTij+m1xpid8\njdNB9bYK5/0+SUQa4Ey3+F1Vn8+kPSNwpupMcK9jvQXnArZe7vruzd1hZums1quqf4jIgzh/174U\nkfdwzvG1OKum1POLV/e630uBT0VkHs5a67E4o6Sb8FqBRVW/FpER7rTvReQDnNV1quCs7f4MMN0d\nPst9vHHulUZ24FycWR/nQtJgHcr8umviv3BeywtFZC3OazkFZ6nOtjhr2QdbKSS7VuLcxOoDEVmK\n8378WlU/zjxbUPfgXHj7nIjcBmwATuCMRrfEmQ5SIg9tHYxz8eyH7uf3F5xzUAPnfdnALz437ydj\nzi8FvX4hEAb8hPOmTb+A5Rt3Wlg28s/B+VR9O04HYAGQhNfare64CTj/NB7E+Wf1Ik5HoGsG5RZx\nt+NXd5zLb38XnD++L7rLG+ouf1JBn0PbbMtow/mHmOq3ncC58cUnOB9GL8ggb7B1vPsB77nfnyeA\n33BGBO/Fax1ed2wlnHWFD/DXEoS3ZFS2X94Y/NZ9dqenAp/hdLbnues/gbMyRtNMyop3/104iNOJ\nq4jTKUgJEn8zzgf4JHd9P3vtyyhPRZxO4i6cjtNedz01gsTuBHZk0Nag5Wfy/Oak3hyt4+2Vry9O\npz7J/bp5GufDWyp+a4W74xvijLwecrdpO/AkUCKD8jvh3JjmsLuOn3HWKL/EL+5SnButHMeZerIA\nZ33qWTh/i/3X8Q76+goWn9Vzg3PTpgk4HzhO4sxP34bzoaR9sNdoBscaUD7ONziT3PuSCbJOfXbL\ncqeH4byvv3Sfq2M4A01zgJ55fS0Cjb2eh8PA+zgd+2+Aozl8P+Xbe8E22/6um6jm5lqn3BORB4B/\nA3XVffcv99eaPwEPq+qzmeS9DGf04VZVfdOdFoLzB/EHVe3lTovA+YcxUVXHeeX/FKioqo2ClD0K\n5+5ZHwGP4jfiLc6trX9X1Q5eaY8Bo3H+oGe08oIxxhjzjyEi4Tgfar9VVVsC0JgcKIw53tcACep1\ny11V3YWzdmzAnDo/PXBueOC5WYCqpuKMyHXxuuioK878wjl++d/GueFGDe9EEamD04G+B2ekDr/9\nVYFG7vze3gKKAf7z34wxxpi/Nfec9gp+aYLzLUhx4MNCaZgxf2OFMce7PsHfrNtwvuLMTD1gp6qe\n9kvfhtMBvhD43h2XrIFrDG/DmQdYD+cuWeleAuaq6joR6ZRBm9Wd30NVd4lIEnmb72eMMcaci8oA\ne0RkOe7poDir3lyKc1Oe6ZnkNcYEURgd7/L8tVSUtyM48+pymzd9f/rP37MRh4jcBFyOM80ks3rJ\noO6j3uUZY4wx/xAngNdxLn6NxZnrvxuYCoxXv7t1GmOydl7fuVJEygNTgEdV9XBht8cYY4w5V6hq\nMnBfYbfDmH+Swuh4HyX4yHZGo9n+eYMt2p8+4nzEK65sNuLG46wKMF9E0u+GFub+WVZETrs/0ae3\nK1i7y3mV50NECvbKVWOMMcYYk2Oqml9LkmaqMC6u3IYzZ9pfPZw5Y1nlrSUixf3S6+NcdPk/r7hQ\nEakdJE696rkEZymswzid66M4a8cKzrJl6RdTps8N92m3+yLNEpm1u7CXrTnXtieeeKLQ23CubXZO\n7JzYObFzYufDzomdk8LbClJhdLw/Alr63RmtJtAG5zbUmVmMcxFlP6+8IUB/4BNVTV+RZBnOuq3+\nd6+7Cdiqzh25AB7AWQs81mt7A6dz3gEYA6DOjX2+DlLezTgd/qVZtNsYY4wxxpznCmOqyUycOWOL\n3OtgA4zDWWXklfQgEamOc2OFOFUdD6CqX4nIXOBZESmGsxj/vUBN4Ib0vKp6SESmAo+KyAmcm0Fc\nj9OxvsYr7hv/xolIe/evn6vvHSlHAYtF5CWcm4Q0xlmC8Fm1NbyNMcYYY0wWCrzjrapJItIBmAa8\nyV+3jH9Qfa+QFq/N2604dxR7Emce99dAF1X92i9uFM6dtobw1y3j+6lqdkanA753UNWlItIX525w\nA3DuzjcemJiN8oxbbGxsYTfhnGPnJJCdk0B2TgLZOfFl5yOQnZNAdk4KV4HfufJ8IiJq59cYY4wx\n5twlIug/+OJKY4wxxhhjzjvn9Trexphzl4z1HXzQJ+zbo3OJc+fwv9i3e8YYkzXreBtjjClQNWvW\nJDExMetAY4zJJzVq1GDXrl2F3QzreBtjjClYiYmJNkJujClQ/t/SFRab422MMcYYY0wBsI63McYY\nY4wxBcA63sYYY4wxxhQAW8f7LLJ1vI0xJpB7zdzCboYx5jyS2d8dW8fbGGOMOYfFxcURERFR2M3w\nMXPmTBYtWhSQXqtWLUaMGHHW6o2Pj6dJkyaEhYUREhKSYZzL5fJsISEhVKlSheuvv/6cWGnCX/v2\n7enfv3+u8m7bto3rrruOSpUqERYWxsUXX8wTTzxBUlKST9zs2bNxuVwB6eafzTrexhhjTA6JyDmz\nSkK6V155JWjH+2wbNGgQ5cqVY8WKFaxfvz7T2IcffpiEhATi4+OZMmUKW7Zs4eqrryYtLa2AWnt2\nrVq1iubNm/Prr7/y/PPPs3z5cu6++26ef/55YmNjfTrZ5+JryJx9tpygMcYYY3Lthx9+YNCgQVxx\nxRVZxtaoUYPmzZsD0KJFC8qUKcPVV1/N9u3biY6OzlM7kpOTCQ0NzVMZeXHq1CluuukmmjVrxmef\nfeYZ/W/bti2dOnWiSZMmjBkzhqlTpxZaG03hsxFvY4wx5iw4evQoAwcOJCoqirCwMNq0acPGjRt9\nYlwuF9OnT2f06NFERkZSqVIlBg8ezJ9//ukTt3r1ai677DLCwsJo0aIFmzZtIiIignHjxgHO1Igv\nv/zSM30hJCSEN99806eMZ599lmrVqlG+fHluuOEGjh07luUxrFy5kpYtWxIWFkZUVBT33XcfJ0+e\nBGDNmjW4XC7S0tIYMmQILpeL22+/PUfnqGTJkgA+x7tkyRKuvPJKKlWqRJkyZWjVqhUrVqzwyZc+\n1WfdunU0b96csLAw5s+fT1JSEvfffz/R0dGEh4dTu3ZtBg8ezPHjx33yp6WlMWnSJC6++GKKFy9O\ntWrVMm37sWPHaNOmDZdffjmHDx8OGjNv3jz279/PhAkTAqbcXHrppdx00028+uqrnD592mffd999\nR7t27ShRogQXX3wxH374oc/+nJyPjRs30qxZM0qUKEHbtm1JTEzk0KFD9O7dm1KlSlGvXj1WrVrl\nk/ett96ibdu2VKhQgfLly9OhQwe+/PLLDM+FyRvreBtjjDknpX8V77/lV/zZdObMGTp27MjKlSuZ\nMmUKixYtIiIigs6dO3Pw4EGf2KlTp7Jv3z7mzJnDiBEjePnll3nuuec8+/fu3Uv37t2JiopiwYIF\nDBo0iBtvvNGnA/fCCy8QHR1N9+7dSUhIYP369XTv3t2zf+7cuaxcuZKZM2fy9NNP8/HHHzNq1KhM\nj2Hbtm1cddVVREZG8sEHHzBu3Djeeecd+vXrB0CTJk1ISEhAVRk+fDgJCQk89thjmZaZlpZGamoq\nKSkpbN++nbi4OOrWrUuDBg08MTt37qR79+689dZbfPDBB7Rp04Zu3br5TGMREZKSkrj11lu56667\nWLZsGc2bNycpKYmUlBTGjx/PsmXLGD9+PKtWrQqYrz1w4EDGjh3L9ddfz3//+1+mTp2a4VzrI0eO\n0LFjR1JTU1m9ejUVKlQIGvfFF19Qrlw52rRpE3R/r169OHnyJFu2bPGkqSrXX389vXr1YuHChTRs\n2JD+/fvz7bff5up8DBo0iIceeoj33nuP3bt3c9NNN3HDDTfQtm1bFi5cSJUqVejfv7/Pa2fXrl3c\ndNNNvP/++7z77rtUr16ddu3anZNz7/8RVNW2s7Q5p9cYkxvE4bOZcwvgs+U0b27qyKqunMbnRVxc\nnEZERGS4/9VXX9XQ0FDdsWOHJy01NVXr1KmjI0aM8KSJiMbGxvrk7dWrl7Zq1crzePjw4RoREaHJ\nycmetHnz5qmI6NixYz1pTZs21dtuuy2gLTVr1tQLL7xQU1NTPWlDhw7VypUrZ3qM1113ndatW1fT\n0tJ86nW5XJqQkOBzDM8//3ymZaXHuVwuFRHPVr16dd26dWuGedLS0jQlJUW7dOmid9xxhyc9Li5O\nXS6XLl68ONM6U1JSdN26depyuXT37t2qqvrDDz+oiOiMGTMyzBcbG6v9+vXTQ4cOacOGDbVt27Z6\n/PjxTOvq2rWrNm7cOMP9X331lYqIzps3T1VVZ8+erSKiTz31lM/xRkdH6w033BC0jKzOxxdffOFJ\ne+GFF1REdPz48Z607777TkVEly1blmn50dHR+uSTT2Z6vH83Wf3t0ALqG9qItzHGGJPPPvvsM5o0\naUKNGjVITU0lNTWVtLQ0YmJi2Lx5s09s586dfR7Xq1ePPXv2eB5v3ryZzp07U6xYMU9ajx49ctSe\n9u3b43L99S+/Xr16HDx4kNTU1AzzbNq0id69e/t8a9CnTx9CQkJYu3ZtjupPN2LECDZv3szmzZtZ\nsmQJl112GVdddRX79u3zxPz6668MGDCAqlWrUqRIEYoWLcry5cvZvn27T1kiQteuXQPqeOutt2jc\nuDGlSpWiaNGinrnn6flXrlyJiDBgwIBM27p//35iYmKIiIjgk08+8UyLyU8iQq9evXwe9+zZ02dK\nUnbPR7FixXzm2V944YWICO3bt/dJSy8z3ffff0/v3r2JiooiJCSEokWLsn379oDyTf4olI63iFQV\nkfki8ruI/CEiC0SkWjbzhorIMyKyV0SSRCReRNoGiRMReVREdorIKRH5SkSuDRI3S0S+c7fjuDtu\nsIi4gsSl+W2pImJXSRhjjPHx22+/sX79eooWLerZihUrxuzZs9m9e7dPbNmyZX0eFytWzGcqwP79\n+wOWLgwNDc1RRzBYHapKcnJyhnn27dtHpUqVfNJcLhcVKlTgyJEj2a7bW7Vq1WjcuDGNGzema9eu\nzJ8/n9OnTzNt2jTA+Rb+mmuuISEhgfHjx7N69Wo2b97MVVddFTA3uly5chQp4rtGxMKFCxkwYABt\n2rRh/vz5bNiwgYULF6KqnvxHjhwhPDw8y/P33Xff8cMPP3DzzTcTFhaW5bFVqVKFxMTEDPcnJiYi\nIlSpUsUnPTIyMuBx+geRnJyPUqVK+TxO/6Dm/dwXLVoUwJP3xIkTXHnllfz6669MmzaNtWvXsnnz\nZho2bBhQvskfBb6qiYiEAauAU8DN7uQJwEoRaaiqp7Io4nXgKmA4sBMYDHwiIi1V9RuvuPHAQ8Ao\nYAtwPfC+iHRX1WVecaHAdGAHzteSXYDngDrAg351HwSuAbwnDe6joBw6BM8+G5herBg88UTOynru\nOfCbZwjArbfCRRflqnnGGJOfNIc32clp/NlUvnx5mjVrxksvvRTQrpyuvBEVFcWhQ4d80pKTkzlx\n4kSe25mZypUrB8xHT0tL4/Dhw5QvXz5f6ihWrBi1a9fm+++/B+B///sfX331FZ988onPNwGnTgV2\nDYLN358/fz4tW7bkP//5jyft888/94mpUKECJ0+e5MSJE5l2vjt06MDll1/OXXfdRcWKFX3mzAfT\nrl07Zs2aRXx8PK1btw7Yv2jRIsLDw2nSpIlP+sGDBylXrpzP48qVKwM5Ox+5ER8fz969e1m5ciUX\nef3v/+OPP/KlfBOoMEa8BwI1gZ6qulhVFwM93GmDMssoIpcBNwBDVfV1VV0F9Ad+AcZ5xUUAw4BJ\nqjpNVdeo6j04Hf6nvMtU1X+p6kuqukJVP1XVh4G5QLDLm8+o6iZV3ei17Q4Sd3YkJcEnnwRun36a\n87LWrQteVgZXaxtjjMm+jh078r///c9nhDd9q1+/fo7KatasGStWrPAZnQ62Xrf/SHletWjRwjNa\nnG7BggWkpqZma+nA7Dh9+jQ7duygWjXnS+/0DqX3tJrExETWrVuXrfJOnToV8MHm7bff9umkd+jQ\nAVUNWPUlmEcffZRhw4bRt29fVq9enWlsv379iIqKYvTo0QFTeLZu3crbb7/NwIEDfdqnqixcuNDn\n8aJFi2jRooXneCD35yMr6a8X7/Lj4+PtwsqzqDDW8b4GSFDVnekJqrpLRNYBPYEgQ7oePYAzwDyv\nvKki8h7wiIgUVdU/ga5AUWCOX/63gddEpIaqZvx9EBwBUnJyUMYYY84vycnJLFiwICA9NjaWW265\nhZdeeomYmBiGDx9O7dq1OXz4MBs3bqRy5co88MAD2a5n6NChPP/881x99dU8+OCD7Nu3j8mTJxMe\nHu4zbzs6Oprly5ezfPlyKlSoQK1atfI0Mj1mzBgaN25Mz549ueeee9i9ezcjR46ka9euno5hTu3a\ntYsNGzYAcOjQIWbMmMGxY8e44447PMdQtWpVhg0bxrhx4zh27BhxcXFUrVo1W+V37tyZwYMHM3Hi\nRFq0aMGSJUtYuXKlT0zdunUZOHAgw4YN48CBA7Rr146jR4+yYMEC3n333YAyJ02axPHjx+nRowcr\nVqzI8NjDwsKYM2cOV199NbGxsQwZMoRKlSqxefNmJk2axOWXX+5Z/tHbq6++StGiRWnQoAEzZ85k\nx44dzJ07N1/OR1bfArVs2ZLw8HDuvPNORowYwe7duxk7dmy2yzc5Vxgd7/rAh0HStwF9s8hbD9ip\nqv4f6bcBxYALge/dccmquiNInLj3+3S8RSQEKAl0Am7Bb2TcLVJEDgFlgZ+B14B/q+o/45ZbxpxD\n9IlzZ9qACXQuTesoLCdOnAh6W/FVq1bRrl07Vq9ezeOPP05cXBwHDhwgMjKS5s2b07NnT09sdpY8\nvOCCC1iyZAkPPPAAffr04ZJLLmHWrFl06tSJ0qVLe+LGjBnD7t27ue666zh27BizZs3illtuyfWy\nivXq1WPp0qWMGjWKPn36ULp0aW688UYmT57sE5fd8kWEKVOmMGXKFMCZ8nHppZeyYsUKz/SLYsWK\nsXDhQu677z769etH1apVGT16NKtXr2br1q1Z1jFo0CB27tzJ9OnTOX36NFdeeSXvvvsuLVu29Il7\n8cUXqVmzJq+++iqTJ08mMjKSLl26BLQ33YwZMzh58iTdunVj9erVXHrppUHrj42NZePGjYwbN47B\ngwdz7NgxatSoweDBgxkxYkTAXHER4b333mPo0KE89thjVKtWjXnz5tGwYcN8OR/Bnhfv5ysyMpL5\n8+czfPhwevXqxUUXXcTLL7/M008/nWXZJnekoP94ikgyMEVVR/mlPwk8oqrFgucEEfkEKKWqrf3S\nOwLLgXZzwWtUAAAgAElEQVSquk5EXgauUdUL/OLqAD8BN6vqHK/07sBi98M04ClVHeOXdwiQitN5\nLw70Bu4EXlPVgRm0V/P1/CYmQp8+gelhYfDFFzkrq39/+PnnwPQZM8DvD5QxxuQnEbGOex6tXbuW\ndu3asWrVKmJiYgq7Ocac8zL7u+PeVyCL/tst4x2fA02BMkBH4GH3k+DpfKvqdL88y0TkJDBERJ5S\n1SC9WGOMMSbvRo4cyeWXX05UVBQ//PAD48ePp1GjRtbpNuZvpjA63keBckHSy7v3ZZW3egZ5wZmb\nnR5XNhtxAKjqcZyVTwBWicifwBgReV5VM1u15F1gKNAMZ+qJMcYYk++Sk5MZMWIEBw4coFSpUnTp\n0sUzZcMY8/dRGB3vbTjzvP3VA77LRt5eIlLcb553fZyLLv/nFRcqIrX9RqLr4ywZmFU9m3FWfKlF\nHpcLjIuL8/weGxtLbGxsXoozxhhzHpo2bZpnrWtjTN6sXr06y1VqzpbC6Hh/BDwjIjVVdReAiNQE\n2gAjssi7GBgL9APecucNwVlS8BP3iiYAy3BWJbkReNIr/03A1ixWNAGIxemgZzWKfRPOnPCNGQV4\nd7yNMcYYY0zh8h8IHTt2bIHVXRgd75nAfcAiEXnMnTYOZ5WRV9KDRKQ6Tsc3TlXHA6jqVyIyF3hW\nRIrh3EDnXpw1wG9Iz6uqh9x3lHxURE7w1w10YnGWM0yvoxtwG06H/hegFNAN56LJl1R1v1db3gDe\ncbcpDLgWZ/WTl7yXRjTG5A8Z63udi61ycm7xXy3BLpY0xpisFXjHW1WTRKQDMA14E2d5v0+BB1U1\nyStUvDZvt+Lc6fJJnHncXwNdVPVrv7hRwHFgCBAF/Aj0U9WlXjE73OU/CUQCv/PXqifvecUdx5k3\nPgqohDPK/QNwv6q+mMNTYIwxxhhjzkOFsqqJqu7BmS6SWUwiEBIkPRnndvHDs8ivwET3llHMj2S9\ndjiqehRnhNsYY4wxxphcKYxbxhtjjDHGGHPesY63McYYY4wxBcA63sYYY0wOxcXFERERUdjN8DFz\n5kwWLVoUkF6rVi1GjMhq0bDci4+Pp0mTJoSFhRESEjBD1MPlcvHCCy+ctXZ4e+ONN3C5XJ6tePHi\nREdHM2nSJNLS0jxxiYmJuFwulixZkml5M2bMwOWyLpPJO7tzpTHmnGSrmJzbzvdVTEQkYGWXwvbK\nK69w6aWX0rNnzwKtd9CgQVSqVIkVK1ZQrFixAq07MyLCqlWrKF68OKdPn+aLL77gscceQ0QYOXIk\nAJUrVyYhIYHo6OgsyzrXnm/z92Qdb2OMMcbk2g8//MCgQYO44oorCrspAZo2bUqJEiUAaNeuHd98\n8w0ffvihp+NdrFgxmjdvXphNNOcZ+97EGGOMOQuOHj3KwIEDiYqKIiwsjDZt2rBxo+/91lwuF9On\nT2f06NFERkZSqVIlBg8ezJ9//ukTt3r1ai677DLCwsJo0aIFmzZtIiIignHjxgHQvn17vvzyS2bP\nno3L5SIkJIQ333zTp4xnn32WatWqUb58eW644QaOHTuW5TGsXLmSli1bEhYWRlRUFPfddx8nT54E\nYM2aNbhcLtLS0hgyZAgul4vbb789R+doxowZ1K1bl+LFi3PRRRfx7LPPBsRs3bqV7t27U7p0aUqX\nLk3//v05cOBAjupJV6pUKZ9zG2yqyZkzZxg8eDDlypWjYsWKPPTQQwHPB+Tv82vOH9bxNsYYY/LZ\nmTNn6NixIytXrmTKlCksWrSIiIgIOnfuzMGDB31ip06dyr59+5gzZw4jRozg5Zdf5rnnnvPs37t3\nL927dycqKooFCxYwaNAgbrzxRk6fPu2JeeGFF4iOjqZ79+4kJCSwfv16unfv7tk/d+5cVq5cycyZ\nM3n66af5+OOPGTVqVKbHsG3bNq666ioiIyP54IMPGDduHO+88w79+jmrATdp0oSEhARUleHDh5OQ\nkMBjjz2WaZneZs6cyZAhQ+jVqxcff/wx/fv3Z9iwYTz99NOemB07dnDFFVdw5swZ5syZwxtvvMG2\nbdvo0aNHtupISUkhNTWVpKQkli5dyrx587j2Wt/Vgf2nkDzyyCO8/vrrPPHEE8yZM4dffvmFKVOm\n+MTk5/NrzjOqattZ2pzTm4927VJt0iRwu+KKnJfVr1/wstavz982G2OMn+z+bSSOoFt+xedFXFyc\nRkREZLj/1Vdf1dDQUN2xY4cnLTU1VevUqaMjRozwpImIxsbG+uTt1auXtmrVyvN4+PDhGhERocnJ\nyZ60efPmqYjo2LFjPWlNmzbV2267LaAtNWvW1AsvvFBTU1M9aUOHDtXKlStneozXXXed1q1bV9PS\n0nzqdblcmpCQ4HMMzz//fKZl+celpaVplSpV9I477vCJuffee7Vs2bKeY73ppps0OjpaU1JSPDE/\n/fSThoSE6JIlSzKsa/bs2SoiPpvL5dK+ffv6nIddu3apiOh///tfVVU9fPiwhoWF6TPPPOOJSUtL\n0+joaHW5XJ60/Hx+TcHI7O+Oe1+B9A1txNsYY4zJZ5999hlNmjShRo0apKamkpqaSlpaGjExMWze\nvNkntnPnzj6P69Wrx549ezyPN2/eTOfOnX0uXMzuiG+69u3b+6zKUa9ePQ4ePEhqamqGeTZt2kTv\n3r19RoT79OlDSEgIa9euzVH9/vbs2cPevXvp29f3HnbXXXcdx44d49tvvwWc89i7d28Az3msWbMm\nNWvWDDiP/kSEtWvXsnnzZhISEnjttddISEjgzjvvzDDPt99+S3Jyss/5FZGAC1bz8/k15xe7uNIY\nc06Ssb5f/9oqJ+cW/6/n9Txf5cTfb7/9xvr16ylatKhPuohQp04dn7SyZcv6PC5WrJjPNJL9+/dz\n2WWX+cSEhoZSsmTJbLcnWB2qSnJysufiQ3/79u2jUqVKPmkul4sKFSpw5MiRbNedUdkiElB+pUqV\nUFVP+b/99huTJ0/mqaee8okTEXbv3p1lPY0aNfIcX/PmzSlTpgx9+vRh+PDh1KtXLyB+//79AERG\nRvqk+z/Oz+fXnF+s422MMcbks/Lly9OsWTNeeumlgA8loaGhOSorKiqKQ4cO+aQlJydz4sSJPLcz\nM5UrVw6Yr5yWlsbhw4cpX758nstW1YDy0y+arFChAuCcx2uvvZa77ror4DxWrFgxx/VecsklAHz/\n/fdBO95RUVEAHDx40KfD7H8xZ34+v+b8Yh1vY4wx56ScfstxLn0r0rFjR0aOHEm1atVy1UH01qxZ\nM2bPnk1ycrKnUxfsRjn5PZLaokULFi5cyMSJEz3fcCxYsIDU1NQ8Lx1YtWpVLrjgAt5//326dOni\nSZ87dy5lypShQYMGgHMet23bxuWXX56n+tJ9++23iAjVqlULuv/SSy8lNDSURYsW8fDDDwPOtzn+\n5zs/n19zfrGOtzHGGJMLycnJLFiwICA9NjaWW265hZdeeomYmBiGDx9O7dq1OXz4MBs3bqRy5co8\n8MAD2a5n6NChPP/881x99dU8+OCD7Nu3j8mTJxMeHu4zbzs6Oprly5ezfPlyKlSoQK1atfI0Mj1m\nzBgaN25Mz549ueeee9i9ezcjR46ka9eutGjRIldlpnfgRYS4uDjuvvtuypcvT+fOnVm9ejUvv/wy\nkyZN8sxnj4uLo0WLFnTv3p3bb7+dihUrsmfPHj799FNuu+022rVrl2FdqsrGjRsJCwsjJSWF7777\njri4OJo1a0bTpk2D5ilfvjwDBw7k8ccfJyQkhPr16zNz5kzPEorpbrnlFl5++eV8eX7N+cU63sYY\nY0wunDhxgv79+wekr1q1inbt2rF69Woef/xx4uLiOHDgAJGRkTRv3tznQr3s3BHxggsuYMmSJTzw\nwAP06dOHSy65hFmzZtGpUydKly7tiRszZgy7d+/2XKA4a9YsbrnlllzfdbFevXosXbqUUaNG0adP\nH0qXLs2NN97I5MmTfeKyU376SLz3BaJ33nknycnJPPfcc0yfPp2qVasydepUhgwZ4om56KKLSEhI\nYMyYMQwaNIhTp05RpUoVOnbsyIUXXphpnSJCx44dAQgJCaFq1ar07NmTsWPH+nxg8W/7008/TUpK\nCk8++SQul4ubbrqJYcOGMWzYME9MaGgoq1atypfn15xfxC6IOXtERPP1/CYmQp8+gelhYfDFF8Hz\n3HILJCUFpu/ZAykpgekzZkDLlnlrpzH5wC6uPLfl5eJKEbGLMfNo7dq1tGvXjlWrVhETE1PYzcnS\n1q1badiwIZ988knAKh/GFITM/u649xXIJyQb8f6nS0wEv6/IjPk7sI72uc06zgVr5MiRXH755URF\nRfHDDz8wfvx4GjVqdM53uo8fP05CQgJPPfUUFStWpG3btoXdJGMKVaGs4y0iVUVkvoj8LiJ/iMgC\nEQl+pUNg3lAReUZE9opIkojEi0jAO1kcj4rIThE5JSJfici1QeJmich37nYcd8cNFpGAcyMivURk\ni7u8XSIyOlicMcYYk5+Sk5MZMWIEXbp0YcyYMcTExLB06dLCblaWtmzZQu/evTlz5gzLly+nePHi\nhd0kYwpVgY94i0gYsAo4BdzsTp4ArBSRhqp6KosiXgeuAoYDO4HBwCci0lJVv/GKGw88BIwCtgDX\nA++LSHdVXeYVFwpMB3YACnQBngPqAA96tbsLMB+Y6U6/HJgElAQezck5MMYYY3Ji2rRpTJs2rbCb\nkWMxMTFnfdlDY/5OCmOqyUCgJlBXVXcCiMi3wE/AIODZjDKKyGXADcCtqvqmO+1zYBswDujlTosA\nhgETVTX9L9UaEbkIeArwdLxV9V9+1XwqIlWA2/HqeON0sj9X1Xu8yisFjBaRaap6EGOMMcYYYzJQ\nGNMkrgES0jvdAKq6C1gH9Mwok1sP4AwwzytvKvAe0EVE0m8h1RUoCszxy/82cKmI1MiiniOA58pD\nEakKNHLn9/YWUAxnBN4YY4wxxpgMFUbHuz6wNUj6NiDwNlK+6gE7VdX/DgHbcDrAF3rFJavqjiBx\nEqweEQkRkTIi0ge4BZji12Z15/dwf2BIyka7jTHGGGPMea4wppqUB44GST8ClMtD3vT96T9/z0Yc\nACLSHVjsfpgGPKWqE/3qJYO6j/qXZ4zJO1tO8NyWl+UEjTHmfGXLCTo+B5oCZYCOwMPuNR3HFG6z\njDHGGGPMP0VhdLyPEnxkO6PRbP+81TPIC3+NaB8FymYjDgBVPY6z8gnAKhH5ExgjIs+r6j6vdgVr\ndzn/8rzFxcV5fo+NjSU2NjajUGOMMcYYc5atXr2a1atXF0rdhdHx3oYzZ9pfPeC7bOTtJSLF/eZ5\n18e56PJ/XnGhIlJbVX/2i9Ns1LMZZ/57LWAff80Nrw9sSA9yX6RZIrPyvDvexhhjjDGmcPkPhI4d\nO7bA6i6Miys/AlqKSM30BPfvbYBFWeRdjHMRZT+vvCFAf+ATVf3TnbwMZ1WSG/3y3wRsVdXELOqJ\nxemg/wygqruBr4OUdzNOh//cv4uBMcaYfDN27FhcLlfAFhISwjvvvJOjslasWMFzzz0XkH7bbbfR\nvHnz/GpygOrVqzNw4ECftJMnT1KkSBHq1q0bEN+mTRu6du0KwJo1a3C5XHz33V/jTi6XixdeeCHD\n+oLlOdv69etHhw4dPI/Hjh1LZGRkgdVvjL/CGPGeCdwHLBKRx9xp44BE4JX0IBGpjtPxjVPV8QCq\n+pWIzAWeFZFiODfQuRdnXfAb0vOq6iERmQo8KiIn+OsGOrE4yxmm19ENuA2nQ/8LUAroBtwJvKSq\n+73aPQpYLCIvAe8CjYHRwLO2hrcxxuRdu3btSEzMalwk/9WoUYPPP/88x/nKli3LJ598EnBh6YUX\nXphBjuCWL1/OggULeOCBB3zSH3/8cU6dyuqecrnXunVr4uPjfdI2bNhA8eLF2bFjB7/99hsVK1YE\n4M8//2TLli2MHj0agMaNG5OQkECdOnWyXV+TJk1ynCe/3XXXXfTo0aPQ6jemwDveqpokIh2AacCb\nOFM4PgUeVNUkr1Dx2rzdinOnyydx5nF/DXRR1a/94kYBx4EhQBTwI9BPVb1Hp3e4y38SiMRZCeUn\n4GZVfc+v3UtFpC/wBDAAOIBzd0zv1U+MMfnEVjE5t52NVUwSExOJiIjI93KzU29uFClShGbNmuW5\n/ozOZa1atbLMm5ycTGhoaK7qbdOmDfPnz+ePP/6gTJkyAKxfv56YmBi+//574uPjPZ3UL7/8kuTk\nZFq1agVAqVKlcjwaX7JkybM6gp8dF1xwARdccEGhtsGc3wpjqgmqukdV+6lqWVUto6p9VPUXv5hE\nVQ1R1Sf90pNVdbiqXqCqJVS1lap+EaQOVdWJqlpLVcNUtZGqLvSL+VFV+6pqDXdMZVVt59/p9or/\nUFUvd8fWVNUJamtoGWOMCSIxMRGXy8X777/P3XffTdmyZalWrZrPtT9jx45l6tSpnliXy8Xtt98O\nwK233urTsZ89ezYul4tNmzbRvn17SpQowb///W/A6YCPGDGC6tWrU7x4cRo1asTSpZnPgmzdujVp\naWmsX7/ekxYfH0/r1q1p1aqVz2h4fHw8RYoUoWXLlkD2po1s3bqVypUrM2DAAFQ1w+kp06ZNY+jQ\noVSoUIFy5coxZMgQUlJSfMravXs3119/PRUqVCA8PJyuXbuyfft2n5g9e/bQrVs3SpQoQe3atXnt\ntdcC2hQXF+fz4S4pKYn777+f6OhowsPDqV27NoMHD+b48eOZnjtjcsuWEzTGGGNyKTU1NSAtJCTE\n5/EjjzxCnz59WLBgAZ999hnjxo2jQYMG9O3blzvvvJOffvqJVatW8eGHH6Kqno6hiPisl57++7/+\n9S/uvfde4uLiKFvWWcCrT58+bN68mXHjxlG7dm3mzp1Ljx49+PLLL2nYsGHQtjdq1IgSJUoQHx/v\nmbudkJDAsGHDKF26NO+//74nNj4+nksvvZTw8PCA9gTzf//3f1x55ZX07duXF198MdM8U6dOpWXL\nlrzzzjts27aNUaNGERYWxuTJkwE4evQobdq0ISIigldeeYWwsDAmTZpE586d2b59u2fEv0ePHhw5\ncoRZs2YRGhrK448/zpEjR3zmq/uf06SkJFJSUhg/fjyVKlVi9+7dTJgwgf79+2f5wcWY3LCOtzHG\nGJMLv/32G0WLFvVJExF27txJ9ep/rXwbExPDM888A0DHjh1ZunQpH3zwAX379qVKlSpUrlyZ0NDQ\nbE9beeCBBxg8eLDn8WeffcbSpUtZs2YNV1xxBQCdOnVi+/btTJgwgblz5wYtJyQkhObNm3tGtr//\n/nuOHTtG8+bNKV26NCNHjiQlJYUiRYqwfv16rr322my1b8OGDVx11VUMGDCAadOmZRnv3cnv0qUL\np0+fZuLEiTz66KOULVuWqVOncurUKVauXOmZEtO6dWtq1qzJ66+/zj333MOSJUv4+uuv2bBhA02b\nNgWceeh16tQJeqFouooVK/p8MEhNTaVmzZq0bduWPXv2ULVq1WwdszHZVShTTYwxxpi/u7Jly/Ll\nl1+yefNmz7Zp06aAOcSdO3f2eVyvXj327NmTqzpFhG7duvmkffbZZ0RFRdGqVStSU1NJTU0lJSWF\nDh06sHnz5kzLa926NRs3bkRVWb9+PfXr16dkyZI0atQIVWXLli3s2rWLffv20aZNmyzbt3btWq68\n8kruvvvubHW6gYCLHa+99lqSkpLYunWr5/g6d+5MyZIlPcdXsmRJmjRp4jm+TZs2UalSJU+nG5xV\nW5o0aZJl/W+99RaNGzemVKlSFC1a1PPhxX8qizH5wUa8jTHGmFwoUqQIl19+eZZx6dNB0hUrVozT\np09nEJ21SpUq+Tz+7bff2LdvX8DoOxA0zVvr1q2ZNGkSX3/9NevXr6d169aAc2xNmjQhPj6eyMhI\nRCRbHe8VK1aQmprKzTffnO3j8V/eL/3xvn37AOf4NmzYwHvv+V5+JSJ06tQJgP379wddJjAyMpIT\nJ05kWPfChQsZMGAA9913H5MmTaJ8+fLs3buX3r175+k5MiYj1vE2xpyTZKzvXFBb5eTc4j9X164z\nLzj+5758+fJUrVqVRYsW5fh5SO9or1u3jvj4eEaOHOnZ16pVK9atW0elSpWoUqUK1apVy7K8MWPG\n8Omnn9K5c2fWrl1LzZo1s8xz8ODBoI/TvzkoX7489evX5/HHHw84vlKlSgEQFRUVUE56WSVKlMiw\n7vnz59OyZUv+85//eNJys7SkMdllU02MMcaYQpTXEfCOHTuyf/9+wsPDady4ccCWmbJlyxIdHc2S\nJUv48ccfPcsFgtPxXr9+vWelk+woWrQo8+fPp27dunTo0MEzap2ZRYt87523YMECSpQoQf369T3H\nt23bNurVqxdwbBdddBEAzZo148CBA2zatMlTzi+//MKWLVsyrfvUqVMByzG+/fbbmV44akxe2Ii3\nMcYYkwspKSls2LAhIL1atWo5Wis6OjqaAwcO8MYbb9CgQQMqVqxIjRo1sp2/c+fOXHnllXTq1IlH\nHnmE+vXrc+zYMb766iuSk5OZMGFCpvlbt27N66+/ToUKFXxu/tOqVSv27t3L/v37ue222wLyZTS6\nHhoayuLFi+nUqRMdO3bk888/99yIJ1ie48eP07dvX+666y62bt3K+PHjuf/++z1TdB566CHmzJlD\n+/btuf/++6lSpQoHDhxgzZo1tG3bluuuu45u3brRsGFD+vbty+TJkylWrBhxcXEB03KCnbvBgwcz\nceJEWrRowZIlS1i5cmWmeYzJC+t4G2OMMbnwxx9/BB0JfvLJJxk1ahSQ+ZJ76fr378/q1at55JFH\nOHToEAMGDOD111/PUVsWLlzIxIkTee655/jll18oX748jRo14v77788yb5s2bXj99dd9RrvBmb5R\no0YNdu/eHfQ4/Y/Ne6m+8PBwli5dSocOHejatSurVq0Kmgdg2LBh/Pzzz9xwww2oKnfddZfPh4UK\nFSqQkJDA6NGjeeihh/j999+pXLkyV1xxhc9SiYsXL2bgwIHccccdREZGMmrUKFasWMFvv/2W4bEP\nGjSInTt3Mn36dE6fPs2VV17Ju+++61mv3Jj8JjYv7+wRkfy9v05iIvTpE5geFgZfBNxDyBETAydP\nZr+OGTPA/uCYc4DN8T635WWOt4gEjf+73TLe5J3L5WLGjBnce++9hd0U8w+X0d8dr30FMr8oVyPe\nItIQaAdUAF5W1f0iciFwQFXtdk/GGGNyzDq/xph/uhx1vEUkFHgbuBYQQIHFwH7gaWA7MDLDAowx\nJptshPvcZt+WmvzgfydJY/7pcjriPQHoBNwMrAAOeO1bCtyLdbyNMcYYkw2pqamF3QRjClROO943\nAGNU9R0RCfHbtxOomS+tMsYYY4wx5h8mp+t4VwC+z6Ss0Az2GWOMMcYYc17Lacd7J9Aqg33NgR/z\n1hxjjDHGGGP+mXLa8X4TGCkiNwJF3WkqIu2BB4FsLTwqIlVFZL6I/C4if4jIAhHJ+l60Tt5QEXlG\nRPaKSJKIxItI2yBxIiKPishOETklIl+JyLV+MVEiMllEtrjbclBEPs2gvFkikua3pYrI1Oy02xhj\njDHGnN9yOsf7aeAy4C3gVXfaWqA48J6q/ierAkQkDFgFnMK5SBOcizZXikhDVT2VRRGvA1cBw3FG\n4AcDn4hIS1X9xituPPAQMArYAlwPvC8i3VV1mTumCdAPmAWsx/kwcS+wWkSuUdUlfnUfBK7BWdEl\nXdb3wzXG5Jit431uy8s63sYYc77KUcdbVVOB60XkeaALEAkcBpap6ppsFjMQ5yLMuqq6E0BEvgV+\nAgYBz2aUUUQuw7nA81ZVfdOd9jmwDRgH9HKnRQDDgImqOs2dfY2IXAQ8BaR3vL8ALnIfV3ody93l\njQD8O95nVHVTNo/TGGOMMcYYj1zdQEdVv8DptObGNUBCeqfbXd4uEVkH9CSTjjfQAzgDzPPKmyoi\n7wGPiEhRVf0T6Iozej3HL//bwGsiUkNVE1X1WJBjSxWRr3BGw40xxhhjjMkXOZ3jnR/qA1uDpG8D\n6mWRtx6wU1VPB8lbDLjQKy5ZVXcEiZPM6hGRojgXkH4XZHekiBwSkT9F5EcRGSEihXEOjTHGFKId\nO3YwaNAgLrvsMooUKUKHDh0yjJ04cSLVq1enRIkSxMTE8PXXXwfEfP/993Ts2JHw8HCqVKnCE088\nkeX0nTVr1uByuYiIiCApKcln34wZM3C5fP89uVwuXC4XGzZs8Enftm0bLperQO4cun//frp160bZ\nsmUJCQnJtM6kpCTi4uKIjo4mLCyMyMhI+vfvz7Zt2wJiXS4XL7zwwtls+lnXo0cPnnzySc/j2267\nzfOceW8hISHEx8fna91xcXFERER4Hqe/tr77LlhX6C/Dhw+nVq1a+dqWnPjyyy+pUKECx4//fW6a\nntM7V6bh3K0yGAX+wJlP/YyqLs8grjxwNEj6EaBcFk3ILG/6/vSfv2cjLpixQBWcKS3e/g/YjNN5\nLw70BibhdPYHZtFuY4wxWbimXTv2JSYWeL2Va9RgcQ47ndu2bWPZsmW0bNmSlJSUDOMmTZrEhAkT\n+Pe//83FF1/MlClT6NSpE9u2bSMyMhKA33//nU6dOtGgQQM++ugjduzYwUMPPYSqMm7cuCzbcuTI\nEV588UWGDRvmScvojpAiwvjx41m8eHFAekGYMGEC3377LXPnzqVcuXLUqxd8HOzkyZPExsayc+dO\nRo0aRdOmTTl48CDTp0+nefPmLFmyhJiYmAJpc0HYsGEDq1ev5q233vJJv+SSS5g9e3bAh7D69evn\na/3+r5cmTZqQkJBAnTp1cpSvoDVp0oTGjRszbdo0Hn/88UJrR07kdKrJk8AAnI7nf3HuXBkFdANO\nAx8CscBSEempqh/nX1PPPhH5F/AIMFZVfT5Oqup0v/BlInISGCIiT6nqzwXVTmOM+Sfal5jIZq9R\ntyTA+6kAACAASURBVILSNBed/R49etCjRw8A+vXrx+HDhwNikpOTmTx5MqNGjeKee+4BoGXLltSs\nWZMZM2Z4OtUvvvgip0+f5oMPPiA8PJyOHTvyxx9/MHbsWEaMGEHJkiUzbUtsbCxTp07l/vvvp1ix\nYlnGLlmyhG+++YaGDRt60gvq4tgffviBFi1a0KVLl0zjRo8ezbfffsuWLVt8Oue9e/cmNjaWG2+8\nkR07dhAa+s+4fch//vMfevbsSZkyZXzSw8PDadasWYG3p2TJkjRv3rzA682NW2+9lYcffpgxY8YE\nfMtzLsppC0/jvkOlqt6hqqNU9XagFrALOAQ0BpbjrCYSzFGCj2xnNJqd3bzw14j2UaBsNuI8ROQa\nnNVNZqpq1kMMjndxzmHBvyuM+YfTJ9RnM+cWVfXZTKD4+HiOHz9Ov379PGklSpTgmmuuYenSpZ60\nZcuW0aVLF8LDwz1p119/PUlJSaxZk/m6BSLCiBEjOHz4MK+++mqmsQDXXnst9erVY/z48ZnGffTR\nRzRt2pSSJUtSvnx5WrVqxRdfZH5p165du+jVqxdlypShdOnS9OjRgx07/prx6XK5WLlyJR988AEu\nl4vatWsHLefUqVO89tpr3HzzzQEj4iEhIUyYMIG9e/fy/vvv++w7c+YMQ4cOpUKFCpQrV44hQ4b4\nfBuxf/9+7rjjDurUqUOJEiW4+OKLeeyxx/jzzz89MYmJibhcLubOncvtt99OmTJlqFatGnPmOJeM\nPf3001SpUoXIyEhGjhzpU/+PP/7IDTfcQPXq1QkPD6dBgwY899xzWb4/Tpw4wcKFC31eJ9k1e/Zs\nXC5XwFSjWrVqMWLECJ+0hQsX0qJFC0qUKEHFihW5+uqr2b17d9Byg001+eOPP/jXv/5FqVKlqFKl\nChMnTgyad/f/t3ffcVJV9//HXx+RXgTEQpASIogQNWrEgmWRHwoxKqL4FUElNrCRYAkCKkXEgoUE\nE2swdkWNWJGIuJqIBcFKglgAAyhSFqQjy+f3x7mzzM7O7szAsrPsvJ+PxzyWOfece8+cvcBnz577\nOf/7H2eddRa77747devWpVu3bsydO7dYnSFDhnDggQdSv359mjdvTt++fVmyZEmJz3DNNdcwbtw4\nmjdvTuPGjenduzc//lj88bxTTjmF5cuXM2XKlLIHq5LIdMZ7AHBF4hprd19vZncBd7v7TWb2IPBw\nKeeYTVjnnag9yddVJ7btYWa1EvrQgfDQ5Vdx9WqaWeuEmegOhCUxxa5jZl0ID2w+5+4DUvQhIyNG\njCj6c15eHnl5eeV5ehERqaTmzJlDtWrVaNOmTbHy/fffn4kTJxar16VLl2J1mjdvTp06dZgzZw4n\nnXRSmddp3rw55557Lrfddhv9+/enWrVqpdY1M4YMGcI555zDF198wX777VeizjfffEOvXr0YNGgQ\nt99+Oxs2bGDmzJmsWFFizqrIpk2bOP7446lZsyZ/+9vfqFatGjfccAN5eXl89tlnNGzYkPfee49L\nLrmERo0acfPNN5c6Oz9z5kzWrl3LqaeemvT4scceS8OGDXn77bfp27dvUfntt9/OkUceyRNPPMHs\n2bMZOnQotWvX5tZbbwVg2bJlNGrUiDvuuIPdd9+duXPnMmLECJYtW8Y999xT7BrXXnstffr04R//\n+AcTJkzgvPPO46OPPuLbb7/loYceYubMmQwbNoxDDjmEM888E4BFixbRtm1b+vTpQ4MGDfj4448Z\nPnw4GzZsYPDgwaWO3TvvvMOGDRs48sjk+xMWFhaWKIt9j9Nd6vHoo49y3nnncfbZZ3PDDTfg7kyb\nNo2lS5fSvHnybVQSz9uvXz/efvtt/vSnP7HXXnsxduxYvv76a6pXr15Up6CggE6dOrHHHntw//33\nU7t2bW6++Wa6du3K3Llzi35DsWTJEoYMGUKzZs1YtmwZd9xxB126dOHzz4s/Ajhx4kQOOuggHnjg\nARYuXMigQYMYOnQod999d1Gd+vXr06FDB6ZOnUr37t1TjgVAfn4++fn5adUtb5kG3nuwdeOcRDUI\nW8oDLKN4rut4LwJjzayVu88HMLNWQCdCCr+yvERYg92LkEscM6sGnAlMiTKaQEgXuBnoQ1geE9MX\n+Nzdi36vaGZHEpbIvM7WvOLp6gtsAT4orUJ84C0iIrmjoKCAevXqlQhgGjVqxLp169i8eTO77ror\nBQUFNGxY8pe0jRo1oqAg1S+Cg2uvvZaHHnqIRx55hN/97ndl1j3rrLMYPnw4Y8aM4eGHS86RffTR\nRzRo0IBbbrmlqKxbt25lnnPChAksXLiQL7/8kpYtWwLQsWNHWrduzX333cfgwYPp2LEjDRo0oHHj\nxmUun1i0aBFmVnSeZFq2bMmiRYuKle22225Fs+AnnngiGzZsYMyYMQwZMoSGDRvyy1/+kttvv72o\n/lFHHUWdOnW44IILGD9+PLvuujUk6tKlS9FvBTp27MgzzzzDSy+9xJw5czAzTjjhBCZNmsTzzz9f\nFHgff/zxxR6y7dSpE2vXruWBBx4oM/CeNWsWTZo0KfZwY8yHH35YLLCFEBAnC8ZL4+4MGTKE008/\nnccee6yo/Le//W3a5/jPf/7DCy+8wMSJEznjjDOAMJnYokWLYstj7rzzTtavX8+0adOKyo866iha\ntWrFhAkTipZcTZiwdb/FLVu2cPjhh9O8eXP+/e9/c/TRRxcdq1GjBpMmTSpaQjJ79myefvrpYoE3\nwEEHHcQHH5QaipWQOBE6cuTItNtur0yXmswERphZ0/hCM/sZMJzw8CFAS2BxKed4gLAs5QUzO8XM\nTiEEvguA++PO2cLMNpvZdbEyd/8YeBoYZ2YXmNnx0ftW0fVj9ZYCdwJDzGyQmR1nZvcQ1p9fG3eN\n/Qhr1ZcCdwC/NrPDY6+EvrxpZheZWRcz+62ZTQAuA+6NT40oIiJS0Vq3bs1ZZ53FLbfcknJpwy67\n7MK1117Lk08+yfz580scP+CAA1i1ahX9+vXj9ddfL7GMIZkZM2ZwyCGHFAuWmzVrRqdOnfj3v/+d\n8efZFrE19zE9e/Zk3bp1xWZRx40bR4cOHahTpw7Vq1enT58+bNy4kW+//bZY2/gAun79+uyxxx4c\nd9xxxX6I2nfffYsF/xs3bmT48OG0adOGmjVrUr16dYYNG8a8efPYsmVLqf3+/vvvadKkSdJj7du3\nZ+bMmXz44YdFrxkzMttO5IsvvmDx4sX069cvo3bxZsyYgZkVG+O6devStWvXYvXeeOMNunbtSr16\n9SgsLKSwsJB69epx6KGH8uGHHxbVmzx5Mp06daJhw4bsuuuuNG/eHDMrsSSlc+fOxdZtt2/fnh9+\n+KHEDx5NmjTh+++/3+bPV5EyDbx/D+wDfBMFok+b2ZvAN8DPgIFRvX2BJ5KdwN3XAccDcwlb0D8K\nfA10iY7FWNwrXj/CWuwbgZcJGUhOdPfE/ExDCbtXDiTMgB8J9HL3yXF1jgB2I/ygMA2YnvCKWU1Y\nNz6UMOv+FHAgYdnN5ck+p4iI5LZGjRqxZs2aEoFwQUEBderUKZphbdSoEatWrSrRvqCggEaNUiX7\n2mro0KF8/fXXPP300ynrnnvuuTRt2rTYrHZM27ZteeGFF5g3bx4nnXQSTZo0oU+fPixbtqzU8333\n3XfstddeJcr32muvMpeoJNOsWTPcnQVlPPS6YMECmjVrVqwsliUm8f1334UNpu+66y6uueYaTj/9\ndF588UVmzJjBX/7yFwA2bCiepTjxNxA1atRIWhbf7o9//CN33nknAwYMYPLkyXz44Ydcd911Sc8f\nb8OGDaU+JFqnTh0OPvhgDjnkkGKvTCxfvhwzo2nTpqkrl+L777+nfv36JZYHJY75smXLePrpp6le\nvXrRq0aNGuTn5xetJ58xYwannnoqLVq04LHHHuO9997j/fffx93T+j64Oxs3bixWXrNmzTLHuDLJ\ndOfKWWa2L2FXyMOBAwhbpt8B3Onuy6N6ZeZ0cfeFhOUiZdVZAJRYqObuGwnbxV+dor0DY6JXaXUe\npvS16PH1CoCeqeqJiIjEtGvXjsLCQr766qti67znzJlDu3btitWbM2dOsbYLFy5k3bp1xeqlsv/+\n+9OjRw9uuukm+vfvX2bd6tWrc80113DNNddw2mmnlTjevXt3unfvzurVq3nllVf4/e9/z8CBA3ni\niaRzajRt2jRpzuclS5bQuHFZGXxLOvTQQ6lbty4vvvhi0uUQ//rXv1i5cmWJdII//PBD0vc/+9nP\nAHj22Wfp1atXsRSNyXKCb6tnn32WgQMHFkvrmJi2MZnGjRuzcmWyDMip1apVCwhr7OvUqVNUHr9E\naffdd8fdi34A2RZ77703q1evZtOmTcWC78Qxb9y4MR06dChaRx6vfv36AEyaNIk999yTJ598suhY\n4m8cMrVy5cqM77NsyTjvirsvj7KZdHH39tHXYbGgW0SkPNhIK/aSyiX2UFe28/hWZkcddRT169cv\nln1j3bp1vPTSS/zmN78pKuvevTtTpkxh7dq1RWVPPfVU0YY7mRg2bBizZ8/m+eefT1n3oosuomHD\nhtx2222lfg/r16/PWWedxWmnnVbmZiqHH344M2fOLDZLvWjRIqZPn84xxxyT0WeoXbs2F154IY88\n8kiJaxYWFnLdddfRrFmzorXGMS+88EKx98899xx16tQpynm9fv36EjPL8Wuet9f69euLBaVbtmzh\nqaeeStluv/32Y/HixcWyq6Rrn332wd3573//W1T2/vvvF8v8sd9++9GsWbOk6/nTddhhh+HuxcZ4\nzZo1vP7668XqdenShdmzZ9O+ffsSs/SxHz7Xr19fYt36Y489tl3/jsyfP5+2bdtuc/uKtE1bxouI\niOSy9evX8+qrr+LuLFq0iNWrV/Pcc88BcNJJJ1GrVi1q1qzJtddey+jRo2nYsCHt2rXjjjvuwN25\n/PKtqxQHDBjA+PHjOe200xg8eDBff/01I0eO5KqrrkqZwztxVvHggw+me/fuTJ48OWUgU7NmTa68\n8koGDx5crO7999/Pu+++S7du3fjZz37G3LlzeeaZZ8pcI9yvXz9uvfVWunXrxqhRo9hll10YNWoU\ne+65JxdfnPkec6NHj2b69Okcd9xxXHvttRx22GEsWbKE8ePHM2vWLF599dUSQfTq1as544wzuOii\ni/j8888ZPXo0V1xxRdFyha5duzJ+/Hg6duzIL37xCx5//PFi6Q63V9euXfnLX/7CL37xCxo1asRf\n//pXNm3alLJdp06d+Omnn/jss89KLCNZu3ZtiZ1GIawv33333enYsSPNmjVj4MCBjBo1iuXLlzN2\n7NhiDzyaGbfddht9+/alb9++9O4d9gd88803Ofvss0tduhJ/b7Vv355TTjmFAQMGsGrVKvbee29u\nv/32YikwAa688koef/xxOnfuzBVXXEGzZs1YsmQJb731Fscccwz/93//R9euXfnTn/7EoEGDOPnk\nk5k+ffp2/wD04YcflkjvWFllHHibWQfgQmA/wkY68dzdu5RsJSIiUramLVtu02Y25XHdTP3www/0\n6tWrWMAay24xb948WrRoAYRsI+7OLbfcwvLlyznssMOYOnVqsQwWDRs25I033uDyyy/nlFNOoWHD\nhlx11VUMHz6cVJIF19dddx2vvfZaiWPJfjtx6aWXcuuttxZb6nDggQfy0ksvcdVVV7FixQqaNm1K\n//79y8z8UKNGDd544w2uvPJKLrzwQtydzp07849//KPEOt10Zjbr1q1Lfn4+t912Gw8++CDXXXcd\nDRo0oHPnztxzzz0ldm40M66++mq+/vprevfujbtz0UUXcdNNNxXVueGGG1i2bBnXX389AKeffjrj\nx4/n5JNPTtm/dH6zM378eC655BIuv/xyateuzXnnnUfPnj1T/uDRpk0bOnTowOTJk0sEwXPmzOGo\no44q0ebRRx/l7LPPpnr16kyaNIlLL72UXr16sd9++3HvvffSp0+fYvV79+5N7dq1uemmm+jVqxd1\n69bliCOOSJpJJf4zx3v44Ye55JJLGDRoEPXq1eOyyy7jxx9/5Nlnny2qs/vuu/Pee+8xbNgwrrzy\nSlauXEnTpk05+uijizZs6t69O7feeivjx4/nwQcf5KijjuKVV14pMWOd7m/TPvroI5YtW0bPnjvH\nimDLZOODKNPHW4SsJG2ATwkb2rQAFgJfufvxpZ4gx5iZl+vGEgsWwOmnlyyvXRtK29jguOMg7teX\nKd19NxxxxLb1T6QcJS4v0SY6lUvif4gZ/l+iTXdE4owbN44JEybw6aefZrsrO50hQ4Ywc+ZM/vnP\nf5ZZr6x/d6JjFbJmLtM13mOAfxA2ojHgAndvBfw/woOQZW+FJSIiIiLFXHzxxSxdupRp06Zluys7\nlXXr1vHggw8W/RZjZ5Bp4H0g8Bhh90eIso64+zRC0H1z+XVNREREpOqrU6cODz/8cLEHbCW1b7/9\nluHDh2f8AG82ZbrGuwaw1t23mNkKID4p5BfAL8utZyKS07S0pHLTUhGR8nXCCSdkuws7nXbt2mWU\ncrMyyHTG+yvCem4I67vPN7NdzGwX4HfAzrFtkIiIiIhIBct0xvsl4FjCbpNjCNut/wgUAvXYunOl\niIiIiIjEyXTnyhFxf55qZkcApwN1gNfcvexHSkVEREREctR2baDj7h8BH5VTX0REREREqqyMAm8z\nKwSOdPcPkhw7FPjA3auVV+dERKTqadmypbaZF5EK1XIbNsraETKd8S7rX8pqbE0zKCKyXbSBTuW2\nPRvozJ8/v5x7IyKyc0gr8I6ylsT+lY1lMYlXG+gOLCvHvomIiIiIVBkpA28zGw7cEL114J0yqv+1\nPDolIiIiIlLVpDPjnR99NUIA/jdgYUKdjcB/gJfLrWciIiIiIlVIysDb3d8C3gIwMwcecPfF23NR\nM9sHGAf8P0JAPxX4g7v/L422NQnb0/cBGgIfA4Pd/V8J9Qy4FrgY2Juws+Yod/9HXJ29gUFAV6A1\nsImwMdDIxPNF9XsQfvjYH1gCPADc7O5bMvn8IiIiIpJ7Mtq50t1HlkPQXRt4E2gLnAP0BdoA06Jj\nqUwALgCuA04CvgOmmNmBCfVGE4LkPwPdgHeBZ8ysW1ydQ4FewPPAGcB5wHog38x+k9DvE4Fngfej\n842L+nBTWh9cRERERHKaZfIkOoCZHQf0JmwdXyvhsLt7lxTtfw/cDrR193lRWSvgS+Aadx9XRtuD\nCHnD+7n7I1FZNWA2MMfde0RlewD/A8a4+6i49lOBJu7+q+h9A2CtuxfG1Ymd73t3z4srnwWsdPfj\n48quB4YBLdz9hyT99UzHt0wLFsDpp5csr10b/lVigj447jhYuzb9a9x9NxxxxLb1T0RERGQnY2a4\ne4XkOM1oxtvM+hNmq88gLPOwhFc65zsZeC8WdAO4+3zCQ5unpmh7CmE5yMS4toXAU8CJZlY9Ku4G\nVAceT2j/GHCAmbWM2v4YH3THne9joFmsLFoa86uofbxHgRqEjC4iIiIiIqXKNI/3VcATwPnuvmkb\nr9kBmJSkfDYhoC9Le2Ceu29I0rYGsC/w36jeRnf/Okk9i44vSHaBKHg/khB8x/fZo/ZF3H2+ma2L\nziciIiIiUqpMA+9mwEPbEXQDNAYKkpSvABptR9vY8djXlWnUS2Yk4XP2TrgupVy7IMX5drzCQnjj\njeTHNm/O7FyzZmW2NOXnP4fWrTO7hoiIiEgOyjTwnknI/lFKlLdzM7OzgcGErCbTs92ftG3aBIMH\nl8+5JkzIrP6AAQq8RURERNKQaeA9EHjczL5w97e38ZoFJJ/ZLm02O7Fti1LawtYZ7QLCGvRU9YqY\n2cnAQ4R0iaMSDsf6lazfjZKdL2bEiBFFf87LyyMvL6+0qiIiIiKyg+Xn55Ofn5+Va2caeL8ENADe\njNY2JwbK7u4tU5xjNmHNdKL2hE14UrXtYWa1EtZ5dyA8dPlVXL2aZtba3b9JqOeJ1zGzLoQHNp9z\n9wGlXNei9u/HtWsJ1Cmr3/GBt4ikz0YWf8Dch5djhiDZbmGrhK3KNYOTiMgOlDgROnLkyAq7dqaB\n9xuEwHV7vAiMNbNWUTaTWDrBTsAfU7R9ibAGuxcho0gs/d+ZwBR3/ymq9xqwmbDJzo1x7fsCn7t7\n0YOVZnYk4WHP1wl5xUtw9/+Z2SfR+eLXYpxDCPgnp+i3iIiIiOS4jAJvd+9XDtd8ALgMeCHKgw0w\nipBl5P5YJTNrAXwDjHD30dH1Pzazp4FxZlYDmAdcCrQi7mFId19qZncCQ8xsDTALOAvII6QzjF1j\nP+AVYClwB/Dr+Fkcdy+a3QaGAi+Z2b3Ak8AhhBze45Ll8BYRERERiZfpjPd2c/d1ZnY8cBfwCFu3\njB/k7uviqsbnB4/Xj7Bb5I2EddyfACe6+ycJ9YYCqwnr0mNbxvdy9/jZ6SOA3aLXtCTdrRbX78lm\ndgYwnLDD5RLC7phj0vrgIiIiIpLTtmXnyoOB64FjCYFvR3efZWZjgLfd/bXy7+bOqcJ2rsymAQPg\nwguz3QupgrTGu3LTGm8RqSoq886VRwPvAu0IG+nEt98CJHswUUREREQk52W61OQWYArQg7AM4/K4\nY7OAc8upXyKS4zTDXblphltEJHOZBt6HAD3d3c0s8V/dZcAe5dMtEREREZGqJaOlJsAGQt7qZJoC\nq7avOyIiIiIiVVOmgfe/gT9EubNjYjPfF5A8M4iIiIiISM7LdKnJ9cA7hBR+zxKC7vOinNmHAoeV\nb/dERERERKqGjGa8o1zZxxJyWA8j5NiOPWB5nLt/Ub7dExERERGpGjLeQMfdZwFdzKwW0BhYmbDx\njYjIdlMe78pNebxFRDKXUeBtZtWBGu6+1t03AIvjjtUFNrn7T+XcRxERERGRnV6mM94PAtWBs5Mc\nuw/YBJy/vZ0SEREREalqMs1q0hl4oZRjLwJdtq87IiIiIiJVU6aB957AD6UcWwrstX3dERERERGp\nmjINvH8ADijl2AHA8u3rjoiIiIhI1ZTpGu+XgevNLN/dP40VmtkBhPSCz5dn50QkdymLSeWmLCYi\nIpnLNPC+AegKzDSzGcBCoBnQEZgHXFe+3RMRERERqRoy3UBnGWF3ypsJm+f8Kvp6E3BYdFxERERE\nRBKkHXibWTUzOwio7u43uPuR7t7W3Y9y9xHuviqDc+1jZs+a2UozW2Vmz5lZ8zTb1jSzsWa22MzW\nmdl0MzsmST0zsyFmNs/M1pvZx2bWM0m9c6O+zDezLWY2oZTrPhQdj38Vmtmd6X5uEREREcldmcx4\nO/AhcPD2XNDMagNvAm2Bc4C+QBtgWnQslQnABYRlLScB3wFTzOzAhHqjCUtj/gx0A94FnjGzbgn1\n+gKtgX8CqX54+AE4HDgieh0J3JVGn0VEREQkx6W9xtvdt5jZ/4C623nNi4FWQFt3nwdgZp8BXwL9\ngXGlNYxm3HsD/dz9kajsbWA2MAroEZXtAVwFjHH3WGD8lpm1AW4BXov7XCfEnb97ir5vcvcZaX/S\nbbVwIbz4YsnylSt3+KVFREREZMfI9OHK+4A/mNkr7r5pG695MvBeLOgGcPf5ZvYOcCplBN7AKYTd\nMSfGtS00s6eAwWZWPdqyvhthh83HE9o/BvzNzFq6+4Jt7P+O9913MCHpiheRnGEjrdh7ZTmpXMwS\nvj/KciIiklKmgXd94BfAN2b2GmGZR/y/tu7uw1OcowMwKUn5bOCMFG3bA/PcfUOStjWAfYH/RvU2\nuvvXSepZdHxbAu89zWwp0BD4BvgbcLu7b9mGc4mIiIhIDsk08B4a9+fzkxx3IFXg3RgoSFK+Ami0\nHW1jx2Nfk63LSKyXiY8Ia9xnA7WA0wjZXfYlLJ8RERERESlVRoG3u2e602WV4e5/Tih6zczWAgPN\n7BZ3/yYb/RIRERGRnUOmM97loYDkM9ulzWYntm1RSlvYOqNdQFgOkqre9noS+AMht3nSwHvEiBFF\nf87LyyMvL6+cLi0iIiIimcrPzyc/Pz8r18448LbwRM3JwLHA7sAId19gZscBX7r74hSnmE1Y552o\nPfCfNNr2MLNaCeu8OxAeuvwqrl5NM2udMBPdgbAcJtV1yk184C0iIiIi2ZU4ETpy5MgKu3ZGS0fM\nrBEwnfBw5EXAuYTgm+j9tWmc5kXgCDNrFXfeVkAn4IUUbV8iPETZK65tNeBMYEqU0QRCusDNQJ+E\n9n2Bz8sxo0lfYAvwQTmdT0QiPtyLvaRycfdiLxERSS3TGe+xQHNCkDyDMMscMxW4Jo1zPABcBrxg\nZtdHZaMIWUbuj1UysxaE5Rsj3H00gLt/bGZPA+PMrAYwD7iUkBe8d6ytuy+NdpQcYmZrgFnAWUAe\nYbaeuOvsT5htN6A20NLMTo8O57v78qgvDwNPRH2qDfQk/OBxb3xqRBERERGRZDINvE8Frnb3d6OZ\n5njfEoLyMrn7OjM7nrDj4yOEgHcqMMjd18VVtbhXvH7ATcCNhHXcnwAnuvsnCfWGAquBgcDewBdA\nL3efnFDvTMIOlzF50QugM/B2dJ6C6Jx7EWa55wBXuPs9qT6ziIiIiEimgXc9YFEpx2pRMkhOyt0X\nErdcpJQ6C4DE4B533whcHb3Kau/AmOhVVr2RQJmLe9y9gDDDLSIiIiKyTTJND/gFcEIpx44DPtu+\n7oiIiIiIVE2Zznj/FbjbzFYR1jsDNDSz3wGXo41kRERERESSynQDnfvNrDVhacaoqPh1wprn29z9\n8XLuX9X2ySfwQpJELkuXVnxfRCoZG1l85Zoym1QuIbPsVspsIiKSWkaBt5k1AUYA9xCWnOwBLAde\n186N22DhQnjxxWz3QkREREQqQMrAO8pecj3we6ABUEjIp32Bu6/csd0TEREREaka0pnxHkBIt/cm\n8CHwC6AH8CPwux3XNRERERGRqiOdwPsi4AF37x8rMLP+hIcs+7v7ptKbioiIiIgIpJdOsDXwE8LT\n2AAAHGxJREFUTELZ04Qc2y3LvUciIiIiIlVQOjPe9QjLSuKtjr7WL9/uiIgEymJSuSmLiYhI5tLN\natIsSiMYUy2uvNgDlspuIiIiIiJSUrqB97OllE9KUlZim3cRERERkVyXTuCtzCUiIiIiItspZeDt\n7g9XREdERERERKqydLKaiIiIiIjIdspoy3gRkYpiI63Ye2U5qVzMEr4/ynIiIpJSVma8zWwfM3vW\nzFaa2Soze87MmqfZtqaZjTWzxWa2zsymm9kxSeqZmQ0xs3lmtt7MPjaznknqnRv1Zb6ZbTGzCWVc\nu4eZzYrON9/MhpmZfmsgIiIiIilVeNBoZrUJ28+3Bc4B+gJtgGnRsVQmABcA1wEnAd8BU8zswIR6\nowlb3f8Z6Aa8CzxjZt0S6vUlbBL0T2BVGf0+kZDd5f3ofOOiPtyURp9FREREJMdlY6nJxUAroK27\nzwMws8+AL4H+hIA2KTM7COgN9HP3R6Kyt4HZwCigR1S2B3AVMMbd74qav2VmbYBbgNdi53T3E+LO\n372Mft8MvO3ul8Sdrz4wzMzucvcf0vv4IiIiIpKLsrFM4mTgvVjQDeDu84F3gFNTtD0F2ARMjGtb\nCDwFnGhm1aPibkB14PGE9o8BB5hZRlvdm9k+wK+i9vEeBWoAZQXsIiIiIiJZCbw7AJ8nKZ8NtE/R\ntj0wz903JGlbA9g3rt5Gd/86ST1L4zqJOgAetS8S/cCwbhvOJyIiIiI5JhtLTRoDBUnKVwCNtqNt\n7Hjs68o06qUrVj/ZtQu24XwikoKymFRuymIiIpI5ZeQQEREREakA2Qi8C0g+s13abHa6bWHrjHYB\n0DCNeumK9SvZtRttw/lEREREJMdkY6nJbMKa6UTtgf+k0baHmdVKWOfdgfDQ5Vdx9WqaWWt3/yah\nnqdxnWTXtaj9+7HC6CHNOmWdb8SIEUV/zsvLIy8vL8NLi4iIiEh5yc/PJz8/PyvXtopep2dmvwfG\nEtIJzo/KWgFzgT+6e1npBH8FzALOc/dHo7JqwGfAXHePTye4EBjt7jfGtZ8K7OHuB5Vy/v8Br7v7\n+UmOfQSscPcucWXXEXJ5t0iWTtDMvMzxfeUVGD689OM7gwED4MILs90LERERkW1iZri7pa65/bIx\n4/0AcBnwgpldH5WNAhYA98cqmVkL4BtghLuPBnD3j83saWCcmdUA5gGXEvKC9461dfelZnYnMMTM\n1hCC9bOAPEI6Q+Kusz9htt2A2kBLMzs9OvyWuy+L/jwUeMnM7gWeBA4BhgHjlMNbRERERFKp8MDb\n3deZ2fHAXcAjhIB3KjDI3dfFVbW4V7x+hN0ibySs4/4EONHdP0moNxRYDQwE9ga+AHq5++SEemcS\ndriMyYteAJ2Bt6N+TzazM4DhwHnAEsLumGPS++QikgkbWfyvvrKcVC5mCd8fZTkREUkpGzPeuPtC\noFeKOguAaknKNwJXR6+y2jshKC4zMHb3kcDIFF2O1Z0ETEqnroiIiIhIvKwE3lKFTJwI06aVLO/S\nBS64oOL7IyIiIlJJKfCW7bNiRXgl+uUvK74vIiIiIpWYNtAREREREakACrxFRERERCqAlppkwYYN\nGygsLKTahg1U37Il293ZIQo3beKntWsr7Hq1atWiWrUSz+LKTkxZTCo3ZTEREclchW+gk0tK20Bn\n4MCBTJ8+nU6rVtF/8eIs9GzHe7NhQx5q2rTCrvf3v/+dX2pduYiIiGSoIjfQ0VITEREREZEKoMBb\nRERERKQCKPAWEREREakACrxFRERERCqAspqISKVkI4s/56IsJ5WLWcL3Rw/qi4ikpBlvEREREZEK\noMBbRERERKQCKPAWEREREakACrxFRERERCqAAm8RERERkQqQlcDbzPYxs2fNbKWZrTKz58yseZpt\na5rZWDNbbGbrzGy6mR2TpJ6Z2RAzm2dm683sYzPrWco5LzKz/5rZBjObY2b9k9R5yMy2JLwKzezO\nzEdARFLx4V7sJZWLuxd7iYhIahWeTtDMagNvAuuBc6Lim4BpZnagu69PcYoJQHfgamAecDkwxcyO\ncPdP4+qNBq4EhgKzgLOAZ8zsJHd/La4/FwH3Rn14A+gC/NXMcPf7Eq79A3AyEJ9H67v0PrmIiIiI\n5LJs5PG+GGgFtHX3eQBm9hnwJdAfGFdaQzM7COgN9HP3R6Kyt4HZwCigR1S2B3AVMMbd74qav2Vm\nbYBbgNeietUIAfrD7n5DXL1mwI1m9qC7F8Z1YZO7z9jOzy8iIiIiOSgbS01OBt6LBd0A7j4feAc4\nNUXbU4BNwMS4toXAU8CJZlY9Ku4GVAceT2j/GHCAmbWM3h8JNElS71Fgd+Do9D6SiIiIiEjZshF4\ndwA+T1I+G2ifom17YJ67b0jStgawb1y9je7+dZJ6FnedDtHXxP4k1ovZ08yWmtlPZvaFmf3RzPSA\nqoiIiIiklI2lJo2BgiTlK4BG29E2djz2dWWa9UhyzsR6AB8BHxKC8lrAacDNhGD/4hT9FhEREZEc\nl43Ae6fk7n9OKHrNzNYCA83sFnf/Jhv9EqmqbKQVe6/MJpWLWcL3R5lNRERSykbgXUDyme3SZrMT\n27YopS1snakuABqmWY+oP0vKqFeaJ4E/AIcBSQPvESNGFP05Ly+PvLy8FKcUERERkR0lPz+f/Pz8\nrFw7G4H3bLaurY7XHvhPGm17mFmthHXeHQgPXX4VV6+mmbVOmInuAHjcdWJruTtQPPCOre1O1Z+U\n4gNv2XFeffVVPvroo2x3o0rp0aMH9evXz3Y3REREylXiROjIkSMr7NrZCLxfBMaaWasomwlm1gro\nBPwxRduXgJFAL0LmkVhKwDOBKe7+U1TvNWAz0Ae4Ma59X+Bzd18QvX8XWBbVmxZX7xxgOSHTSln6\nAluAD1LUkxh3rLRDluRIWfUBojYTJ04spZZsq86dOyvwFhERKUfZCLwfAC4DXjCz66OyUcAC4P5Y\nJTNrQVi+McLdRwO4+8dm9jQwzsxqEDbQuZSQF7x3rK27L412lBxiZmvYuoFOHiGdYaze5qgPfzGz\nxcBUwgY6/YDL3X1zXF8eBp6I+lQb6AmcC9wbnxpRynbwmjUMWriwRPmCWrW4/uc/L1HeoLCQu7/8\nMum5fteuHYVJj4iIiIhUPhUeeLv7OjM7HrgLeISw1GMqMMjd18VVtbhXvH6EXSZvJKzj/gQ40d0/\nSag3FFgNDAT2Br4Aern75IT+3GdmWwgb7lwNfAtclrBr5WrCevChwF6EWe45wBXufk+mYyAiIiIi\nuScrWU3cfSFhuUhZdRYA1ZKUbyQEyFenaO/AmOiVqj8PEGbiSzteQJjhFpEKoiwmlZuymIiIZE6b\nv4iIiIiIVAAF3iIiIiIiFUCBt4iIiIhIBVDgLSIiIiJSARR4i4iIiIhUgKxkNRERScVGFs8kqiwn\nlYslbHilLCciIqlpxltEREREpAIo8BYRERERqQAKvEVEREREKoDWeMsOUcOdhj/9VKK8XmFh0vq7\nllK/fin1ARpu3kzpR0taveuuFCasSy1P1bdsoW6S/m42Y82u+qsmO7HCQlixolhRE8CB5VnpkIjI\nzknRgOwQnVatotOqVWnXb7ZxI3/+6quMrnFXhvVvbNmSL+vUyahNJg5Zs4bLFi0qUf5l7drc2KrV\nDruuyA63aBH07FmsaDKwETg6Kx0SEdk5KfAWkUpJWUwqt18feijUrIm/8062uyIistNQ4C0iSQ0f\nPpxatWpluxtVytixY6mzA3/rIiIilZsCbxFJ6pNPPsl2F6qcwjKeWRARkapPWU1ERERERCpAVgJv\nM9vHzJ41s5VmtsrMnjOz5mm2rWlmY81ssZmtM7PpZnZMknpmZkPMbJ6ZrTezj82sZynnvMjM/mtm\nG8xsjpn1L6VeDzObFZ1vvpkNMzP98CIiIiIiKVV40GhmtYE3gbbAOUBfoA0wLTqWygTgAuA64CTg\nO2CKmR2YUG80cAPwZ6Ab8C7wjJl1S+jPRcC9wDPAicBE4K+JwbeZnQg8C7wfnW9c1Ieb0vrgIiIi\nIpLTsrHG+2KgFdDW3ecBmNlnwJdAf0JAm5SZHQT0Bvq5+yNR2dvAbGAU0CMq2wO4Chjj7ndFzd8y\nszbALcBrUb1qhAD9YXe/Ia5eM+BGM3vQ3WOLMm8G3nb3S+Lq1QeGmdld7v7D9gyKiBQ3c/HMYu8P\n/dmhWeqJJPPhzJkhnWCUG99dWWhERFLJRuB9MvBeLOgGcPf5ZvYOcCplBN7AKcAmwqx0rG2hmT0F\nDDaz6u7+E2FGujrweEL7x4C/mVlLd18AHEnYByKx3qNAP0KK2rfMbB/gV8CFSeqNBLoDD6f64CKS\n2x566CFq1qyZ7W5krN6KFZywdGmZde67774K6s1WZsbFF19c4dcVEdlW2Qi8OwCTkpTPBs5I0bY9\nMM/dNyRpWwPYF/hvVG+ju3+dpJ5FxxdEfQH4vIx6b0X1PCovEv3AsC6qJ2nYUljILtWqZbsblcrq\n1aupX79+trtRqaxevTrbXdghHnnkkW1um837ZK9Nmzh42bIy6zzwwAMV1Jut1q5dq8A7Tn5+Pnl5\nednuRqWiMSlJY5Jd2Qi8GwMFScpXAI22o23seOzryjTrkeSc6daLlTVOUi5JFG7ZosA7gQLvkqpq\n4L09dJ+U9OOPP7Ju3bpsd6PSeP311+nYseN2n6cq5ZpXkFmSxiS7lMdbRER2Su7Osccem+1uVBqL\nFy9mypQp23WO3XbbjSeeeKKcepR9a9asYcmSJVntQ7Vq1WjSpElW+yCVRzYC7wKSz2yXNpud2LZF\nKW1h60x1AdAwzXpE/VmSZr1EjeLqpaV58+a0a9eOJj/8QMHmzZk03ekVrFxJo4bJvjU7XrN996Va\ngwY77PxNli2j4KefSpT/1KAB7dq1K7Xdpk2byjyeizZt2sR3fFesLNfHKJv3yW7r11OQ8FuIefPn\nsynufTb6pr87xZXXeFx11VXl0JvK4dNPP+X777/Pah8aNGjAb37zm6z2Id7cuXN5+eWXs92N7VKz\nZk322muvbHdj27h7hb6ANwjZQRLL3wTeTNH2emADUCuhfASwHqgevT8HKARaJ9TrF5W3jN4fA2wB\njk+od1xUflz0vnn0/vyEei2j8vNK6a/rpZdeeumll1566VW5XxUVB2djxvtFYKyZtXL3+QBm1gro\nBPwxRduXCFlEehEyisRSAp4JTIkymkBIF7gZ6APcGNe+L/B5lNEEQm7vZVG9aXH1zgGWA+8AuPv/\nzOyTqN6EhHqbgMnJOuvuluLziIiIiEiOyEbg/QBwGfCCmV0flY0iZBm5P1bJzFoA3wAj3H00gLt/\nbGZPA+PMrAYwD7iUkBe8d6ytuy81szuBIWa2BpgFnAXkEdIZxuptjvrwFzNbDEwFuhBmxi939/h1\nIEOBl8zsXuBJ4BBgGDBOObxFREREJBXLxqYHUV7su4CuhLR9U4FB7v5tXJ2WbA28b4wrr0nYLfJs\nwjruT4A/uvu/Eq5hwBDgImBv4AtgpLs/n6Q/FxE23GkJfAvc6e4lktKaWQ9gONCOsCb8AcImPRU/\niCIiIiKyc6noNd6V/QU0A8YD04G1hDXcLZLUawg8CCwF1gCvA79MUq8mMBZYDKyLzntMknqxHxTm\nEdarfwz0zPZ4pDsmbF3vnvgqBBpUwTE5A3ie8IPaOmAOMAaol8P3ScoxycH75ATCcy3fEZ5P+R/w\nNLB/Dt8nKcck1+6TJH19Lfq8o3L1PklnTHLpPmHrs2eJrxW5eo+kMyaV8R7J+sBVtlf0jfwOeJmw\ndruQ5IH3vwkBxpmE/0jyoxv9Zwn1HidkPTkf6Aw8F31DD0yod1P0DRwU9eGe6NrddoYxibu5bwQ6\nJrysCo7Ju8AzhN+8HAsMJGS/mZ7D90nKMcnB++Qs4FagJ+Fh7j6EDbtWAs1z9D5JOSa5dp8k9LM3\n4T/+QkoG3jlzn6QzJrl0n0R9KSQsr43/nIfk6j2SzphUxnsk63+hKvMLuIDkQeapUfmxcWUNCA9k\njosrOyj6hp8bV1aNMBM4Ka5sD8LMzw0J15kKfJztcUhzTGI39/kp2leJMQF2T1IWy6aTl4v3SZpj\nklP3SSmfrW302Qbl4n2S5pjk5H1CSE/7HfB/lJzdzcn7JMWY5Mx9wtYg8/gy6uTUPZLmmFS6e2QX\nZFucDCx297djBe7+IyHryqlx9U4hZD2ZGFevEHgKONHMqkfF3YDqhJ+24j0GHBCtd68qqsSYuPvy\nJMUzCL+Caha9z6n7JM0xSVeVGJNSxPL+x7IwnUIO3SeliI1JphsbVLUxuRX41N2fTnIsp/49iVPW\nmKSrqoxJqkxpuXiPlFf2uAobEwXe26YD4VejiWYDLcwstt9ue2Ceu29IUq8GsG9cvY3u/nWSehYd\n31ncbGY/mdlKM3vBzH6ZcLwqj0keIR/of6L3uk+2jsl/E8pz6j4xs13MrLqZtQHuI/za/KnocHty\n8D4pZUyeTKiWM/eJmR1NSHl7WSlVcu7fkzTGJCZn7hPgcTPbbGbLzOxxM2sedyzn7pFIWWMSU2nu\nEW0Zv20aExbVJ4rN2jQirAsqbTfOWL3GcV9XplGvMtsI3Av8k7CerB0h3eI7ZnaYu8+N6lXJMTGz\nZoQc86+7+0dRcU7fJwljMisqztX75H3g0OjPXwJd3H1Z9D5X75OyxiSn7pNoNu1eYKy7f1VKtZy6\nT9Ick1y6T1YBtwNvAT8CBxM+63QzOzj6u5NT9wjpjUmlu0cUeEu5cPfvCQ84xLxjZlMIPwUOA87L\nSscqgJnVBV4g/Jrq/Cx3p1IobUxy+D7pS1hr2Rq4GphqZp08LoVqDip1THLwPhkM1CJkAZIg5Zjk\n0n3i7h8TsmfE/MvM/gV8AFxBSHWcU9IZk8p4j2ipybYpIPzkmKhx3PF06q2Iq9cwjXo7FXdfSHjC\numNccZUaEzOrRcj20go40d0Xxx3OyfskxZiUkAv3ibt/4e4zonWq/w+oB1wbHc7J+yTFmCSrXyXv\nk+jX4kOB64FaZrabmcX6WjN6vws5dJ9kMCYlVNX7JJnot6tz2fpZc+YeKU2SMUlWJ6v3iALvbTOb\nsJYqUXvgW3dfF1fv51EgEq8DYSbwq7h6Nc2sdZJ68WuGq4IqMyZmtish3dAhQHd3T+xTzt0naYxJ\nuqrMmCRy91WE/sfWDObcfZIoyZikqyqMSWtC/uDHCP+pFxD+83bgmujPvyS37pN0xyRdVWFM0pFL\n90h5q7gxSSf1Sa6+SJ1O8Ji4sgbAMoqn7PkVIT3NOXFl1aJvTGJ6mo3A9QnXmQp8ku1xSGdMSqnb\ngrAG66GqNiaEhygmEjYUyiulTk7dJ+mMSa7dJ6V83r2A1cBfc/E+SWdMcuk+ib7XxyZ5bQEeJuQ6\nr5NL90m6Y5JL90kpn/XXhExAw6P3OXOPpDsmlfEeyfogVcYXcHr0uif6RgyI3h8bHTfgHWABIbfo\niYQk9cuAZgnnepKQQ/MC4HjgWcLDDQcl1Ls5Ko9PyL6ZMGu4M4zJ7cBthE0x8qLj86PP3qaqjUnc\nOIwCDk94NcvF+yTNMcm1++QfwHWEVFV5QH9ChpflwL45ep+UNiYrgF/k4n1Syjgl5qzOqfskzTHJ\nmfsEeBQYQQiuOwNXER4WnAc0zsV7JM0xqXT3SNb/IlXGF1u3E018TYurE9uWdRlhW9Z/Uvq2rLez\ndQvSdyl9C9KhFN+C9LRsj0W6YwL8jpClYDnhp8HF0V+KNknOtdOPSdSnZONRSFxi/Vy6T9IZkxy8\nT64h5DJfEX3//wv8lZK/Rcul+yTlmOTafVLKOBUCI3P1PklnTHLpPiE8//AxYdnNRkJwfQ+wV67e\nI+mMSWW8Ryw6iYiIiIiI7EB6uFJEREREpAIo8BYRERERqQAKvEVEREREKoACbxERERGRCqDAW0RE\nRESkAijwFhERERGpAAq8RUREREQqgAJvEZFKyMzOMbMFce9nm9mAcr7GEWb2npmtMbNCMzuwPM+/\nI5hZSzPbYmbnZrsvIiKZ2jXbHRARkaQOAT4EMLO6wH7AzHK+xgRgLXASYQe2ueV8fhERiaMZbxGR\nyulQtgbahxC2y/6kvE5uZrsAbYFX3P0td//A3TeU1/m3h5nVyHYfRER2BAXeIiKVTBQU/4qtgfdh\nwH/cfVOa7eub2d1mtsjMNpjZHDP7Q9zx84DNgAE3REs3vinlXIdEx4+KK7siKhsVV7ZvVNY9rqyj\nmU01s9XRcpapZnZYwvn/bmb/i5a9vGNm64Bbo2O1zeyvZrYsOsckYJ8kfTzMzP4Z1VtnZl+b2d3p\njJWISEVS4C0iUkmY2Twz20IIiusCr0bvbwcOjALbQjNrUcY5DHgVOA8YC/wWmAzcaWajo2ovA50I\ngfeDwBHAaaWc8iNgJXB8XFlnYF1CWRfgJ+DtqB8HAvnAbsC5wDlAA+AtMzsgrp1HdZ4EngC6RV8B\n7gfOjz7/acAX0TGP+7x1gdeia58btR+JllKKSCWkf5hERCqP7kANQtB8AnA2ITj+F3A9IZAFWFzG\nOU4iBNXnufujUdlUM6sHXGVmd7r7cjP7IDq20N0/SHomwN3dzN4mBNujo8D+OOAeYKCZ1XH3dUAe\nMNPd10ZNbwA2AMe7+2oAM5sKzAeGA2fEXaYucLa7vxwrMLO2QG9giLuPjfsc9YH+cW3bAQ2Bwe7+\neVT2NvBIGWMkIpIVmvEWEakk3H2Ou38KNAfy3f0zwsxyPeAZd/80em0u4zTHENaDP5lQ/hghqD9y\nG7o2DTgyWnt9MGGG+jZgU3Q9CIH5mwn9eDkWdEefbzXwIiFwj/cT8EpC2eGEHzqeSSh/KiqP+ZIw\nI3+/mfUxsxJLUUREKgsF3iIilYCZ7WJm1cxsV8KM9btmVg04FlgE/BC9T6UxsCJJcP49IWBtvA3d\nexOoCRxFmNn+xN2XAv8GOptZe2BPQoAe34/vkpzre6BRQtlSd/eEsqbR1yUJ5cXeu/uPhKB/EfAX\n4Fsz+8zMeqbxuUREKpQCbxGRyuENwszvJmBv4NHo/YNAs9gxMzs2xXlWAI2jAD7e3nHHMxLNvC8n\nrOM+nq0B9rS4so3AOwn92JuS9gYKEi+RpF4saN8roTzxPdFvAXoRgv0jgK+Ap6MfCEREKg0F3iIi\nlcPFwK8JDxJ+Ff3518BSYFj058NIncv7LaAa0CuhvC8hOH53G/uXD3QFjqZ44H0w4cHHxHSEbwG/\niR5+BEK2FeBkii9JKc37hID8zITy3iQP1HH3LdF69RsIY7B/GtcREakwerhSRKQScPcvAczsBkJu\n7Y/MbD+gCTDB3X9I81STCUtA7jWzPYHZhAcuzwfGuHvGM96RNwlLOTYTHvaEkPFkNWH5yaiE+jdG\n151mZrdGZYOB2tGxMrn7XDN7AhgVLbGZQXjgtHt8PTM7ifBDyyRgHmE9/EDgR7b9hwwRkR1CgbeI\nSCVhZtUJyzb+EhV1A2ZlEHTHspD8BhgD/BHYnZBJZJC7/zmxOqXMHifxZlR3hruvia61xczeIqQs\nLDaL7e6fmVkecBPwd8L68neBY6OlK4n9SOZiQmB/FeHB0DcIM97/jqvzJeEB1OsI68JXE4L0ru5e\nVvYXEZEKZyWfZxERERERkfKmNd4iIiIiIhVAgbeIiIiISAVQ4C0iIiIiUgEUeIuIiIiIVAAF3iIi\nIiIiFUCBt4iIiIhIBVDgLSIiIiJSARR4i4iIiIhUAAXeIiIiIiIV4P8DCEecJB6IXK8AAAAASUVO\nRK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x7fef604b2450>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.figure(figsize=(10.5,4.5))\n",
    "plt.hist(wiki['length'], 50, color='k', edgecolor='None', histtype='stepfilled', normed=True,\n",
    "         label='Entire Wikipedia', zorder=3, alpha=0.8)\n",
    "plt.hist(nearest_neighbors_euclidean['length'], 50, color='r', edgecolor='None', histtype='stepfilled', normed=True,\n",
    "         label='100 NNs of Obama (Euclidean)', zorder=10, alpha=0.8)\n",
    "plt.axvline(x=wiki['length'][wiki['name'] == 'Barack Obama'][0], color='k', linestyle='--', linewidth=4,\n",
    "           label='Length of Barack Obama', zorder=2)\n",
    "plt.axvline(x=wiki['length'][wiki['name'] == 'Joe Biden'][0], color='g', linestyle='--', linewidth=4,\n",
    "           label='Length of Joe Biden', zorder=1)\n",
    "plt.axis([1000, 5500, 0, 0.004])\n",
    "\n",
    "plt.legend(loc='best', prop={'size':15})\n",
    "plt.title('Distribution of document length')\n",
    "plt.xlabel('# of words')\n",
    "plt.ylabel('Percentage')\n",
    "plt.rcParams.update({'font.size':16})\n",
    "plt.tight_layout()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Relative to the rest of Wikipedia, nearest neighbors of Obama are overwhemingly short, most of them being shorter than 2000 words. The bias towards short articles is not appropriate in this application as there is really no reason to  favor short articles over long articles (they are all Wikipedia articles, after all). Many Wikipedia articles are 2500 words or more, and both Obama and Biden are over 2500 words long. "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Note:** Both word-count features and TF-IDF are proportional to word frequencies. While TF-IDF penalizes very common words, longer articles tend to have longer TF-IDF vectors simply because they have more words in them."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true
   },
   "source": [
    "To remove this bias, we turn to **cosine distances**:\n",
    "$$\n",
    "d(\\mathbf{x},\\mathbf{y}) = 1 - \\frac{\\mathbf{x}^T\\mathbf{y}}{\\|\\mathbf{x}\\| \\|\\mathbf{y}\\|}\n",
    "$$\n",
    "Cosine distances let us compare word distributions of two articles of varying lengths.\n",
    "\n",
    "Let us train a new nearest neighbor model, this time with cosine distances.  We then repeat the search for Obama's 100 nearest neighbors."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 78,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<pre>Starting brute force nearest neighbors model training.</pre>"
      ],
      "text/plain": [
       "Starting brute force nearest neighbors model training."
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "model2_tf_idf = graphlab.nearest_neighbors.create(wiki, label='name', features=['tf_idf'],\n",
    "                                                  method='brute_force', distance='cosine')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 79,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<pre>Starting pairwise querying.</pre>"
      ],
      "text/plain": [
       "Starting pairwise querying."
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>+--------------+---------+-------------+--------------+</pre>"
      ],
      "text/plain": [
       "+--------------+---------+-------------+--------------+"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>| Query points | # Pairs | % Complete. | Elapsed Time |</pre>"
      ],
      "text/plain": [
       "| Query points | # Pairs | % Complete. | Elapsed Time |"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>+--------------+---------+-------------+--------------+</pre>"
      ],
      "text/plain": [
       "+--------------+---------+-------------+--------------+"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>| 0            | 1       | 0.00169288  | 22.983ms     |</pre>"
      ],
      "text/plain": [
       "| 0            | 1       | 0.00169288  | 22.983ms     |"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>| Done         |         | 100         | 656.919ms    |</pre>"
      ],
      "text/plain": [
       "| Done         |         | 100         | 656.919ms    |"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>+--------------+---------+-------------+--------------+</pre>"
      ],
      "text/plain": [
       "+--------------+---------+-------------+--------------+"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "nearest_neighbors_cosine = model2_tf_idf.query(wiki[wiki['name'] == 'Barack Obama'], label='name', k=100)\n",
    "nearest_neighbors_cosine = nearest_neighbors_cosine.join(wiki[['name', 'length']], on={'reference_label':'name'})"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 80,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div style=\"max-height:1000px;max-width:1500px;overflow:auto;\"><table frame=\"box\" rules=\"cols\">\n",
       "    <tr>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">query_label</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">reference_label</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">distance</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">rank</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">length</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">0.0</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">1</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">3278</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Joe Biden</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">0.703138676734</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">2</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">2523</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Samantha Power</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">0.742981902328</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">3</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">1911</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Hillary Rodham Clinton</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">0.758358397887</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">4</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">3472</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Eric Stern (politician)</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">0.770561227601</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">5</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">1589</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Robert Gibbs</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">0.784677504751</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">6</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">1572</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Eric Holder</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">0.788039072943</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">7</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">1430</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Jesse Lee (politician)</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">0.790926415366</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">8</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">1374</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Henry Waxman</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">0.798322602893</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">9</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">1607</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Joe the Plumber</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">0.799466360042</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">10</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">1422</td>\n",
       "    </tr>\n",
       "</table>\n",
       "[100 rows x 5 columns]<br/>Note: Only the head of the SFrame is printed.<br/>You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns.\n",
       "</div>"
      ],
      "text/plain": [
       "Columns:\n",
       "\tquery_label\tstr\n",
       "\treference_label\tstr\n",
       "\tdistance\tfloat\n",
       "\trank\tint\n",
       "\tlength\tint\n",
       "\n",
       "Rows: 100\n",
       "\n",
       "Data:\n",
       "+--------------+-------------------------+----------------+------+--------+\n",
       "| query_label  |     reference_label     |    distance    | rank | length |\n",
       "+--------------+-------------------------+----------------+------+--------+\n",
       "| Barack Obama |       Barack Obama      |      0.0       |  1   |  3278  |\n",
       "| Barack Obama |        Joe Biden        | 0.703138676734 |  2   |  2523  |\n",
       "| Barack Obama |      Samantha Power     | 0.742981902328 |  3   |  1911  |\n",
       "| Barack Obama |  Hillary Rodham Clinton | 0.758358397887 |  4   |  3472  |\n",
       "| Barack Obama | Eric Stern (politician) | 0.770561227601 |  5   |  1589  |\n",
       "| Barack Obama |       Robert Gibbs      | 0.784677504751 |  6   |  1572  |\n",
       "| Barack Obama |       Eric Holder       | 0.788039072943 |  7   |  1430  |\n",
       "| Barack Obama |  Jesse Lee (politician) | 0.790926415366 |  8   |  1374  |\n",
       "| Barack Obama |       Henry Waxman      | 0.798322602893 |  9   |  1607  |\n",
       "| Barack Obama |     Joe the Plumber     | 0.799466360042 |  10  |  1422  |\n",
       "+--------------+-------------------------+----------------+------+--------+\n",
       "[100 rows x 5 columns]\n",
       "Note: Only the head of the SFrame is printed.\n",
       "You can use print_rows(num_rows=m, num_columns=n) to print more rows and columns."
      ]
     },
     "execution_count": 80,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "nearest_neighbors_cosine.sort('rank')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "From a glance at the above table, things look better.  For example, we now see Joe Biden as Barack Obama's nearest neighbor!  We also see Hillary Clinton on the list.  This list looks even more plausible as nearest neighbors of Barack Obama.\n",
    "\n",
    "Let's make a plot to better visualize the effect of having used cosine distance in place of Euclidean on our TF-IDF vectors."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 52,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<matplotlib.figure.Figure at 0x7f028c09bf50>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAt4AAAEuCAYAAAC57hXbAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzs3Xd4VNXWwOHfmgAhhB4SgnRQjICo9CIQOoJSpAjXghUs\niCiICKgBKaIXUC7YUMGCClJEvIAgEBRCqJ8FLHgREKQXpQdJ1vfHmQwzk0kPCcp6n+c8yeyzdjln\nZpI9e/bZR1QVY4wxxhhjzMXlyusGGGOMMcYYczmwjrcxxhhjjDG5wDrexhhjjDHG5ALreBtjjDHG\nGJMLrONtjDHGGGNMLrCOtzHGGGOMMbnAOt7GGABE5G4RSRKRu/Kg7ubuup/1S08SkRW53R6v+mNF\nJCmv6s8uEekoIvEi8qf7XE7MRll5+lxc7kRkp4j8mtftyI5/wjEYk13W8TbmH0REKro7SN7bSRHZ\nIyJLRWS4iJRNJbu6t6zWnd2OWbbqzwoRiXG3u1kabfpbdrxFpAowFygHvAHEAEvysk0mWx/mLvmb\nbmTw/WTMZS1fXjfAGHNRbAM+dP9eEIgEGgGjgBEi8rSqvuyXZx6wFtiXa628YB1wDXA4l+tNr7N/\nJ1Aol9qS01oC+YHHVfWTvG6M8cj1D5i56J98bMbkCOt4G/PPtE1VR/knishNwHRggoicUNW3k/ep\n6gngRC620UNVz+J8WMhtktZOVd2TWw25CK5w/zyQp60wl5M030/GGJtqYsxlRVUXA91x/kGOE5GQ\n5H0i0ifQHG8Rae2eprJXRM6KyD4RWSEit7n3N3d/da5AtN80l7vcMZ754yLSWUTWiMgJEdnsXYb/\nHG+vNlQQkU9E5Ih76sxyEakXIC7VOaT+X/GLyEogub5Yrzb/mloer/RwEZniri/BfW5miEil1Nok\nIqEi8oqI/O4+j9+KSLdAbU1NRupNnm6EM7VEvI4tUUQqZKCOHiLyfyJyxj1F6SURKZhGfC0RmSsi\nB93HtU1ERotIaCrxLUVkoVf8DhF5X0Sqe8WkOh3DfbxJ3sfi/dp1v77Wi8gp93l6wivuSXf7zojI\nVhG5OZU6SovIZBHZ7m7jfncbKwWITXK/HyJE5F33cZ0WkbUi0tw/Fmjm/OrzPnkntfObHhEp4j7f\nP7qP67CIzBeRWgFiM/1aFJHaIrLM/X496n4fVsjK+8krNtvvBWP+rmzE25jLjKquFpGvgKZAK+Bz\n793ese6OyQKc6ScLgCM401bqAt2AWcBOnE5ejPv3GV5FfONVrgK93HV+BnxFxv4GlQC+Bn4HXseZ\ns3wbsEpEWqpqfGrt9+P/Nfh0989m7jbvdD/+I408iEg4sB6oACwDZgJX40xL6SAiN6rqNr8y8gNL\ngeLAHJzpK72AWSLSXlW/TKPdma33D5znIhpoDrzrPjb1O7ZAddwLvAUcdf88C9wKRKUS3xxYhDOI\nMwvYC7QAhgFtRaSpqiZ4xQ8CXgKOA/Pd8eVxpsVsAH5wh6Y1ZSG1fYrzmmzpLnu1u+0vichpoCbQ\nCef17gLuAOaKSHVV3e7VxiuBVUCE+9jmuNvYA2gnIg1UdYdf3cXd9f0BvO/O2wtYIiJ1VDX5uGKA\ne3CewxgujBB/QxaISBjOe+NqYKX72MLc56GNiLRS1XV+5yjDr0URuQHnfZof5/ndjfN+WY3zGsns\n+4nM1G/MP5Kq2mabbf+QDaiIczHgZ+nEjQQSgRivtD7utLu80uYCZ4CwAGWU8HucBKxIpb4+7v1/\nAU0D7G/u3v9sgDITgXf80lu6933jl74D+DWVNqwEEv3SnnOX3ywTeWa48wz3S7/b3ablAdqU6D6X\n+QIcw6IMPreZrTfNYwtQflHgT+AYUMErvRCwxV3WCq90F7AdOA/c6FfWdHf8M15p17ljfwUi/eJd\nQHha5z1A2d5tTH59nQFqeaVf4U475j6G4l77bnXnmexX/lp3niZ+6Q2Ac/i9t7xeo/7l3Ove92p6\nr6kMPj8pXtvAR+66e/qlV8Hp8H6bndcisMYd38Ev/a3k487k+ylH3gu22fZ33myqiTGXp704o22l\nMhD7F84/Sx+qeiwL9c5T1a8zmScReMav7hU4o77Xish1WWhHlohIAaAncBBn5Na7TTNwOnfRIlIu\nQPbHVfW8V/wKYBeQYspMDtebUZ2BIsCbqvqbV/mngTGknL97I1AZpyO62m/fMJzXTR+vtAfdZQxX\n1f1+x5Ckqoey0fZk76vqd17l7sUZnS0KjFVV79HX+Tgd6WuTE9wjvA2At1V1jV8b1+F863OTiBTx\nq/cUMNQv7V2cDxrpPr9Z4R7t7gEsVtXZfm39FZgG1PSewuMl3deiiFTEuSB7naou8sv/HM6xZVWW\n3wvG/N3ZVBNjTFpmAV2ALSLyEbACWKOqx7NY3qYs5Nmlqr8HSF8NtMYZSf02i+3JrKtxVolZqqrn\nAuxfBdRwt8n7wsw/vDuzXvYADS9ivZlxHc7UgTUB9vl3rL3jv/Lfoar7ROQXoLqIhKrqKZzpSeB8\nYLpYvguQti/QPlVVETnEhYtQwel0A5QTkecClFUGZ3T+KmCzV/o29wcU7/ITReQAzpSKi6Geuy2h\nqbT1GvfPKC5M4YGMvxaTP9DG+weq6u8i8hvOB6/Myu57wZi/Net4G3N5Su5spDnKqKqzReQc8AQw\n0P0zUUSW4IxabU8rfwBZWWHjYBplCVAsC2VmVVGvugPZ7xeX7M9U4s+TsYvcs1pvZiSfx0CviUD1\nZqRN1d1xp9zln1fVi7VkpOLMHfeX/G1NoH3nceYcJyvp/nmLe0utHv8LR1P7IHoeCEplX3Ylt7WZ\ne0uNf1sz+lpMHtVP7W/EQbLW8c7ue8GYvzV7kRtzeWqO04HYmF6gqn6qqs1w/tHfjHNR383AIhHJ\nzIf3rK7xG5FKeml3ed7/yJNIfUAhJzroyR2s0mm0yTsup+RGvcnnMTyN8v3bJJlo0x9APhHJyPSm\nJAARCfQ/6mJ+0Epu64OqGpTKli8L06UuhuS2jk+jrUGq+n4Wy09eWjTQ6wFSf18aY9JgHW9jLjMi\n0hRnhOwQztSRDFHVE6q6WFXvwZnreiUXvs4Gp7N0MUb3Kkrgu202df/0nmZyDIjw77CJSCGc6QH+\nkkdDM9run3FW+qgvIvkD7E8eeczpqS+5Ue+3OB3pGwPsaxogLXkljhSjrSISCVTDuRjwlDt5g/tn\n2wy0Jfn6AZ/nXUSEC1MgLob17p+NLmIdieA5luzYgPPB82JNz0h+LaUoX0SuwFmZxV9m30/GXHas\n423MZUREOuCsKKDAMFU9k078jQE6scKFUbCzXruO4iz1l9OCgNF+bWiFM7/7e1X17mxuwJk6cLtf\nGS+Q8it3cNosOMvFpcs9v3oWzmjuIL829QFqASs1h2+8k0v1foYzyvmA+K4LXhjnYkn/bytW46xQ\n0klEmvjtG4vzPLzrlfamu4wx7o6b9zEEuZdLTLYB53m526/cQWRtekOGqOp6nM73nSLS2X+/iOQL\ncKyZddT9M0OvudSo6gGc5fiai0j/QDGS+q3bM1L+Lpz53Q3EufGWt5EE/mYpU+8nYy5HeTLH233l\n/cs4/zgF+BIYqKq7M5A3GOef8O04F618Azzl/9Wfu3MwFOiLs+7wz8AoVZ2XRtmNcf6ZKJBfVZP8\n9nfBuUHANTjzGqcB4/zjjLkEVPO64CoY5z3QGGcU8izO/OxAN+3wH4X7DxApImtw1uUVnHWarwMW\nquovXrErgB4iMh/4P5zRrwWquiWVsjPqO6CFiMQBsVxYU/kM0M8vdgrOOslvi0hbnFH9pjjTE77F\n6aB6W4nzfh8nIjVxplv8oapT02jPEJypOmPc61hvxrmArYu7voezdpjpuqj1quqfIvI4zt+1TSLy\nMc45vhVn1ZTqfvHqXvd7MfCliMzGWWs9GmeUdANeK7Co6rciMsSd9qOIzMNZXacsztruLwGT3eHT\n3ccb415pZDvOxZk1cC4kDdShzKm7Jv4L57U8X0RW47yWz+Ms1dkUZy37QCuFZNQKnJtYzRORxTjv\nx29V9fO0swX0EM6Ft6+IyD3AOuAkzmh0Q5zpIIWy0db+OBfPfup+fn/DOQcVcd6XNf3is/J+Muby\nktvrFwIhwC84b9rkC1i+c6eFZCD/TJxP1ffidADmAqfxWrvVHTcG55/G4zj/rF7D6Qi0T6XcfO52\n/O6Oc/ntb4fzx/c1d3kD3eWPy+1zaJttqW04/xAT/baTODe++ALnw+gVqeQNtI53D+Bj9/vzJHAY\nZ0TwYbzW4XXHlsZZV/gAF5YgvCu1sv3yNsdv3Wd3eiKwHKezPdtd/0mclTHqplFWnPvvwkGcTlwp\nnE7B+QDxd+J8gD/tru9Xr32p5SmF00ncidNx2uuup2KA2B3A9lTaGrD8NJ7fzNSbqXW8vfJ1x+nU\nn3a/bl7E+fCWiN9a4e74Wjgjr4fcbdoGPA8USqX81jg3pjniruNXnDXKr/GLuxbnRisncKaezMVZ\nn3o6zt9i/3W8A76+AsWn99zg3LRpDM4HjlM489O34nwoaRHoNZrKsaYoH+cbnHHufQkEWKc+o2W5\n00Nw3teb3OfqOM5A00ygc3Zfi0Btr+fhCPAJTsf+O+BYJt9POfZesM22v+smqlm51inrROQx4N9A\nNXXf/cv9teYvwJOq+nIaea/DGX24W1Xfc6cF4fxB/ElVu7jTwnH+YYxV1VFe+b8ESqnq9QHKHoZz\n96zPgKfxG/EW59bWf6hqS6+0Z4DhOH/QU1t5wRhjjPnHEJFQnA+136uqLQFoTCbkxRzvW4B49brl\nrqruxFk7NsWcOj+dcG544LlZgKom4ozItfO66Kg9zvzCmX75P8C54UZF70QRqYrTgX4IZ6QOv/3l\ngOvd+b29DxQA/Oe/GWOMMX9r7jntYX5pgvMtSEHg0zxpmDF/Y3kxx7sGgd+sW3G+4kxLdWCHqp71\nS9+K0wG+EvjRHZegKdcY3oozD7A6zl2ykr0OzFLVNSLSOpU2qzu/h6ruFJHTZG++nzHGGHMpKgbs\nEZGluKeD4qx6cy3OTXkmp5HXGBNAXnS8S3JhqShvR3Hm1WU1b/L+5J9/ZCAOEbkDuAFnmkla9ZJK\n3ce8yzPGGGP+IU4C7+Bc/BqNM9d/NzARGK1+d+s0xqTvsr5zpYiUBCYAT6vqkbxujzHGGHOpUNUE\n4JG8bocx/yR50fE+RuCR7dRGs/3zBlq0P3nE+ahXXPEMxI3GWRVgjogk3w0txP2zuIicdX+iT25X\noHaX8CrPh4jk7pWrxhhjjDEm01Q1p5YkTVNeXFy5FWfOtL/qOHPG0stbWUQK+qXXwLno8n9eccEi\nUiVAnHrVcw3OUlhHcDrXx3DWjhWcZcuSL6ZMnhvu0273RZqF0mp3Xi9bc6ltzz33XJ634VLb7JzY\nObFzYufEzomdDzsnebflprzoeH8GNPS7M1oloAnObajTshDnIsoeXnmDgJ7AF6qavCLJEpx1W/3v\nXncHsEWdO3IBPIazFni01/YuTue8JTACQJ0b+3wboLw7cTr8i9NptzHGGGOMuczlxVSTaThzxha4\n18EGGIWzysibyUEiUgHnxgoxqjoaQFW/EZFZwMsiUgBnMf6HgUpA7+S8qnpIRCYCT4vISZybQfTC\n6Vjf4hX3nX/jRKSF+9ev1PeOlMOAhSLyOs5NQmrjLEH4stoa3sYYY4wxJh253vFW1dMi0hKYBLzH\nhVvGP66+V0iL1+btbpw7ij2PM4/7W6Cdqn7rFzcM505bA7hwy/geqpqR0ekU3zuo6mIR6Y5zN7g+\nOHfnGw2MzUB5xi06Ojqvm3DJsXOSkp2TlOycpGTnJCU7J77sfKRk5yRv5fqdKy8nIqJ2fo0xxhhj\nLl0igv6DL640xhhjjDHmsnNZr+NtjLl0yUjfwQd9zr49upQ4dw6/wL7dM8aY9FnH2xhjTK6qVKkS\nu3btSj/QGGNySMWKFdm5c2deN8M63sYYY3LXrl27bITcGJOr/L+lyys2x9sYY4wxxphcYB1vY4wx\nxhhjcoF1vI0xxhhjjMkFto73RWTreBtjTEruNXPzuhnGmMtIWn93bB1vY4wx5hIWExNDeHh4XjfD\nx7Rp01iwYEGK9MqVKzNkyJCLVm9cXBx16tQhJCSEoKCgVONcLpdnCwoKomzZsvTq1euSWGnCX4sW\nLejZs2eW8m7dupXbbruN0qVLExISwtVXX81zzz3H6dOnfeJmzJiBy+VKkW7+2azjbYwxxmSSiFwy\nqyQke/PNNwN2vC+2fv36UaJECZYtW8batWvTjH3yySeJj48nLi6OCRMmsHnzZm6++WaSkpJyqbUX\n18qVK6lfvz6///47U6dOZenSpTz44INMnTqV6Ohon072pfgaMhefLSdojDHGmCz76aef6NevHzfe\neGO6sRUrVqR+/foANGjQgGLFinHzzTezbds2oqKistWOhIQEgoODs1VGdpw5c4Y77riDevXqsXz5\ncs/of9OmTWndujV16tRhxIgRTJw4Mc/aaPKejXgbY4wxF8GxY8fo27cvkZGRhISE0KRJE9avX+8T\n43K5mDx5MsOHDyciIoLSpUvTv39//vrrL5+42NhYrrvuOkJCQmjQoAEbNmwgPDycUaNGAc7UiE2b\nNnmmLwQFBfHee+/5lPHyyy9Tvnx5SpYsSe/evTl+/Hi6x7BixQoaNmxISEgIkZGRPPLII5w6dQqA\nVatW4XK5SEpKYsCAAbhcLu69995MnaPChQsD+BzvokWLaNu2LaVLl6ZYsWI0atSIZcuW+eRLnuqz\nZs0a6tevT0hICHPmzOH06dM8+uijREVFERoaSpUqVejfvz8nTpzwyZ+UlMS4ceO4+uqrKViwIOXL\nl0+z7cePH6dJkybccMMNHDlyJGDM7Nmz2b9/P2PGjEkx5ebaa6/ljjvu4K233uLs2bM++3744Qea\nNWtGoUKFuPrqq/n000999mfmfKxfv5569epRqFAhmjZtyq5duzh06BBdu3alSJEiVK9enZUrV/rk\nff/992natClhYWGULFmSli1bsmnTplTPhcke63gbY4y5JCV/Fe+/5VT8xXTu3DlatWrFihUrmDBh\nAgsWLCA8PJw2bdpw8OBBn9iJEyeyb98+Zs6cyZAhQ3jjjTd45ZVXPPv37t1Lx44diYyMZO7cufTr\n14/bb7/dpwP36quvEhUVRceOHYmPj2ft2rV07NjRs3/WrFmsWLGCadOm8eKLL/L5558zbNiwNI9h\n69at3HTTTURERDBv3jxGjRrFhx9+SI8ePQCoU6cO8fHxqCqDBw8mPj6eZ555Js0yk5KSSExM5Pz5\n82zbto2YmBiqVatGzZo1PTE7duygU6dOfPDBB8ybN48mTZrQoUMHn2ksIsLp06e5++67eeCBB1iy\nZAn169fn9OnTnk71kiVLGD16NCtXrkwxX7tv376MHDmSXr168d///peJEyemOtf66NGjtGrVisTE\nRGJjYwkLCwsY9/XXX1OiRAmaNGkScH+XLl04deoUmzdv9qSpKr169aJLly7Mnz+fWrVq0bNnT77/\n/vssnY9+/frxxBNP8PHHH7N7927uuOMOevfuTdOmTZk/fz5ly5alZ8+ePq+dXbt20adPH+bMmcNH\nH31EhQoVaNas2SU59/4fQVVtu0ibc3qNMVlBDD6bubQAPltm82aljvTqymx8dsTExGh4eHiq+996\n6y0NDg7W7du3e9ISExO1atWqOmTIEE+aiGh0dLRP3i5dumijRo08jwcPHqzh4eGakJDgSZs9e7aK\niI4cOdKTVrduXb3nnntStKVSpUp65ZVXamJioidt4MCBWqZMmTSP8bbbbtNq1appUlKST70ul0vj\n4+N9jmHq1KlplpUc53K5VEQ8W4UKFXTLli2p5klKStLz589ru3bt9L777vOkx8TEqMvl0oULF6ZZ\n5/nz53XNmjXqcrl09+7dqqr6008/qYjolClTUs0XHR2tPXr00EOHDmmtWrW0adOmeuLEiTTrat++\nvdauXTvV/d98842KiM6ePVtVVWfMmKEioi+88ILP8UZFRWnv3r0DlpHe+fj66689aa+++qqKiI4e\nPdqT9sMPP6iI6JIlS9IsPyoqSp9//vk0j/fvJr2/HZpLfUMb8TbGGGNy2PLly6lTpw4VK1YkMTGR\nxMREkpKSaN68ORs3bvSJbdOmjc/j6tWrs2fPHs/jjRs30qZNGwoUKOBJ69SpU6ba06JFC1yuC//y\nq1evzsGDB0lMTEw1z4YNG+jatavPtwbdunUjKCiI1atXZ6r+ZEOGDGHjxo1s3LiRRYsWcd1113HT\nTTexb98+T8zvv/9Onz59KFeuHPny5SN//vwsXbqUbdu2+ZQlIrRv3z5FHe+//z61a9emSJEi5M+f\n3zP3PDn/ihUrEBH69OmTZlv3799P8+bNCQ8P54svvvBMi8lJIkKXLl18Hnfu3NlnSlJGz0eBAgV8\n5tlfeeWViAgtWrTwSUsuM9mPP/5I165diYyMJCgoiPz587Nt27YU5ZuckScdbxEpJyJzROQPEflT\nROaKSPkM5g0WkZdEZK+InBaROBFpGiBORORpEdkhImdE5BsRuTVA3HQR+cHdjhPuuP4i4vKLixWR\nJL8tUUQGZP1MGGOM+Sc6fPgwa9euJX/+/J6tQIECzJgxg927d/vEFi9e3OdxgQIFfKYC7N+/P8XS\nhcHBwZnqCAaqQ1VJSEhINc++ffsoXbq0T5rL5SIsLIyjR49muG5v5cuXp3bt2tSuXZv27dszZ84c\nzp49y6RJkwDnW/hbbrmF+Ph4Ro8eTWxsLBs3buSmm25KMTe6RIkS5Mvnu0bE/Pnz6dOnD02aNGHO\nnDmsW7eO+fPno6qe/EePHiU0NDTd8/fDDz/w008/ceeddxISEpLusZUtW5Zdu3alun/Xrl2ICGXL\nlvVJj4iISPE4+YNIZs5HkSJFfB4nf1Dzfu7z588P4Ml78uRJ2rZty++//86kSZNYvXo1GzdupFat\nWinKNzkj11c1EZEQYCVwBrjTnTwGWCEitVT1TDpFvAPcBAwGdgD9gS9EpKGqfucVNxp4AhgGbAZ6\nAZ+ISEdVXeIVFwxMBrbjfC3ZDngFqAo87hWnwLdAX8B70uDODBx2zvjrL4iJCbxv+HAoVCjjZb37\nLgT6NNu1K9Stm6XmGWNMTtJM3mQns/EXU8mSJalXrx6vv/56inZlduWNyMhIDh065JOWkJDAyZMn\ns93OtJQpUybFfPSkpCSOHDlCyZIlc6SOAgUKUKVKFX788UcA/ve///HNN9/wxRdf+HwTcOZMyq5B\noPn7c+bMoWHDhvznP//xpH311Vc+MWFhYZw6dYqTJ0+m2flu2bIlN9xwAw888AClSpXymTMfSLNm\nzZg+fTpxcXE0btw4xf4FCxYQGhpKnTp1fNIPHjxIiRIlfB6XKVMGyNz5yIq4uDj27t3LihUruOqq\nqzzpf/75Z46Ub1LKixHvvkAloLOqLlTVhUAnd1q/tDKKyHVAb2Cgqr6jqiuBnsBvwCivuHBgEDBO\nVSep6ipVfQinw/+Cd5mq+i9VfV1Vl6nql6r6JDALCHR58wlV3aCq6722gwHiLg5V+OKLwJvfFfDp\n2rQpcDleX28aY4zJmlatWvG///3PZ4Q3eatRo0amyqpXrx7Lli3zGZ0OtF63/0h5djVo0MAzWpxs\n7ty5JCYmZmjpwIw4e/Ys27dvp3x550vv5A6l97SaXbt2sWbNmgyVd+bMmRQfbD744AOfTnrLli1R\n1RSrvgTy9NNPM2jQILp3705sbGyasT169CAyMpLhw4enmMKzZcsWPvjgA/r27evTPlVl/vz5Po8X\nLFhAgwYNPMcDWT8f6Ul+vXiXHxcXZxdWXkR5sY73LUC8qu5ITlDVnSKyBugMvJxG3k7AOWC2V95E\nEfkYeEpE8qvqX0B7ID8w0y//B8DbIlJRVVP/PgiOAuczc1DGGGMuLwkJCcydOzdFenR0NHfddRev\nv/46zZs3Z/DgwVSpUoUjR46wfv16ypQpw2OPPZbhegYOHMjUqVO5+eabefzxx9m3bx/jx48nNDTU\nZ952VFQUS5cuZenSpYSFhVG5cuVsjUyPGDGC2rVr07lzZx566CF2797N0KFDad++vadjmFk7d+5k\n3bp1ABw6dIgpU6Zw/Phx7rvvPs8xlCtXjkGDBjFq1CiOHz9OTEwM5cqVy1D5bdq0oX///owdO5YG\nDRqwaNEiVqxY4RNTrVo1+vbty6BBgzhw4ADNmjXj2LFjzJ07l48++ihFmePGjePEiRN06tSJZcuW\npXrsISEhzJw5k5tvvpno6GgGDBhA6dKl2bhxI+PGjeOGG27wLP/o7a233iJ//vzUrFmTadOmsX37\ndmbNmpUj5yO9b4EaNmxIaGgo999/P0OGDGH37t2MHDkyw+WbzMuLjncN4NMA6VuB7unkrQ7sUFX/\nj/RbgQLAlcCP7rgEVd0eIE7c+3063iISBBQGWgN34Tcy7naDiPwBFHLX84qqvpNOm40xWaDPXTrT\nBkxKl9K0jrxy8uTJgLcVX7lyJc2aNSM2NpZnn32WmJgYDhw4QEREBPXr16dz586e2IwseXjFFVew\naNEiHnvsMbp168Y111zD9OnTad26NUWLFvXEjRgxgt27d3Pbbbdx/Phxpk+fzl133ZXlZRWrV6/O\n4sWLGTZsGN26daNo0aLcfvvtjB8/3icuo+WLCBMmTGDChAmAM+Xj2muvZdmyZZ7pFwUKFGD+/Pk8\n8sgj9OjRg3LlyjF8+HBiY2PZsmVLunX069ePHTt2MHnyZM6ePUvbtm356KOPaNiwoU/ca6+9RqVK\nlXjrrbcYP348ERERtGvXLkV7k02ZMoVTp07RoUMHYmNjufbaawPWHx0dzfr16xk1ahT9+/fn+PHj\nVKxYkf79+zNkyJAUc8VFhI8//piBAwfyzDPPUL58eWbPnk2tWrVy5HwEel68n6+IiAjmzJnD4MGD\n6dKlC1dddRVvvPEGL774Yrplm6yR3P7jKSIJwARVHeaX/jzwlKoWCJwTROQLoIiqNvZLbwUsBZqp\n6hoReQM6MqiBAAAgAElEQVS4RVWv8IurCvwC3KmqM73SOwIL3Q+TgBdUdYRf3hhgN7ANKI7TOe8G\njFDVsam0V3P0/J47BwHmjQGwfDkUK5bxsgYMgLi4lOkjRoDXFdbGGJPTRMQ67tm0evVqmjVrxsqV\nK2nevHleN8eYS15af3fc+3Jl0X+7ZbzjK6AuUAxoBTzpfhI8nW9VjfHLs1BE5gHDReRlVQ288r4x\nxhiTTUOHDuWGG24gMjKSn376idGjR3P99ddbp9uYv5m86HgfA0oESC/p3pde3gqp5AVnbnZyXPEM\nxAGgqidwVj4BWCkifwEjRGSqqu4jdR/hzEu/FliXTtuNMcaYLElISGDIkCEcOHCAIkWK0K5dO8+U\nDWPM30dedLy34szz9lcd+CEDebuISEG/ed41cC66/J9XXLCIVFHVX/3iNAP1bMRZ8aUykFbHO1mq\n35nGeC3/Fx0dTXR0dAaKM8YYYy6YNGmSZ61rY0z2xMbGprtKzcWSFx3vz4CXRKSSqu4EEJFKQBNg\nSDp5FwIjgR7A++68QThLCn7hXtEEYAnOqiS3A8975b8D2JLOiiYA0Tid6V/TibsDZz3y71MLiElt\n3W1jjDHGGJPr/AdCR44cmWt150XHexrwCLBARJ5xp43CWWXkzeQgEamA0/GNUdXRAKr6jYjMAl4W\nkQI4N9B5GGcN8N7JeVX1kIhMBJ4WkZNcuIFONM5yhsl1dADuwenQ/wYUAToA9wOvq+p+d9yNwFBg\nHs4Nc4oBdwM341wQmjMr2RtjPGSk73UutsrJpcV/tQS7WNIYY9KX6x1vVT0tIi2BScB7OMv7fQk8\n7neBonht3u7GudPl8zjzuL8F2qnqt35xw4ATwAAgEvgZ6KGqi71itrvLfx6IAP7gwqonH3vF7XPH\njQRKAX8B3wG9VXU2xhhjjDHGpCNPVjVR1T0400XSitkFBAVIT8C5XfzgdPIrMNa9pRbzM+mvHY57\nPfC07xVrjDHGGGNMGvLilvHGGGOMMcZcdqzjbYwxxhhjTC6wjrcxxhiTSTExMYSHh+d1M3xMmzaN\nBQsWpEivXLkyQ4akt2hY1sXFxVGnTh1CQkIICkoxQ9TD5XLx6quvXrR2eHv33XdxuVyerWDBgkRF\nRTFu3DiSkpI8cbt27cLlcrFo0aI0y5syZQoul3WZTPbZnSuNMZckW8Xk0na5r2IiIilWdslrb775\nJtdeey2dO3fO1Xr79etH6dKlWbZsGQUKFMjVutMiIqxcuZKCBQty9uxZvv76a5555hlEhKFDhwJQ\npkwZ4uPjiYqKSresS+35Nn9P1vE2xhhjTJb99NNP9OvXjxtvvDGvm5JC3bp1KVSoEADNmjXju+++\n49NPP/V0vAsUKED9+vXzsonmMmPfmxhjjDEXwbFjx+jbty+RkZGEhITQpEkT1q9f7xPjcrmYPHky\nw4cPJyIigtKlS9O/f3/++usvn7jY2Fiuu+46QkJCaNCgARs2bCA8PJxRo0YB0KJFCzZt2sSMGTNw\nuVwEBQXx3nvv+ZTx8ssvU758eUqWLEnv3r05fvx4usewYsUKGjZsSEhICJGRkTzyyCOcOnUKgFWr\nVuFyuUhKSmLAgAG4XC7uvffeTJ2jKVOmUK1aNQoWLMhVV13Fyy+/nCJmy5YtdOzYkaJFi1K0aFF6\n9uzJgQMHMlVPsiJFivic20BTTc6dO0f//v0pUaIEpUqV4oknnkjxfEDOPr/m8mEdb2OMMSaHnTt3\njlatWrFixQomTJjAggULCA8Pp02bNhw8eNAnduLEiezbt4+ZM2cyZMgQ3njjDV555RXP/r1799Kx\nY0ciIyOZO3cu/fr14/bbb+fs2bOemFdffZWoqCg6duxIfHw8a9eupWPHC6vgzpo1ixUrVjBt2jRe\nfPFFPv/8c4YNG5bmMWzdupWbbrqJiIgI5s2bx6hRo/jwww/p0cNZDbhOnTrEx8ejqgwePJj4+Hie\neeaZNMv0Nm3aNAYMGECXLl34/PPP6dmzJ4MGDeLFF1/0xGzfvp0bb7yRc+fOMXPmTN599122bt1K\np06dMlTH+fPnSUxM5PTp0yxevJjZs2dz6623+sT4TyF56qmneOedd3juueeYOXMmv/32GxMmTPCJ\nycnn11xmVNW2i7Q5pzcHJSSo1qkTePvjj8yV9eijgcuZPz9n22yMMX4y+reRGAJuORWfHTExMRoe\nHp7q/rfeekuDg4N1+/btnrTExEStWrWqDhkyxJMmIhodHe2Tt0uXLtqoUSPP48GDB2t4eLgmJCR4\n0mbPnq0ioiNHjvSk1a1bV++5554UbalUqZJeeeWVmpiY6EkbOHCglilTJs1jvO2227RatWqalJTk\nU6/L5dL4+HifY5g6dWqaZfnHJSUladmyZfW+++7ziXn44Ye1ePHinmO94447NCoqSs+fP++J+eWX\nXzQoKEgXLVqUal0zZsxQEfHZXC6Xdu/e3ec87Ny5U0VE//vf/6qq6pEjRzQkJERfeuklT0xSUpJG\nRUWpy+XypOXk82tyR1p/d9z7cqVvaCPexhhjTA5bvnw5derUoWLFiiQmJpKYmEhSUhLNmzdn48aN\nPrFt2rTxeVy9enX27Nnjebxx40batGnjc+FiRkd8k7Vo0cJnVY7q1atz8OBBEhMTU82zYcMGunbt\n6jMi3K1bN4KCgli9enWm6ve3Z88e9u7dS/fuvvewu+222zh+/Djff/894JzHrl27AnjOY6VKlahU\nqVKK8+hPRFi9ejUbN24kPj6et99+m/j4eO6///5U83z//fckJCT4nF8RSXHBak4+v+byYhdXGmMu\nSTLS9+tfW+Xk0uL/9bxe5quc+Dt8+DBr164lf/78PukiQtWqVX3Sihcv7vO4QIECPtNI9u/fz3XX\nXecTExwcTOHChTPcnkB1qCoJCQmeiw/97du3j9KlS/ukuVwuwsLCOHr0aIbrTq1sEUlRfunSpVFV\nT/mHDx9m/PjxvPDCCz5xIsLu3bvTref666/3HF/9+vUpVqwY3bp1Y/DgwVSvXj1F/P79+wGIiIjw\nSfd/nJPPr7m8WMfbGGOMyWElS5akXr16vP766yk+lAQHB2eqrMjISA4dOuSTlpCQwMmTJ7PdzrSU\nKVMmxXzlpKQkjhw5QsmSJbNdtqqmKD/5osmwsDDAOY+33norDzzwQIrzWKpUqUzXe8011wDw448/\nBux4R0ZGAnDw4EGfDrP/xZw5+fyay4t1vI0xxlySMvstx6X0rUirVq0YOnQo5cuXz1IH0Vu9evWY\nMWMGCQkJnk5doBvl5PRIaoMGDZg/fz5jx471fMMxd+5cEhMTs710YLly5bjiiiv45JNPaNeunSd9\n1qxZFCtWjJo1awLOedy6dSs33HBDtupL9v333yMilC9fPuD+a6+9luDgYBYsWMCTTz4JON/m+J/v\nnHx+zeXFOt7GGGNMFiQkJDB37twU6dHR0dx11128/vrrNG/enMGDB1OlShWOHDnC+vXrKVOmDI89\n9liG6xk4cCBTp07l5ptv5vHHH2ffvn2MHz+e0NBQn3nbUVFRLF26lKVLlxIWFkblypWzNTI9YsQI\nateuTefOnXnooYfYvXs3Q4cOpX379jRo0CBLZSZ34EWEmJgYHnzwQUqWLEmbNm2IjY3ljTfeYNy4\ncZ757DExMTRo0ICOHTty7733UqpUKfbs2cOXX37JPffcQ7NmzVKtS1VZv349ISEhnD9/nh9++IGY\nmBjq1atH3bp1A+YpWbIkffv25dlnnyUoKIgaNWowbdo0zxKKye666y7eeOONHHl+zeXFOt7GGGNM\nFpw8eZKePXumSF+5ciXNmjUjNjaWZ599lpiYGA4cOEBERAT169f3uVAvI3dEvOKKK1i0aBGPPfYY\n3bp145prrmH69Om0bt2aokWLeuJGjBjB7t27PRcoTp8+nbvuuivLd12sXr06ixcvZtiwYXTr1o2i\nRYty++23M378eJ+4jJSfPBLvfYHo/fffT0JCAq+88gqTJ0+mXLlyTJw4kQEDBnhirrrqKuLj4xkx\nYgT9+vXjzJkzlC1bllatWnHllVemWaeI0KpVKwCCgoIoV64cnTt3ZuTIkT4fWPzb/uKLL3L+/Hme\nf/55XC4Xd9xxB4MGDWLQoEGemODgYFauXJkjz6+5vIhdEHPxiIjm6Pk9dw4aNw68b/lyKFYsZfoT\nT8Bvv6VM378fAn0lOWIEdOmSvXYakwPs4spLW3YurhQRuxgzm1avXk2zZs1YuXIlzZs3z+vmpGvL\nli3UqlWLL774IsUqH8bkhrT+7rj35conJBvx/qfbuxd27szrVhiTadbRvrRZxzl3DR06lBtuuIHI\nyEh++uknRo8ezfXXX3/Jd7pPnDhBfHw8L7zwAqVKlaJp06Z53SRj8lSerOMtIuVEZI6I/CEif4rI\nXBEJfKVDyrzBIvKSiOwVkdMiEiciKd7J4nhaRHaIyBkR+UZEbg0QN11EfnC344Q7rr+IpDg3IvKA\niPwoImdF5CcR6Ze1M2CMMcZkXEJCAkOGDKFdu3aMGDGC5s2bs3jx4rxuVro2b95M165dOXfuHEuX\nLqVgwYJ53SRj8lSuj3iLSAiwEjgD3OlOHgOsEJFaqnomnSLeAW4CBgM7gP7AFyLSUFW/84obDTwB\nDAM2A72AT0Sko6ou8YoLBiYD2wEF2gGvAFWBx73a/QDwuruty4FWwKvuryfeyNxZMMYYYzJu0qRJ\nTJo0Ka+bkWnNmze/6MseGvN3khdTTfoClYBqqroDQES+B34B+gEvp5ZRRK4DegN3q+p77rSvgK3A\nKKCLOy0cGASMVdXkv1SrROQq4AXA0/FW1X/5VfOliJQF7sXd8RaRIJyO/Luq+qxXeWWB50XkLVVN\n/fZfxhhjjDHmspcXU01uAeKTO90AqroTWAN0Ti2TWyfgHDDbK28i8DHQTkSSbyHVHsgPzPTL/wFw\nrYhUTKeeo8B5r8eNgFIBynsfCAOyt6CpMcYYY4z5x8uLjncNYEuA9K1AyttI+aoO7FBV/+U4tgIF\ngCu94hJUdXuAOAlUj4gEiUgxEekG3AVM8GszAdqdannGGGOMMcZ4y4upJiWBYwHSjwIlspE3eX/y\nzz8yEAeAiHQEFrofJgEvqOpYv3oJUHfA8owx2WfLCV7asrOcoDHGXK5sOUHHV0BdoBjORZNPui+a\nHJG3zTLGGGOMMf8UedHxPkbgke3URrP981ZIJS9cGIE+BhTPQBwAqnoCZ+UTgJUi8hcwQkSmquo+\nr3aVAA6kV563mJgYz+/R0dFER0enFmqMMcYYYy6y2NhYYmNj86TuvOh4b+XCnGlv1YEfMpC3i4gU\n9JvnXQPnosv/ecUFi0gVVf3VL04zUM9GnPnvlYF9XJjLXQPfjnfy3O5Uy/PueBtjjDHGmLzlPxA6\ncuTIXKs7Ly6u/AxoKCKVkhPcvzcBFqSTdyHORZQ9vPIGAT2BL1T1L3fyEpxVSW73y38HsEVVd6VT\nTzROBz25074WOBygvDuBIzgrshhjjLlMjBw5EpfLlWILCgriww8/zFRZy5Yt45VXXkmRfs8991C/\nfv2canIKFSpUoG/fvj5pp06dIl++fFSrVi1FfJMmTWjfvj0Aq1atwuVy8cMPF8adXC4Xr776aqr1\nBcpzsfXo0YOWLVt6Ho8cOZKIiIhcq98Yf3kx4j0NeARYICLPuNNGAbuAN5ODRKQCTsc3RlVHA6jq\nNyIyC3hZRArg3EDnYZx1wXsn51XVQyIyEXhaRE5y4QY60TjLGSbX0QG4B6dD/xtQBOgA3A+8rqr7\n3eWdd7d1qojsBb7EmQt+N9BfVb2XHjTGGJMFzZo1Y9eu9MZFcl7FihX56quvMp2vePHifPHFFyku\nLL3yyitTyRHY0qVLmTt3Lo899phP+rPPPsuZM+ndUy7rGjduTFxcnE/aunXrKFiwINu3b+fw4cOU\nKlUKgL/++ovNmzczfPhwAGrXrk18fDxVq1bNcH116tTJdJ6c9sADD9CpU6c8q9+YXO94q+ppEWkJ\nTALew5nC8SXwuKqe9goVr83b3Th3j3weZx73t0A7Vf3WL24YcAIYAEQCPwM9VNX7Hrvb3eU/D0Tg\nrITyC3Cnqn7s1+43RCQJ58Y8g3E66o/YXSuNuThsFZNL28VYxWTXrl2Eh4fneLkZqTcr8uXLR716\n9bJdf2rnsnLlyunmTUhIIDg4OEv1NmnShDlz5vDnn39SrFgxANauXUvz5s358ccfiYuL83RSN23a\nREJCAo0aNQKgSJEimR6NL1y48EUdwc+IK664giuuuCJP22Aub3kx1QRV3aOqPVS1uKoWU9Vuqvqb\nX8wuVQ1S1ef90hNUdbCqXqGqhVS1kap+HaAOVdWxqlpZVUNU9XpVne8X87OqdlfViu6YMqrazL/T\n7RU/TVWj3LFXW6fbGGNManbt2oXL5eKTTz7hwQcfpHjx4pQvX97n2p+RI0cyceJET6zL5eLee+8F\n4O677/bp2M+YMQOXy8WGDRto0aIFhQoV4t///jfgdMCHDBlChQoVKFiwINdffz2LFy8mLY0bNyYp\nKYm1a9d60uLi4mjcuDGNGjXyGQ2Pi4sjX758NGzYEMjYtJEtW7ZQpkwZ+vTpg6qmOj1l0qRJDBw4\nkLCwMEqUKMGAAQM4f973i+Tdu3fTq1cvwsLCCA0NpX379mzbts0nZs+ePXTo0IFChQpRpUoV3n77\n7RRtiomJ8flwd/r0aR599FGioqIIDQ2lSpUq9O/fnxMnTqR57ozJKltO0BhjjMmixMTEFGlBQUE+\nj5966im6devG3LlzWb58OaNGjaJmzZp0796d+++/n19++YWVK1fy6aefoqqejqGI+KyXnvz7v/71\nLx5++GFiYmIoXtxZwKtbt25s3LiRUaNGUaVKFWbNmkWnTp3YtGkTtWrVCtj266+/nkKFChEXF+eZ\nux0fH8+gQYMoWrQon3zyiSc2Li6Oa6+9ltDQ0BTtCeT//u//aNu2Ld27d+e1115LM8/EiRNp2LAh\nH374IVu3bmXYsGGEhIQwfvx4AI4dO0aTJk0IDw/nzTffJCQkhHHjxtGmTRu2bdvmGfHv1KkTR48e\nZfr06QQHB/Pss89y9OhRn/nq/uf09OnTJCUlMW7cOEqVKsXu3bsZM2YMPXv2TPeDizFZYR1vY4wx\nJgsOHz5M/vz5fdJEhB07dlChwoWVb5s3b85LL70EQKtWrVi8eDHz5s2je/fulC1bljJlyhAcHJzh\naSuPPfYY/fv39zxevnw5ixcvZtWqVdx4440AtG7dmm3btjFmzBhmzZoVsJygoCDq16/vGdn+8ccf\nOX78OPXr16do0aIMHTqU8+fPky9fPtauXcutt96aofatW7eOm266iT59+jBp0qR04707+e3atePs\n2bOMHTuWp59+muLFizNx4kTOnDnDihUrPFNiGjduTKVKlXjnnXd46KGHWLRoEd9++y3r1q2jbt26\ngDMPvWrVqgEvFE1WqlQppk6d6nmcmJhIpUqVaNq0KXv27KFcuXIZOmZjMipPppoYY4wxf3fFixdn\n06ZNbNy40bNt2LAhxRziNm3a+DyuXr06e/bsyVKdIkKHDh180pYvX05kZCSNGjUiMTGRxMREzp8/\nT8uWLdm4cWOa5TVu3Jj169ejqqxdu5YaNWpQuHBhrr/+elSVzZs3s3PnTvbt20eTJk3Sbd/q1atp\n27YtDz74YIY63UCKix1vvfVWTp8+zZYtWzzH16ZNGwoXLuw5vsKFC1OnTh3P8W3YsIHSpUt7Ot3g\nrNpSp06ddOt///33qV27NkWKFCF//vyeDy/+U1mMyQk24m2MMcZkQb58+bjhhhvSjUueDpKsQIEC\nnD17NpXo9JUuXdrn8eHDh9m3b1+K0XcgYJq3xo0bM27cOL799lvWrl1L48aNAefY6tSpQ1xcHBER\nEYhIhjrey5YtIzExkTvvvDPDx+O/vF/y43379gHO8a1bt46PP/a9/EpEaN26NQD79+8PuExgREQE\nJ0+eTLXu+fPn06dPHx555BHGjRtHyZIl2bt3L127ds3Wc2RMaqzjbYy5JMlI37mgtsrJpcV/ru7F\nWOXEBOZ/7kuWLEm5cuVYsGBBpp+H5I72mjVriIuLY+jQoZ59jRo1Ys2aNZQuXZqyZctSvnz5dMsb\nMWIEX375JW3atGH16tVUqlQp3TwHDx4M+Dj5m4OSJUtSo0YNnn322RTHV6RIEQAiIyNTlJNcVqFC\nhVKte86cOTRs2JD//Oc/nrSsLC1pTEbZVBNjjDEmD2V3BLxVq1bs37+f0NBQateunWJLS/HixYmK\nimLRokX8/PPPnuUCwel4r1271rPSSUbkz5+fOXPmUK1aNVq2bOkZtU7LggW+986bO3cuhQoVokaN\nGp7j27p1K9WrV09xbFdddRUA9erV48CBA2zYsMFTzm+//cbmzZvTrPvMmTMplmP84IMP0rxw1Jjs\nsBFvY4wxJgvOnz/PunXrUqSXL18+U2tFR0VFceDAAd59911q1qxJqVKlqFixYobzt2nThrZt29K6\ndWueeuopatSowfHjx/nmm29ISEhgzJgxaeZv3Lgx77zzDmFhYT43/2nUqBF79+5l//793HPPPSny\npTa6HhwczMKFC2ndujWtWrXiq6++8tyIJ1CeEydO0L17dx544AG2bNnC6NGjefTRRz1TdJ544glm\nzpxJixYtePTRRylbtiwHDhxg1apVNG3alNtuu40OHTpQq1Ytunfvzvjx4ylQoAAxMTEppuUEOnf9\n+/dn7NixNGjQgEWLFrFixYo08xiTHdbxNsYYY7Lgzz//DDgS/PzzzzNs2DAg7SX3kvXs2ZPY2Fie\neuopDh06RJ8+fXjnnXcy1Zb58+czduxYXnnlFX777TdKlizJ9ddfz6OPPppu3iZNmvDOO+/4jHaD\nM32jYsWK7N69O+Bx+h+b91J9oaGhLF68mJYtW9K+fXtWrlwZMA/AoEGD+PXXX+nduzeqygMPPODz\nYSEsLIz4+HiGDx/OE088wR9//EGZMmW48cYbfZZKXLhwIX379uW+++4jIiKCYcOGsWzZMg4fPpzq\nsffr148dO3YwefJkzp49S9u2bfnoo48865Ubk9PE5uVdPCKiOXp+z52D1L7uW74c3Mss+ejVC/73\nv4zXMWIEdOmStfYZk4NsjvelLTtzvEUkYPzf7ZbxJvtcLhdTpkzh4YcfzuummH+41P7ueO3LlflF\nWRrxFpFaQDMgDHhDVfeLyJXAAVW12z0ZY4zJNOv8GmP+6TLV8RaRYOAD4FZAAAUWAvuBF4FtwNBU\nCzDGmAyyEe5Lm31banKC/50kjfmny+yI9xigNXAnsAw44LVvMfAw1vE2xhhjTAYkJibmdROMyVWZ\n7Xj3Bkao6ociEuS3bwdQKUdaZYwxxhhjzD9MZtfxDgN+TKOs4FT2GWOMMcYYc1nLbMd7B9AolX31\ngZ+z1xxjjDHGGGP+mTLb8X4PGCoitwP53WkqIi2Ax4EMLTwqIuVEZI6I/CEif4rIXBFJ/160Tt5g\nEXlJRPaKyGkRiRORpgHiRESeFpEdInJGRL4RkVv9YiJFZJyIbBCRYyJyUES+TKW86SKS5LclisjE\njLTbGGOMMcZc3jI7x/tF4DrgfeAtd9pqoCDwsar+J70CRCQEWAmcwblIE5yLNleISC1VPZNOEe8A\nNwGDcUbg+wNfiEhDVf3OK2408AQwDNgM9AI+EZGOqrrEHVMH6OEucx1QAOcC0VgRuUVVF/nVfRC4\nBWdFl2Tp3w/XGJNpto73pS0763gbY8zlKlMdb1VNBHqJyFSgHRABHAGWqOqqDBbTF+cizGqqugNA\nRL4HfgH6AS+nllFErsO5wPNuVX3PnfYVsBUYBXRxp4UDg4CxqjrJnX2ViFwFvAAkd7y/drcjyauO\npe7yhgD+He9zqrohg8dpjDHGGGOMR5ZuoKOqX+N0WrPiFiA+udPtLm+niKwBOpNGxxvoBJwDZnvl\nTRSRj4GnRCS/qv4FtMeZCjPTL/8HwNsiUlFVd6nq8QDHligi3+CMhhtjjDHGGJMjMjvHOyfUALYE\nSN8KVE8nb3Vgh6qeDZC3AHClV1yCqm4PECdp1SMi+XEuIP0hwO4IETkkIn+JyM8iMkRE8uIcGmOM\nyUPbt2+nX79+XHfddeTLl4+WLVumGjt27FgqVKhAoUKFaN68Od9++22KmB9//JFWrVoRGhpK2bJl\nee6559KdvrNq1SpcLhfh4eGcPn3aZ9+UKVNwuXz/PblcLlwuF+vWrfNJ37p1Ky6XK1fuHLp//346\ndOhA8eLFCQoKSrPO06dPExMTQ1RUFCEhIURERNCzZ0+2bt2aItblcvHqq69ezKZfdJ06deL555/3\nPL7nnns8z5n3FhQURFxcXI7WHRMTQ3h4uOdx8mvrhx8CdYUuGDx4MJUrV87RtmTGpk2bCAsL48SJ\nv89N0zN758oknLtVBqLAnzjzqV9S1aWpxJUEjgVIPwqUSKcJaeVN3p/8848MxAUyEiiLM6XF2/8B\nG3E67wWBrsA4nM5+33TabYwxJh23NGvGvl27cr3eMhUrsjCTnc6tW7eyZMkSGjZsyPnz51ONGzdu\nHGPGjOHf//43V199NRMmTKB169Zs3bqViIgIAP744w9at25NzZo1+eyzz9i+fTtPPPEEqsqoUaPS\nbcvRo0d57bXXGDRokCcttTtCigijR49m4cKFKdJzw5gxY/j++++ZNWsWJUqUoHr1wONgp06dIjo6\nmh07djBs2DDq1q3LwYMHmTx5MvXr12fRokU0b948V9qcG9atW0dsbCzvv/++T/o111zDjBkzUnwI\nq1GjRo7W7/96qVOnDvHx8VStWjVT+XJbnTp1qF27NpMmTeLZZ5/Ns3ZkRmanmjwP9MHpeP4X586V\nkUAH4CzwKRANLBaRzqr6ec419eITkX8BTwEjVdXn46SqTvYLXyIip4DHRGR8gNF1Y4wxmbBv1y42\neuxDwWEAACAASURBVI265Za6Wejsd+rUiU6dOgHQo0cPjhw5kiImISGB8ePHM2zYMB566CEAGjZs\nSKVKlZgyZYqnU/3aa69x9uxZ5s2bR2hoKK1ateLPP/9k5MiRDBkyhMKFC6fZlujoaCZOnMijjz5K\ngQIF0o1dtGgR3333HbVq1fKk59bFsT/99BMNGjSgXbt2acYNHz6c77//ns2bN/t0zrt27Up0dDS3\n334727dvJzj4n3H7kP/85z907tyZYsWK+aSHhoZSr169XG9P4cKFqV+/fq7XmxV33303Tz75JCNG\njEjxLc+lKLMtPIv7DpWqep+qDlPVe4HKwE7gEFAbWIqzmkggxwg8sp3aaHZG88KFEe1jQPEMxHmI\nyC3AdGCaqqY/xOD4CGfqSt0MxhtjMkifU5/NXFpU1WczKcXFxXHixAl69OjhSStUqBC33HILixcv\n9qQtWbKEdu3aERoa6knr1asXp0+fZtWqtNctEBGGDBnCkSNHeOutt9KMBbj11lupXr06o0ePTjPu\ns88+o27duhQuXJiSJUvSqFEjvv467Uu7du7cSZcuXShWrBhFixalU6dObN9+YUzK5XKxYsUK5s2b\nh8vlokqVKgHLOXPmDG+//TZ33nlnihHxoKAgxowZw969e/nkk0989p07d46BAwcSFhZGiRIlGDBg\ngM+3Efv37+e+++6jatWqFCpUiKuvvppnnnmGv/76yxOza9cuXC4Xs2bN4t5776VYsWKUL1+emTOd\nS8ZefPFFypYtS0REBEOHDvWp/+eff6Z3795UqFCB0NBQatasySuvvJLu++PkyZPMnz/f53WSUTNm\nzMDlcqWYalS5cmWGDBnikzZ//nwaNGhAoUKFKFWqFDfffDO7d+8OWG6gqSZ//vkn//rXvyhSpAhl\ny5Zl7NixAfPu3v3/7N19fM11/8Dx13uzzTbTZiiWm59yE6XichPFIuESuWldRKUbUckVcr8ycq+i\nS6VSSkrJXbhqFFp1JV1uutG6UDOE3G8a24zt8/vje3acc3a2c47NNvZ+Ph7nwfl835/v93OO4X0+\n5/N9f/6gd+/eREZGEhoaSqdOndi1a5dTzJgxY2jcuDFhYWHUqFGDfv36cfjw4TyvYcSIEcyePZsa\nNWpQqVIl+vTpw19/Od+e161bN44fP87atWsLfrNKCV9nvAcBT7musTbGZIjILOAVY8xkEXkLWJDP\nORKx1nm7aoj7ddWufbuLSHmXMTTCuunyd4e4IBGpY4zZ7RJnXK8jIu2xbthcZowZ5GEM7uT7tyou\nLs7+++joaKKjoy/g9EoppS41O3bswN/fn7p16zq1X3fddXz88cdOce3bt3eKqVGjBiEhIezYsYMu\nXboUeJ0aNWrwwAMPMGPGDAYOHIi/v3++sSLCmDFjuP/++9m5cyf169fPE7N7925iYmIYOnQoL7zw\nApmZmWzdupUTJ/LMWdllZWXRrl07goKCePvtt/H39+e5554jOjqa7du3Ex4ezqZNm3j88ceJiIhg\n6tSp+c7Ob926ldOnT3P33Xe7Pd6mTRvCw8P5+uuv6devn739hRde4JZbbmHRokUkJiYyduxYgoOD\nmT59OgDHjh0jMjKS2bNnEx4ezq5du4iLi+PYsWPMnTvX6RqjR4+mb9++LF++nPnz5/Pggw/yww8/\nsG/fPt555x22bt3KuHHjaNKkCffeey8ABw4coEGDBtx///1UqFCBH3/8kfHjx5OZmcmoUaPyfe++\n/fZbMjMzueUW9/sTZmdn52nL/TP2dqnHwoULefDBB7nvvvt47rnnMMawYcMGjh49So0a7rdRcT1v\n//79+frrr3n55Ze58sormTlzJklJSQQEBNhjUlJSaN26NVWqVOHNN98kODiYqVOn0qFDB3bt2mX/\nhuLo0aPExsZSrVo1jh49yosvvkj79u355RfnWwA//vhjbrzxRubNm8f+/fsZOnQoY8eO5ZVXXrHH\nhIWF0ahRI9atW0fnzp09vhcACQkJJCQkeBVb1HxNvKtwfuMcV4FYW8oDHMO51rWjVcBMEaltjNkD\nICK1gdZYJfwKshprDXYMVi1xRMQfuBdYa6toAla5wHNAX6zlMbn6Ab8YY+zfK4rILVhLZL7gfF1x\nb/UDcoB8Sww6Jt5KKaXKjpSUFCpUqJAngYmIiCA9PZ1z585Rrlw5UlJSCA/P+yVtREQEKSmevgi2\njB49mnfeeYf33nuPhx56qMDY3r17M378eKZMmcKCBXnnyH744QcqVqzItGnT7G2dOnUq8Jzz589n\n//79/Pbbb9SqVQuA5s2bU6dOHd544w1GjRpF8+bNqVixIpUqVSpw+cSBAwcQEft53KlVqxYHDhxw\narviiivss+AdO3YkMzOTKVOmMGbMGMLDw7n++uuZMWOGPb5Vq1aEhITwyCOPMGfOHMqVO58StW/f\n3v6tQPPmzVmyZAmrV69mx44diAh33nknn3zyCStWrLAn3u3atXO6ybZ169acPn2aefPmFZh4b9u2\njcqVKzvd3Jhry5YtToktWAmxu2Q8P8YYxowZQ69evXj//fft7XfddZfX5/j1119ZuXIlH3/8Mffc\ncw9gTSbWrFnTaXnMSy+9REZGBhs2bLC3t2rVitq1azN//nz7kivHb2dycnJo0aIFNWrU4D//+Q+3\n3nqr/VhgYCCffPKJfQlJYmIiixcvdkq8AW688Ub++9//ev16XCdCJ0yY4HXfwvJ1qclWIE5Eqjk2\nikh1YDzWzYcAtYCD+ZxjHtaylJUi0k1EumElvnuBNx3OWVNEzolIbG6bMeZHYDEwW0QeEZF2tue1\nbdfPjTsKvASMEZGhItJWROZirT8f7XCN+lhr1Y8CLwJ/E5EWuQ+XsXwlIo+LSAcRuUtE5gNPAq87\nlkZUSimliludOnXo3bs306ZN87i0wc/Pj9GjR/Phhx+yZ8+ePMdvuOEGTp48Sf/+/fniiy/yLGNw\nZ/PmzTRp0sQpWY6KiqJ169b85z//8fn1XIjcNfe5evbsSXp6utMs6uzZs2nUqBEhISEEBATQt29f\nzpw5w759+5z6OibQYWFhVKlShbZt2zp9iLr22mudkv8zZ84wfvx46tatS1BQEAEBAYwbN47k5GRy\ncnLIz6FDh6hcubLbYw0bNmTr1q1s2bLF/ti82bftRHbu3MnBgwfp37+/T/0cbd68GRFxeo9DQ0Pp\n0KGDU9z69evp0KEDFSpUIDs7m+zsbCpUqEDTpk3ZsmWLPS4+Pp7WrVsTHh5OuXLlqFGjBiKSZ0nK\n7bff7rRuu2HDhhw5ciTPB4/KlStz6NChC359xcnXxPufwNXAbhH5UkQWi8iXwG6gOjDEFnctsMjd\nCYwx6UA7YBfWFvQLgSSgve1YLnF4OOqPtRb7eeDfWBVIOhpjXOszjcXavXII1gz4LUCMMSbeIaYl\ncAXWB4UNwEaXR640rI2CRgIrgY+AxljLbga7e51KKaXKtoiICE6dOpUnEU5JSSEkJMQ+wxoREcHJ\nkyfz9E9JSSEiwlOxr/PGjh1LUlISixcv9hj7wAMPUK1aNadZ7Vz16tVj5cqVJCcn06VLFypXrkzf\nvn05duxYvuf7888/ufLKK/O0X3nllQUuUXEnKioKYwx7C7jpde/evURFRTm15VaJcX3+55/WBtOz\nZs1ixIgR9OrVi1WrVrF582ZeffVVADIznasUu34DERgY6LbNsd/IkSN56aWXGDRoEPHx8WzZsoXY\n2Fi353eUmZmZ702iISEh3HzzzTRp0sTp4Yvjx48jIlSrVs1zcD4OHTpEWFhYnuVBru/5sWPHWLx4\nMQEBAfZHYGAgCQkJ9vXkmzdv5u6776ZmzZq8//77bNq0ie+//x5jjFd/DsYYzpw549QeFBRU4Htc\nmvi6c+U2EbkWa1fIFsANWFumvwi8ZIw5bosrsKaLMWY/1nKRgmL2AnkWqhljzmBtF/+Mh/4GmGJ7\n5BezgPzXojvGpQA9PcUppZRSuRo0aEB2dja///670zrvHTt20KBBA6e4HTt2OPXdv38/6enpTnGe\nXHfddXTv3p3JkyczcODAAmMDAgIYMWIEI0aMoEePHnmOd+7cmc6dO5OWlsann37KP//5T4YMGcKi\nRW7n1KhWrZrbms+HDx+mUqWCKvjm1bRpU0JDQ1m1apXb5RDffPMNqampecoJHjlyxO3z6tWrA7B0\n6VJiYmKcSjS6qwl+oZYuXcqQIUOcyjq6lm10p1KlSqSmuquA7Fn58uUBa419SEiIvd1xiVJkZCTG\nGPsHkAtx1VVXkZaWRlZWllPy7fqeV6pUiUaNGtnXkTsKCwsD4JNPPqFq1ap8+OGH9mOu3zj4KjU1\n1eefs5Lic90VY8xxWzWT9saYhrZfx+Um3UopVRRkgjg9VOmSe1NXSdfxLc1atWpFWFiYU/WN9PR0\nVq9ezd///nd7W+fOnVm7di2nT5+2t3300Uf2DXd8MW7cOBITE1mxYoXH2AEDBhAeHs6MGTPy/TMM\nCwujd+/e9OjRo8DNVFq0aMHWrVudZqkPHDjAxo0bue2223x6DcHBwTz66KO89957ea6ZnZ1NbGws\nUVFR9rXGuVauXOn0fNmyZYSEhNhrXmdkZOSZWXZc81xYGRkZTklpTk4OH330kcd+9evX5+DBg07V\nVbx19dVXY4zhf//7n73t+++/d6r8Ub9+faKiotyu5/dWs2bNMMY4vcenTp3iiy++cIpr3749iYmJ\nNGzYMM8sfe6Hz4yMjDzr1t9///1C/TuyZ88e6tWrd8H9i9MFbRmvlFJKlWUZGRl89tlnGGM4cOAA\naWlpLFu2DIAuXbpQvnx5goKCGD16NJMmTSI8PJwGDRrw4osvYoxh8ODzqxQHDRrEnDlz6NGjB6NG\njSIpKYkJEyYwfPhwjzW8XWcVb775Zjp37kx8fLzHRCYoKIhhw4YxatQop9g333yT7777jk6dOlG9\nenV27drFkiVLClwj3L9/f6ZPn06nTp2YOHEifn5+TJw4kapVq/LYY77vMTdp0iQ2btxI27ZtGT16\nNM2aNePw4cPMmTOHbdu28dlnn+VJotPS0rjnnnsYMGAAv/zyC5MmTeKpp56yL1fo0KEDc+bMoXnz\n5lxzzTV88MEHTuUOC6tDhw68+uqrXHPNNURERPDaa6+RlZXlsV/r1q05e/Ys27dvz7OM5PTp03l2\nGgVrfXlkZCTNmzcnKiqKIUOGMHHiRI4fP87MmTOdbngUEWbMmEG/fv3o168fffpY+wN++eWX3Hff\nffkuXXH82WrYsCHdunVj0KBBnDx5kquuuooXXnjBqQQmwLBhw/jggw+4/fbbeeqpp4iKiuLw4cN8\n9dVX3HbbbfzjH/+gQ4cOvPzyywwdOpSuXbuycePGQn8A2rJlS57yjqWVz4m3iDQCHgXqY22k48gY\nY9rn7aWUUkoVrFqtWhe0mU1RXNdXR44cISYmxilhza1ukZycTM2aNQGr2ogxhmnTpnH8+HGaNWvG\nunXrnCpYhIeHs379egYPHky3bt0IDw9n+PDhjB8/Hk/cJdexsbGsWbMmzzF330488cQTTJ8+3Wmp\nQ+PGjVm9ejXDhw/nxIkTVKtWjYEDBxZY+SEwMJD169czbNgwHn30UYwx3H777SxfvjzPOl1vZjZD\nQ0NJSEhgxowZvPXWW8TGxlKxYkVuv/125s6dm2fnRhHhmWeeISkpiT59+mCMYcCAAUyePNke89xz\nz3Hs2DGeffZZAHr16sWcOXPo2rWrx/F5883OnDlzePzxxxk8eDDBwcE8+OCD9OzZ0+MHj7p169Ko\nUSPi4+PzJME7duygVatWefosXLiQ++67j4CAAD755BOeeOIJYmJiqF+/Pq+//jp9+/Z1iu/Tpw/B\nwcFMnjyZmJgYQkNDadmypdtKKo6v2dGCBQt4/PHHGTp0KBUqVODJJ5/kr7/+YunSpfaYyMhINm3a\nxLhx4xg2bBipqalUq1aNW2+91b5hU+fOnZk+fTpz5szhrbfeolWrVnz66ad5Zqy9/Tbthx9+4Nix\nY/TseWmsCBZfNj6wVfr4CqsqSV3gZ6wNbWoC+4HfjTHt8j1BGSMipkg3lsjKAjd/AQFYvx5cdrwC\noHdv+P33vO35iY2F7t0vbHxKFSHX5SW6iU7p4vofoo//l+imO0o5mD17NvPnz+fnn38u6aFccsaM\nGcPWrVv5/PPPC4wr6N8d27FiWTPn6xrvKcByrI1oBHjEGFMbuAPrRsiCt8JSSimllFJOHnvsMY4e\nPcqGDRtKeiiXlPT0dN566y37txiXAl8T78bA+5zfqdEfwBizASvpnlp0Q1NKKaWUuvyFhISwYMEC\npxtslWf79u1j/PjxPt/AW5J8XeMdCJw2xuSIyAnAsSjkTuD6IhuZUqpM06UlpZsuFVGqaN15550l\nPYRLToMGDXwquVka+Drj/TvWhjVgre9+WET8RMQPeAi4NLYNUkoppZRSqpj5OuO9Gmvb9UVY670/\nBf4CsoEKnN+5UimllFJKKeXA150r4xx+v05EWgK9gBBgjTGm4FtKlVJKKaWUKqMKtYGOMeYH4Ici\nGotSSimllFKXLZ/WeItItog0z+dYUxHJLpphKaWUUkopdXnxdca7oOLi/pwvM6iUUoWiG+iUboXZ\nQEcppcoqr2a8bZVL/HP75FYycXiEAp2BYxdtpEoppVQpkZSUxMCBA7nxxhspV64c7drlv2nzlClT\nqFmzJiEhIbRt25affvopT8z//vc/2rdvT2hoKFFRUYwfP97jh5mvvvoKPz8/qlSpQnp6utOxV155\nBT8/5//i/fz88PPz4/vvv3dqT0xMxM/Pj6+//trTyy60Q4cO8fe//53w8HD8/f0LvGZ6ejpxcXE0\naNCA4OBgqlatyr333ktiYmKeWD8/P1577bWLOfSLrlu3bjz//PPFes0FCxbg7++f5+enKGzdupXI\nyEjS0tKK/NyXMo8z3iIyHnjO9tQA3xYQfmn/1CullCoxbdp0Ze/eP4v9urVqVePrr1f71CcxMZE1\na9bQsmVLzp07l2/c1KlTmTx5Mi+88AL169fnxRdf5I477iAxMZGqVasCkJqayh133MH111/PqlWr\nSEpKYtiwYRhjmDhxosexnDhxgrlz5zJ8+HB7m4jk+VYit33SpEmsXr06T3txmDx5Mtu3b2fx4sVE\nRETQsGFDt3GnT58mOjqa5ORkxo4dy9/+9jeOHDnCv/71L5o3b85nn31G27Zti2XMxeH7778nISGB\nhQsXFut177rrLr777jtCQkKK/NxNmzalSZMmzJo1i+eee85zhzLCm6UmCbZfBSsBfxvY7xJzBvgV\n+HeRjUwppVSZsnfvn1SpsqUErvs3n/t069aNbt26ARATE8Px48fzxJw5c4bp06czduxYHn/8cQBa\ntmxJ7dq1eeWVV+xJ9dy5c8nMzGT58uWEhobSvn17Tp48yYQJExg5ciQVKlQocCzR0dG89NJLPPXU\nUwQGBnqM/eyzz/j5559p3Lixvb24lgrt2LGDFi1a0LFjxwLjxo0bx/bt29m2bZtTct6jRw+io6Pp\n27cvSUlJBAUFXewhF4s5c+Zw9913c8UVVxTrdSMjI4mMjLxo5+/fvz8jRowgNjY2zzcwZZXHd8EY\n85UxZoKtlOAEYLztueNjmjFmlTEmx5uLisjVIrJURFJF5KSILBORGl72DRKRmSJyUETSRWSjiOTZ\nK1QsY0QkWUQyRORHEenpEnOViEwVkc0ikiIiR0Rknbvz2eK7i8g22/n2iMg42+ZBSimllJONGzeS\nlpZGTEyMvS0kJISuXbsSHx9vb1uzZg0dO3YkNDTU3ta7d2/S09P56quvCryGiDBy5EiOHz/OW2+9\n5XFMPXv2pGHDhkyaNKnAuFWrVvG3v/2NChUqUKlSJW655Ra++eabAvvs2bOH7t27c8UVV1CxYkW6\ndetGUlKS/bifnx8bNmxg+fLl+Pn5UadOHbfnycjI4O233+b+++/PMyPu7+/P5MmTOXjwIEuWLHE6\nlpWVxdNPP01kZCQREREMGTLE6duIQ4cO8cgjj3DNNdcQEhJC/fr1efbZZzl79qw9Zu/evfj5+bF4\n8WIefvhhrrjiCmrUqMEHH3wAwIwZM4iKiqJq1aqMHj3a6fo7d+6kT58+1KxZk9DQUK6//npefvll\njx9qTp06xYoVK5x+TnKtWLGCFi1aEBISQuXKlbnrrrv4448/7Mc3bNhAy5YtCQ4O5qqrruLJJ590\n2nb+3LlzPPPMM9SqVYvy5csTFRVFr1697O/Lu+++i5+fn32pSe7rX7JkCYMGDSI8PJwaNWoQFxeX\nZ2y//PILXbp0oWLFilSsWJF7772Xw4cPO8V069aN48ePs3bt2gLfg7LEp6TRlmQfLMwFRSQY+BKo\nB9wP9APqAhtsxzyZDzwCxAJdgD+BtSLS2CVuEtYM/b+ATsB3wBIR6eQQ0xSIAVYA9wAPAhlAgoj8\n3WXcHYGlwPe28822jWGyVy9cKaVUmbJjxw78/f2pW7euU/t1113Hjh07nOJct72uUaMGISEhTnH5\nqVGjBg888AAzZswgO7vg4mIiwpgxY1i2bBk7d+50G7N7925iYmK44447+Pe//82iRYu46667OHHi\nRL7nzcrKol27duzcuZO3336bBQsWkJycTHR0NKmpqQBs2rSJm266iXbt2vH999+zYsUKt+faunUr\np0+f5u6773Z7vE2bNoSHh+dZH/7CCy9w4MABFi1axLPPPsubb77JuHHj7MePHTtGZGQks2fPZu3a\ntYwcOZJ3332XIUPy7v03evRoqlevzvLly2nTpg0PPvggzzzzDFu2bOGdd95h6NChzJgxg48//tje\n58CBAzRo0IDXX3+d+Ph4HnvsMeLi4pgxY0a+7xvAt99+S2ZmJrfccotT+8KFC+nVqxd169ZlyZIl\nvPvuu9SrV4+jR48C1nKnzp07U7VqVZYvX87EiRNZtGiRUwI/ZcoUPvzwQyZPnsy6det4+eWXueKK\nK+w/J/ktSRo1ahRhYWEsW7aM+++/n4kTJ7J06VL78aSkJG699VaysrL44IMPWLBgAYmJifZvgXKF\nhYXRqFEj1q1bV+B7UJb4XMdbRNoCfYCaQHmXw8YY097DKR4DagP1jDHJtnNuB34DBmIltPld+0bb\ntfsbY96ztX0NJAITge62tirAcGCKMWaWrftXIlIXmAassbV9YxtHjsM1PredbyTwmcPlpwJfG2Me\ndzhfGDBORGYZY454eN1KKR9oFZPSTauYeJaSkkKFChXyJDYRERGkp6dz7tw5ypUrR0pKCuHh4Xn6\nR0REkJKS4tW1Ro8ezTvvvMN7773HQw89VGBs7969GT9+PFOmTGHBggV5jv/www9UrFiRadOm2ds6\ndeqUJ87R/Pnz2b9/P7/99hu1atUCoHnz5tSpU4c33niDUaNG0bx5cypWrEilSpVo1qxZvuc6cOAA\nImI/jzu1atXiwIEDTm1XXHGFfRa8Y8eOZGZmMmXKFMaMGUN4eDjXX3+9UxLcqlUrQkJCeOSRR5gz\nZw7lyp1Pidq3b2//VqB58+YsWbKE1atXs2PHDkSEO++8k08++YQVK1Zw7733AtCuXTunm2xbt27N\n6dOnmTdvHqNGjcr3tWzbto3KlStTpUoVe5sxhjFjxtCrVy/ef/99e/tdd91l//3zzz9P7dq1Wbly\npf1nLCIign/84x98//33tGjRgs2bN3PffffRr18/e7977rkn37Hkatu2LTNnzrS/F/Hx8Sxfvtze\nNy4ujmrVqrFmzRr8/a3aGzfccAMNGjQgPj6ezp07289144038t///tfjNcsKX+t4D8Sarb4HCMda\n9+348OZ8XYFNuUk3gDFmD9ZNm+4/3p7XDcgC7B8xjTHZwEdARxEJsDV3AgKAD1z6vw/cICK1bH3/\ncl0eYzvfj0BUbpuIXA3cZOvvaCEQiFXRRSmllCoRderUoXfv3kybNs3jhyI/Pz9Gjx7Nhx9+yJ49\ne/Icv+GGGzh58iT9+/fniy++8KrixebNm2nSpIlTshwVFUXr1q35z3/+4/PruRCus609e/YkPT2d\nX375xd42e/ZsGjVqREhICAEBAfTt25czZ86wb98+p76OCXRYWBhVqlShbdu2Th+irr32Wqfk/8yZ\nM4wfP566desSFBREQEAA48aNIzk5mZyc/FfiHjp0iMqVKzu17dy5k4MHD9K/f/98+23evJkePXo4\njalXr16UK1fO/p7fdNNNvPPOO8ycOZPt27fney5XHTp0cHresGFD9u8/f3vf+vXr6dGjBwDZ2dlk\nZ2dTu3ZtateuzZYtzvdpVK5cmUOHDnl97cudr+uThwOLgOrGmFbGmNtdH16coxHwi5v2RMD97c3n\nNQSSjTGZbvoGAtc6xJ0xxiS5iZOCrmNL3m/BulnUcczG1t/O9oEh3YtxK6WUKmMiIiI4depUnkQ4\nJSWFkJAQ+wxrREQEJ0+ezNM/JSWFiIgIr683duxYkpKSWLx4scfYBx54gGrVqjnNaueqV68eK1eu\nJDk5mS5dulC5cmX69u3LsWP5Vwz+888/ufLKK/O0X3nllQUuUXEnKioKYwx79+7NN2bv3r1ERUU5\nteVWiXF9/uefVqWcWbNmMWLECHr16sWqVavYvHkzr776KgCZmc5phes3EIGBgW7bHPuNHDmSl156\niUGDBhEfH8+WLVuIjY11e35HmZmZeW4SPX78OCJCtWrV8u3n7j338/MjMjLS/p7HxsYyePBg5s6d\ny0033USNGjX417/+le85c3l6rceOHWP69OkEBATYH4GBgSQnJzutQQcICgoq8PWXNb4uNYkC3jHG\nZBXimpUAd9+dnQA8/QtTUN/c47m/pnoR584ErNfZx+W65HPtFA/nKx5ffQUON+bY+Vo/89dfISzM\n+/jq1eG663y7hlJKlQENGjQgOzub33//3Wmdt+ua7gYNGuRZy71//37S09PzrP0uyHXXXUf3H2oO\n/QAAIABJREFU7t2ZPHkyAwcOLDA2ICCAESNGMGLECPvMpaPOnTvTuXNn0tLS+PTTT/nnP//JkCFD\nWLRokdvzVatWjV9//TVP++HDh6lUybf/Ips2bUpoaCirVq1yWlqR65tvviE1NTVPOcEjR464fV69\nenUAli5dSkxMjFOJRnc1wS/U0qVLGTJkiFNZR9eyje5UqlTJvg4+V2RkJMYY+4cGd6pVq5bnNefk\n5HD8+HH7ex4UFERcXBxxcXEkJSXx+uuv8/TTT9OgQQPuvPNOX15enjH37NmTAQMG5Plg6Tp7n5qa\n6vPPwOXM18R7K1AHWH8RxlLiROQ+YBQwwRizsaTH4xMvar16Zfly6+GtHj3A4eYVpZRSllatWhEW\nFsaSJUsYO3YsYG0Ks3r1agYNGmSP69y5My+88AKnT5+2Vzb56KOP7Bvu+GLcuHE0bdo03xsXHQ0Y\nMIDJkyczY8aMfOt4h4WF0bt3bxISEti0aVO+52rRogULFy5k79699uUmBw4cYOPGjV7VIncUHBzM\no48+yty5c3n66aedKptkZ2cTGxtLVFRUnrXKK1euZOrUqfbny5YtIyQkhEaNGgFWtRTXmWXH9dOF\nlZGR4VTOMScnh48++shjv/r163Pw4EHOnj1LQECAvS0qKooFCxbQpUsXt/1atGjBihUrmDJliv3P\nb9myZWRnZ3Prrbfmib/mmmuYOXMmr7zyCr/++muhEu/27duTmJjIzTff7DF2z5491KtX74Kvdbnx\nNfEeAnwgIjuNMRe6xVUK7me285vNdu1bM5++cH5GOwVrDbqnODsR6Qq8A8wzxrj+K5E7LnfjjnB3\nvlyOJXiio6OJjo7OL1QppdQlIiMjg88++wxjDAcOHCAtLY1ly5YB0KVLF8qXL09QUBCjR49m0qRJ\nhIeH06BBA1588UWMMQwePNh+rkGDBjFnzhx69OjBqFGjSEpKYsKECQwfPtxjDW/X2cabb76Zzp07\nEx8f73FTnKCgIIYNG8aoUaOcYt98802+++47OnXqRPXq1dm1axdLliwpcL1x//79mT59Op06dWLi\nxIn4+fkxceJEqlatymOPPVbgONyZNGkSGzdupG3btowePZpmzZpx+PBh5syZw7Zt2/jss8/yJNFp\naWncc889DBgwgF9++YVJkybx1FNP2ZdNdOjQgTlz5tC8eXOuueYaPvjgA6dyh4XVoUMHXn31Va65\n5hoiIiJ47bXXyMryvECgdevWnD17lu3bt9OkSRPAqjYyY8YM+vXrR79+/ejTx/oS/ssvv+S+++6j\nSZMmxMbG0qRJE+6++24ef/xx/vjjD0aPHk2nTp1o0aIFYK1zb9q0KTfffDPBwcEsWbKE7Oxs2rRp\nU6jXGhcXR4sWLejSpQsPP/wwlStXZv/+/axbt46HHnrI6fxbtmzJU3qxpCUkJJCQkFAi1/Y18V4N\nVAS+FJF08ibKxhiT/23IlkSsNdOuGuK8rjq/vt1FpLzLOu9GWDdd/u4QFyQidYwxu13ijOt1RKQ9\n1g2by4wxg8grd214I6xygrn9agEhBY3bXe1LpZRnMsE5adAqJ6WLa1JX1qqcHDlyhJiYGKf3Ibe6\nRXJyMjVrWnNEo0ePxhjDtGnTOH78OM2aNWPdunVOFSzCw8NZv349gwcPplu3boSHhzN8+HDGjx/v\ncRzukuvY2FjWrFmT55i70nFPPPEE06dPd1rq0LhxY1avXs3w4cM5ceIE1apVY+DAgUyYMCHfcQQG\nBrJ+/XqGDRvGo48+ijGG22+/neXLl+dZL+zNLpmhoaEkJCQwY8YM3nrrLWJjY6lYsSK33347c+fO\ntc9iO57zmWeeISkpiT59+mCMsc/o53ruuec4duwYzz77LGDdiDhnzhy6du3qcXz5ld1zNGfOHB5/\n/HEGDx5McHAwDz74ID179vT4waNu3bo0atSI+Ph4e+IN0KdPH4KDg5k8eTIxMTGEhobSsmVL+89O\nw4YNiY+PZ+zYsfTq1YuKFSvSt29fpk+fbj9H69atWbx4MS+88AI5OTk0bNiQ5cuXO13H3Wv1pG7d\numzatInY2FgGDhxIRkYGUVFRtG/fnmuvvdYe98MPP3Ds2DF69uxZwNmKn+tEaEE/20VNfPnHUkTe\nxUpc82WMKbCOkYj8E5iJVcZvj62tNrALGGmMKaic4E3ANuBBY8xCW5s/sB3YZYxxLCe4H5hkjHne\nof86oIox5kaHtluAz7GqtfSwVTVxd+0fgBOO5RJFJBarlndNd+UERcQU6X9GWVnQqlXRna8o6FIT\ndZFo4l26FSbxFhG38ZfSlvFKFaXZs2czf/58fv7555IeSpEaM2YMW7du5fPPPy/poeT7747DMc+f\nOIpiHMU9SyEiIVjl+jKAZ23NE4FQ4EZjTLotriawG4gzxkxy6P8hcCdWne1k4Ang78AtxpifHOKm\nAv8ExmEl672BAUBXY0y8LaY+1sY6qcBDgNNtt8YYx9ntzlgz/m8BHwJNgCnAy8YYt9+haOKt1IXT\nxLt0uxiJt1JlVXp6un35i2Mpw0tZeno6tWrVYvny5dx2m9sNwYtVaUm8fd5Ap7CMMeki0g6YBbyH\ntYRjHTA0N+m2cawP7qg/1m6Rz2Ot4/4J6OiYdNuMBdKw1qVfBewEYnKTbpuWwBW2xwY3w/V3GHe8\niNwDjMfa4fIw1u6YU7x64UoppZRSboSEhLBgwQKn7d4vdfv27WP8+PGlIukuTXye8RaRm7Fmqttg\nJb7NjTHbRGQK1s6Oawo8QRmiM95KXTid8S7ddMZbKXUpKS0z3r7uXHkr1tKMBlgb6Tj2zwHc3Zio\nlFJKKaVUmefrUpNpwFqgO9YyjMEOx7YBDxTRuJRSZZzOcJduOmOtlFK+8zXxbgL0NMYYEXH9V/cY\nUMVNH6WUUkoppco8n5aaYFX9CMnnWDXgZOGGo5RSSiml1OXJ18T7P8DTttrZuXJnvh/BfWUQpZRS\nSimlyjxfl5o8C3yLVcJvKVbS/aCIvAQ0BZoV7fCUUkpdbmrVquXV7nhKKVVUatXytLF68fAp8TbG\n/CQibbB2nhyHVWN7MPAN0NYYs7Poh6iUUupysmfPnpIeglJKlQifN9AxxmwD2otIeaASkOqy8Y1S\nShWa1vEu3QpTx1sppcoqnxJvEQkAAo0xp40xmcBBh2OhQJYx5mwRj1EppZRSSqlLnq8z3m8BAcB9\nbo69AWQBDxd2UEoppZRSSl1ufK1qcjuwMp9jq4D2hRuOUkoppZRSlydfE++qwJF8jh0FrizccJRS\nSimllLo8+Zp4HwFuyOfYDcDxwg1HKaWUUkqpy5Ova7z/DTwrIgnGmJ9zG0XkBqzygiuKcnBKqbJL\nq5iUblrFRCmlfOdr4v0c0AHYKiKbgf1AFNAcSAZii3Z4SimllFJKXR58WmpijDmGtTvlVKzNc26y\n/ToZaGY7rpRSSimllHLhdeItIv4iciMQYIx5zhhzizGmnjGmlTEmzhhz0odzXS0iS0UkVUROisgy\nEanhZd8gEZkpIgdFJF1ENorIbW7iRETGiEiyiGSIyI8i0tNN3AO2sewRkRwRmZ/Pdcfbjrs+lnv7\nupVSSimlVNnly4y3AbYANxfmgiISDHwJ1APuB/oBdYENtmOezAcewVrW0gX4E1grIo1d4iZhLY35\nF9AJ+A5YIiKdXOL6AXWAzwFPHx4M0Apo6fAY6cWYlVJKKaVUGef1Gm9jTI6I/AGEFvKajwG1gXrG\nmGQAEdkO/AYMBGbn19E2494H6G+Mec/W9jWQCEwEutvaqgDDgSnGmFm27l+JSF1gGrDG4XXd6XD+\nzl6M/7/GmByvXumFOnkSPvggb/u5cxf1skoppZRS6uLx9ebKN4CnReRTY0zWBV6zK7ApN+kGMMbs\nEZFvgbspIPEGumHtjvmxQ99sEfkIGCUiAbYt6zth7bDpmr2+D7wtIrWMMXsvcPxygf28l5YG892u\neFGqzJAJzn/VtMpJ6SLi8uejVU6UUsojXxPvMOAaYLeIrMFa5uH4r60xxoz3cI5GwCdu2hOBezz0\nbQgkG2My3fQNBK4F/meLO2OMSXITJ7bjF5p4/yEiVbEqunwExLkZj1JKKaWUUk58TbzHOvz+YTfH\nDeAp8a4EpLhpPwFEFKJv7vHcX1O9iPPF78Bo4Aes13knMBRrzXvHCzifUkoppZQqQ3xKvI0xvu50\nedkwxrguW1kvIgeAWSLSzhizoSTGpZRSSimlLg2+zngXhRTcz2znN5vt2rdmPn3h/Ix2ChDuRVxh\nfYi1Jr0Z4DbxjouLs/8+Ojqa6OjoIrq0UkoppZTyVUJCAgkJCSVybZ8Tb7HuqOkKtAEisdY47xWR\ntsBvxpiDHk6RiLXO21VD4Fcv+nYXkfIu66obYd10+btDXJCI1DHG7HaJM15cx1f53lXkmHgrpZRS\nSqmS5ToROmHChGK7tk9LR0QkAtiIdXPkAOABrOQb2/PRXpxmFdBSRGo7nLc20BpY6aHvaqybKGMc\n+voD9wJrbRVNwCoXeA7o69K/H/BLISqauOqHlXT/t4jOp5SyMeON00OVLsYYp4dSSinPfJ3xngnU\nwEqSN2PNMudaB4zw4hzzgCeBlSLyrK1tIlaVkTdzg0SkJrAba0Z9EoAx5kcRWQzMFpFAIBl4Aqsu\neJ/cvsaYoyLyEjBGRE4B24DeQDTWbD0O17kOa7ZdgGCgloj0sh3+yhhzzBa3DXgP2Mn5mysHA/HG\nmAQvXrdSSimllCrDfE287waeMcZ8Z5tpdrQPKykvkDEmXUTaAbOwElnBStqHGmPSHULF4eGoPzAZ\neB5rHfdPQEdjzE8ucWOBNGAIcBVWwhxjjIl3ibsXa4fLXNG2B8DtwNe23+/A+sBQDeubgt1AHNaH\nEaWUUkoppQrka+JdATiQz7HyeLm5jDFmPw7LRfKJ2Qu4JvcYY84Az9geBfU3wBTbo6C4CYDHxT3G\nmPs8xSillFJKKZUfX8sD7sRaYuFOW2B74YajlFJKKaXU5cnXGe/XgFdE5CSwyNYWLiIPYa13fqwo\nB6eUUkoppdTlwtcNdN4UkTpYSzMm2pq/AHKAGW42mVEF2bsXFizI237qVPGPRalSRiY4r1zTyial\ni1VZ9jytbKKUUp75lHiLSGWsGwrnYi05qQIcB75wqZetvHH8OKxaVdKjUEoppZRSxcBj4m2rXvIs\n8E+gIpCNVU/7EWNM6sUdnlJKKaWUUpcHb2a8B2GV20vAqt1dB+gB/AU8dNFGppRSSiml1GXEm8R7\nADDPGDMwt0FEBmLdZDnQGJOVf1ellFJKKaUUeFdOsA6wxKVtMVaN7VpFPiKllFJKKaUuQ97MeFfA\nWlbiKM32a1jRDkcppSxaxaR00yomSinlO2+rmkTZygjm8ndod7rBUqubKKWUUkoplZe3iffSfNo/\ncdOWZ5t3pZRSSimlyjpvEm+tXFJGjT/4GEfOVio4aNX/wX5o1gwefrh4xqWUUkopdSnymHgbY9xs\nrajKgu0Z17Iv66qCg/ZHQDZUrlw8Y1JKKaWUulR5U9VEKaWUUkopVUg+bRmvlFLFRSaI03OtclK6\niLj8+WiVE6WU8qhEZrxF5GoRWSoiqSJyUkSWiUgNL/sGichMETkoIukislFEbnMTJyIyRkSSRSRD\nRH4UkZ5u4h6wjWWPiOSIyPwCrn2riHxru+6fIvKiiJT37dUrpZRSSqmyqNgTbxEJBr4E6gH3A/2A\nusAG2zFP5gOPALFAF+BPYK2INHaJm4S11f2/gE7Ad8ASEenkEtcPa5Ogz4GTBYy7sS3mkO2647Bu\nPH3HizErpZRSSqkyriSWmjwG1AbqGWOSAURkO/AbMBCYnV9HEbkR6AP0N8a8Z2v7GkgEJgLdbW1V\ngOHAFGPMLFv3r0SkLjANWJN7TmPMnQ7n71zAuCcAfwD3GmOygS9F5CzwrohMN8b86PU7oJRSSiml\nypySSLy7Aptyk24AY8weEfkWuJsCEm+gG5AFfOzQN1tEPgJGiUiAMeYs1gx3APCBS//3gbdFpJYx\nZq+3AxaRckBH4AVb0p3rY2CebdyaeF8k69fDSy95Hz9/Plx55cUbj1JKKaXUhSiJxLsR7jfeSQTu\n8dC3IZBsjMl00zcQuBb4ny3ujDEmyU2c2I57nXgD1wDlbf3tjDFnRCTJdj51kWRkwOHD3sdnZ3uO\nUUoppZQqbiWReFcCUty0nwAiCtE393jur6lexHkrNz6/a/t6PqWUB1rFpHTTKiZKKeU7reOtlFJK\nKaVUMSiJxDsF9zPb+c1me9sXzs9opwDhXsR5K3dc+V3b1/MppZRSSqkypiSWmiRirfN21RD41Yu+\n3UWkvMs670ZYN13+7hAXJCJ1jDG7XeKMF9dxlQSccR23iARhlSL82F0ngLi4OPvvo6OjiY6O9vHS\nSimllFKqqCQkJJCQkFAi1y6JxHsVMFNEahtj9gCISG2gNTDSQ9/VWGX9YoCFtr7+wL3AWltFE7DK\nBZ4D+gLPO/TvB/ziS0UTAGPMWRFZA9wrInHGmBzboRismzpX5dfXMfEuaTlGOGf8fYi/eF+IZGV5\nH3v2rOcYpZRSSilvuE6ETpgwodiuXRKJ9zzgSWCliDxra5uIVWXkzdwgEakJ7AbijDGTAIwxP4rI\nYmC2iAQCycATWHXB++T2NcYcFZGXgDEicgrYBvQGorHKGeJwneuwZtsFCAZqiUgv2+GvjDHHbL+P\n4/wmPK8C/wfMAJYYY34o5HtSLL74qwXjDj5R0sMAICYGDhwo6VEopZRSShWfYk+8jTHpItIOmAW8\nh5XwrgOGGmPSHULF4eGoPzAZayY7HPgJ6GiM+cklbiyQBgwBrgJ2AjHGmHiXuHuxdrjMFW17ANwO\nfG0b908icicwHfg31i6X72LtYKmUKmIywfmvvlY5KV1EXP58tMqJUkp5VBIz3hhj9mMt0ygoZi+Q\nZ12EMeYM8IztUVB/A0yxPQqKm4C1fMUjY8x/sJbEKKWUUkop5ZMSSbzVZSTtL8jMgBU/QdKS8+03\n3QQjPS3ZV0oppZQqOzTxVoWTnW09jh+HXbvOt1epUnJjUkoppZQqhXQDHaWUUkoppYqBznirIvFX\nTii/Z159viG18vmq6m5oiUCllFJKlTWaeJeAM2fOcO7cOfwyMgjMyfHcoYhkG2NtH3QRfJt2I9+m\n3Wh/bo6EYrZnX5yLuSHil6fKgrq0aRWT0k2rmCillO808S4Bs2bNYunSpdRPT2fcXp/28imU/dk1\nyDyb6TmwCKSfzeLw6dPFci2Aq6++mrCwisV2PaWUUkopX+kab6WUUkoppYqBJt5KKaWUUkoVA028\nlVJKKaWUKgaaeCullFJKKVUM9OZKVaYdPAg7dngf36oVlC9/8cajzpMJzlVqtMpJ6eJaRUirnCil\nlGeaeKsybcsWmDjR+/hPP9XEWymllFIXRpeaKKWUUkopVQw08VZKKaWUUqoYaOKtlFJKKaVUMdDE\nWymllFJKqWJQIom3iFwtIktFJFVETorIMhGp4WXfIBGZKSIHRSRdRDaKyG1u4kRExohIsohkiMiP\nItIzn3MOEJH/iUimiOwQkYFuYt4RkRyXR7aIvOT7O6CU8sSMN04PVboYY5weSimlPCv2qiYiEgx8\nCWQA99uaJwMbRKSxMSbDwynmA52BZ4BkYDCwVkRaGmN+doibBAwDxgLbgN7AEhHpYoxZ4zCeAcDr\ntjGsB9oDr4kIxpg3XK59BOgKONbR+tO7V66Ky9KlULGid7G//urbuT/+GMLCvIutV88qP6gu3KJF\nkJXlXWzDhtC8+cUdj1JKKVUYJVFO8DGgNlDPGJMMICLbgd+AgcDs/DqKyI1AH6C/MeY9W9vXQCIw\nEehua6sCDAemGGNm2bp/JSJ1gWnAGlucP1aCvsAY85xDXBTwvIi8ZYzJdhhCljFmcyFfv7rI3nvv\n4p17wQLvY7t318S7sObNg7Q072Lvu08Tb6WUUqVbSSw16Qpsyk26AYwxe4Bvgbs99O0GZAEfO/TN\nBj4COopIgK25ExAAfODS/33gBhGpZXt+C1DZTdxCIBK41buXpJRSSimlVMFKIvFuBPzipj0RaOih\nb0Mg2RiT6aZvIHCtQ9wZY0ySmzhxuE4j26+u43GNy1VVRI6KyFkR2SkiI0VEb1BVSimllFIelcRS\nk0pAipv2E0BEIfrmHs/9NdXLONyc0zUO4AdgC1ZSXh7oAUzFSvYf8zBupZRSSilVxumW8V4yxvzL\npWmNiJwG/iki093MriulCkEmCOzZAGesu1mbVv9bCY9IORIRp+da2UQppTwricQ7Bfcz2/nNZrv2\nrZlPXzg/U50ChHsZh208hwuIy8+HwNPA3wC3iXdcXJz999HR0URHR3s4pVJKKaWUulgSEhJISEgo\nkWuXROKdyPm11Y4aAp6KuyUC3UWkvMs670ZYN13+7hAXJCJ1jDG7XeKMw3Vy13I3wjnxzl3b7W2x\nuXynehwT74vhw7MDSCHSq9jDOVEXdSwlKS0tjayssyU9DCc//vgHCxduL+lhXLCOHTtStWrVIj3n\nf/8La9Z4jgMg4Vk4G+z1uTdtgokTvR/LqFEQFOR9vFJKqcuD60TohAkTiu3aJZF4rwJmikhtWzUT\nRKQ20BoY6aHvamACEINVeSS3JOC9wFpjTG7mtQY4B/QFnnfo3w/4xRiz1/b8O+CYLW6DQ9z9wHGs\nSisF6QfkACVWYvD7nLYcNLU8B17mTp48CZws6WE4+e6779iz5+2SHsYFa9y4cZEn3rt3w6pVXgYf\n7ObzuXfv9hyXa/hwTbyVUkoVr5JIvOcBTwIrReRZW9tEYC/wZm6QiNQEdgNxxphJAMaYH0VkMTBb\nRAKxNtB5AqsueJ/cvsaYo7YdJceIyCnOb6ATjVXOMDfunG0Mr4rIQWAd1gY6/YHBxphzDmNZiFW2\n8HcgCOgJPAC87lgaURUsMMcQlXUmT3s2sK98ebd9amdmIm7a/wgK4py4O6KUUkopVfoUe+JtjEkX\nkXbALOA9rKUe64Chxph0h1BxeDjqj7XL5PNY67h/AjoaY35yiRsLpAFDgKuAnUCMMSbeZTxviEgO\n1oY7zwD7gCdddq1Mw5oBHwlciTXLvQN4yhgz19f3QCmllFJKlT0lUtXEGLMfa7lIQTF7AX837Wew\nEuRnPPQ3wBTbw9N45mHNxOd3PAVrhlspVUy0iknpplVMlFLKd7r5i1JKKaWUUsVAE2+llFJKKaWK\ngW6go1QZ8McfQ8nODvUqNixsC5GR3tb8U0oppZS3NPFWqgzIyLiG7OyKXsWWL//HRR6NUkopVTbp\nUhOllFJKKaWKgc54K6VKpa0Htzg91yonpYu41NDXKidKKeWZzngrpZRSSilVDDTxVkoppZRSqhho\n4q2UUkoppVQx0DXe6qIQwN/Nmk93bd4cyy/elx45CEY8x10oMeDnMKLTqbeQ/NdNGOCcFO2Fw8O/\noWrVxUV6zrKme3co4j8Wu1WroHx572I//hjeeuvijMNXn30G5dz9r5CTA8ePOzVVtv167KKPSiml\nLh+aeKuLIjgnh5pnzngd7w8+xQNUz8ryKf5IQACn/f196uOLIJNDtTxjCuKcCH8EBRXptbKzQ4r0\nfGVRSsrFO7cvnyEzMuDEiYs3liLx11/QubNTU7zt11bA2WIfkFJKXZo08VZKlUpaxaR0+1vTpgBk\nbdwIgYElPBqllLo0aOKtlHLrxRdfJCwsrEjP+dtvTdm3r32RnrM0evrpWZQrl3ceePz48VStWrUE\nRqSUUqo00MRbKeXWr7/+WuTnPHHiCk6fblnk5y1tNm/ejJ9f3qVTZ3xcTqWUUuryolVNlFJKKaWU\nKgYlMuMtIlcDs4E7sApgrAOeNsb84UXfIGAS0BcIB34ERhljvnGJE2A08BhwFbATmGiMWe7mnAOA\nYcD/AXuAWcaYN9zEdQeeA64DDgPzgKnGmByvXrhSRcQYf7KzvSybAVh/zbw9dzmfzu3ndwYR3bXQ\nUU5OeYybEjrp6cLp085tl+okeFZOOc6acnCaEr+7MjS0ZK+fKysLzvrwXpSWcStV0s6cgXPnvIsV\ngZBLuL5AsSfeIhIMfAlkAPfbmicDG0SksTEmw8Mp5gOdgWeAZGAwsFZEWhpjfnaIm4SVTI8FtgG9\ngSUi0sUYs8ZhPAOA121jWA+0B14TERyTbxHpCCzFSraHAjcDU4EKwBif3wilCuHkyTacPNnmopw7\nNbUtqaltvY6vW/cJypU7dVHGcqn67bc5bttjYqpeNvchvneiC68f7QV3lPPlc91FsWVLyV4/17x5\n8M473sUGBMB3313c8Sh1qZg6Ff79b+9iq1e3SrZeqkpixvsxoDZQzxiTDCAi24HfgIFYM+FuiciN\nQB+gvzHmPVvb10AiMBHobmurAgwHphhjZtm6fyUidYFpwBpbnD9Wgr7AGPOcQ1wU8LyIvGWMyba1\nTwW+NsY87hAXBowTkVnGmCOFeVOUUs7Sz6Y7PQ8JuISnOC5De/buJZ10dmzbhgGaNtUqNEop5UlJ\nJN5dgU25STeAMWaPiHwL3E0BiTfQDcgCPnbomy0iHwGjRCTAGHMW6AQEAB+49H8feFtEahlj9gK3\nYO0D4Rq3EOgP3IqVYF8N3AQ86iZuAtYM/AJPL1wpVbadOHEC/4tYS76w3nxzBf7+eZcNBaanc9fR\nowX2Perh+MVSuXIkeruSUupSURKJdyPgEzfticA9Hvo2BJKNMZlu+gYC1wL/s8WdMcYkuYkT2/G9\ntrEA/FJA3Fe2OGNrt7N9YEi3xSkvGGOQi7Vd4CUqOzsHf39NHBxlZ1+et02kpFz4TjnF8XPy9ttv\nI5Kdp73CuXO0OFbwHpXHjhV/4p2dnUNkZKViv25plpCQQHR0dEkPo9TQ9yMvfU9KVkkk3pUAd3vG\nnQAiCtE393jur6lexuHmnN7G5bbpv/zqguXkZGvi7SInJ2/yV9bpz0leOTnZ5OTkkJ5jzbIPAAAR\nNUlEQVReOu5QzcoqR06Od99o5ORwUcb9xRdf0Lx580KdI+RSvnPNhSaZeel7UrK0jrdSSqlL1m+/\n/UabNg+U9DAAOHIkhuPHu3oVK3KONm0eLvIxHDx4kLVr115w/8DAQFasWFGEIypZp06d4vDhwyU6\nBj8/P6pUqVKiY1ClR0kk3im4n9nObzbbtW/NfPrC+ZnqFKxSg97EYRvPYS/jXEU4xHnlyiuvpEGD\nBlQ7eZKUDE9FXApW5cQRJPvSWbqRlZVFYAmVdfCrWJG0oKCLdv7gs2eJSs37RctZfz/OVIrMt19q\nagrh4Z6+7Cm96tevS0CAdz/HBw9egTGe/ppb70mqy5dWVcP/74LGd7kojp+T+vXr4+eXd5lP8Nmz\npJw86dR2as9xIthhf161avH/+eS+Jw0aNCj2a7sTHByCv7/nn28AP7/sizLurKysQp93+PDhRTSa\nkvfzzz9z6NChEh1DhQoVuOuuu0p0DI527drFv70tIVJMjh6tSViYd4sH/Pyy+Pzz37nqqqsu8qgu\nEmNMsT6wSvZ97ab9S+BLD32fBTKB8i7tcVjlCQNsz+8HsoE6LnH9be21bM9vA3KAdi5xbW3tbW3P\na9ieP+wSV8vW/mA+4zX60Ic+9KEPfehDH/oo3Y/iyoNLYsZ7FTBTRGobY/YAiEhtoDUw0kPf1VhV\nRGKwKorklgS8F1hrq2gCVrnAc1ib7Dzv0L8f8IutognAd8AxW9wGh7j7gePAtwDGmD9E5Cdb3HyX\nuCwg3t1gjbsdNJRSSimlVJlUEon3POBJYKWIPGtrm4hVZeTN3CARqQnsBuKMMZMAjDE/ishiYLaI\nBGJtoPMEVl3wPrl9jTFHReQlYIyInOL8BjrRWOUMc+PO2cbwqogcxNpBsz3WzPhgY4zjPkpjgdUi\n8jrwIdAEGAfM1hreSimllFLKE7EtiSjei1p1sWcBHTi/ZfxQY8w+h5hanE+8n3doD8LaZfI+rHXc\nPwEjjfst48cAAzi/ZfwEY0yeu0Zsu1cOx1o6sg94yeS/Zfx4oAHnt4yfYkriTVRKKaWUUpeW4l7j\nfSk8gChgDrAROI21jrumm7ggYCZwEEi3xd/mJi73Q0Ay1lr0H4Ge+Vx7AFYt8kxgBzDwEno/ctw8\nsoHGl9P7YRtXL2ApsMf2Z///7Z17sF1Vfcc/XxKewYjBCi2PIgV8gCiBIKCEEB+AiA5abFFIxjgq\ndqYoQy2tShwDwiAM0+koUAapLSAg04oOqMWQECBGocrL8Ao2RSUgJOERSBNI8usfa53Jvvvuc+/O\n9dxzNud8PzN77tlr//Y6a3/Pb6/7O+us/VsPA+cBO5bsdgKuAJ4BXgR+ChzQDV9qoiZsfi6iyk8m\n96Em7yc91/Jk9uHfAdcDbynZ7Z61ew54HvgPYI+K+jrqT03VhM3P2ZS31f2oSUVbf5Kvd954XmuT\n7506mgxSf1L3nhgkH6mjSRN9pOfCNXHLH+aTwE2k+dsbqQ40ryFlNJkDHE36Z7mW4YHm1/OHc0au\n+9Jc57Elu0/n8nnZbl7e72mwuQV6bMo3/KGlrfww7Ktaj9y2JcB1pClORwKnk7Lf/KxkdyfpV5SP\nkQKO23KH+Gfj6UtN1aTQCZ5T4SfqQ03+GrgA+EjW5BOkBbueIwfWwPbAMuB+0lS4E/LrZcD24+lP\nDdbkqPwZ/k3JR6ZW1Peq16TUzpNJ//g3MjzwHpj+pI4mDFB/UveeGCQfqaNJE32k5zdU0zfgU1QE\nmsDb84c5q1A2gTTKd2Oh7E9IozpzS+fPB+4tnfsH4MqS3beBp4EJvdZiJD3ysWEjNBU2faEHsHNF\nWSubzoy8/+G8P71gM5n04O4/jZcvNVyTVic4Z5S6+kKTNte2X762M/L+54FXgDcWbPbKZV8olHXU\nn5q0VWjS+oc6c5Tz+koTUnraJ4G/Kveng9af1NRkYPqTOvfEoPlITU0a5yNeBm3sfIiU0eR7rYKI\n2Ega8TtG0ta5+Fhga9I3qSJXA2/Lc9kBDgdeX2F3FbAz8O6Otr539IUeEbGqovhu0k9Qu+X9E4AV\nEXF74bwXSNl5Plw4r9O+1BNqalKXvtCkDa28/60sTCcAP4+I5S2DSBmfFjPUTzrtT02irAkkvxmN\nftPkAuD+iLi+4thA9ScFRtKkLv2iyWj3xCD6SKeyx3VNEwfeY+etwPKIWFcqXwpsA+xTsFsfEb+p\nsFM+DrB//vvrUeyazuckrZP0kqRbJZUD5H7WYwYpH+iDeX9/hrcf0jXsKam1LnOnfalJzCBp8lCp\n/HxJr0h6TtIPJB1QOt5XmkjaStLWkvYF/oX0s/m1+fBIflJsf6f9qae00eS6ktk1kjZIWinpGkl7\nlI73jSa5rzyFlPWrioHrT2po0mKQ+pOR7omB85HMaP0ENMhHvGT82Gm30ubqwvHW3+HLGVbbUVFn\n2a7JXEWaB76C9PPOF4EFkt5b+Abel3pI2o2UY/6nEXFPLp5CeviiTOsaXkeaP9ZpX2oEJU1+lYvX\nA5cBt5DmHb6ZlJZzsaRDI+KRbNdvmvwCODi/Xga8p/ALwUjXWlyqstP+1GuqNFmZ958HLgIWAS8A\nB5H85GeSDirY9YUmeTTtMuDCiHisjdlA9Sc1NRmk/qTOPTFQPkI9TRrnIw68TceIiNmF3cWSfkj6\n9n0uML03rRp/JE0CfkD6mWpOj5vTCNppEhFPkR6EabFY0n+RRgu+DMzqZju7yCmkuZZ7A38HzJf0\nriikUB1A2moSEfeSMgW0uEPSHcBdpId253a9tePLWcB2pCxAJjGqJoPUnwzgPTEqdTRpoo94qsnY\neZaho1EtWt92VhfsdqppR0WdZbtXDRHxInAzMK1Q3Fd6SNqONMq/F3BMRKwoHB7NR56tabelvtRT\nRtFkGBHxe9KT+GU/6RtNIuKRiLg7z1N9L7Aj8A/58EjXWhyB6bQ/9ZRRNKmyvwd4lC3zk8Zrkn8W\n/xJwNrCdpNdKavn0tnl/KwaoP9kCTYYxCP1Ji4p7YmB8pB1t+omyTU99xIH32FkKvDEHGUX2J43y\nPVaw21bS3hV2xfnArflB+5fsWvOFHuTVSxRe940ekiaS0g1NBY6LiHKbljK8/ZCu4bcRsbZg10lf\n6hk1NBmJsp/0hSZlIuJ5UvtbcwZH8pNi+zvtT42hQpMRzQuv+0GTvUn5g68m/VN/lvTPO0jT9VYD\nBzBY/UldTUZiIPqTTOtaB8lHRiNGN+mRj9RJfTLIG+3TCb6DlHrm1ELZhCx6OfXMeuDs0vnzgfsK\n+xNJafK+XbJrJcKf2GstRtKjje1k4HFgYb/pQfpS8D3SgkIz2ti0UjsdWSibDKxkaGqnjvpSkzVp\nc96epLl6/9pvmrS53l2ANcAlef/zpI59r4LNXrmsKp1gR/ypSVtZkzY2hwAbgK/2kya5vdMrtk3A\nv5Fyne8wSP1JXU3anDsw/Un5nhgkH6mrSRN9pOciNXUjrcL3UVJi9E3AaXm/mB/zWlJ+zE8BM0kr\nz60F3l6q6/xcXky2voE0Ili0+2wuP4fNC8ZsAE5ruh7AmcDlpIUOjgJmkxYBWQcc0Yd6tHSYB7yz\ntO2WbURKCfc4KQftMaTFDFa2bMbLlxqsyUXAxcBJpIwnp5FWulwF7NuHmvwn8BVSqqoZ2acfyte1\nT7bZgfTT6H3Z7kOkeYvLKAQX4+FPDdNkNfAX2ebqfN+fSFrI4kzSF+7lwJR+06SNTuWc1QPVn9TU\nZGD6kzr3xKD5SE1NGucjPb+RmrqxeUnR8ragYLNt/lBby4suof3yol9i6PKiJ7Z530+TErb/H/AI\nDVilsY4ewAeBO0ij1Ouz838fOLhP9VjeRo+NFBLrs3n53pWk5Xtvof3yvR31pSZqAnySlM1iVfaT\nFaRsOPtW1NcPmnyRlMt8df78HwIuYfgvaLsDNzB0yfiqRao66k9N1YQ01/te0hSD9aRA4lJgl37U\npI1OG4Gvjee1NvneqaPJIPUnde+JQfKROpo00UeUKzHGGGOMMcaMI3640hhjjDHGmC7gwNsYY4wx\nxpgu4MDbGGOMMcaYLuDA2xhjjDHGmC7gwNsYY4wxxpgu4MDbGGOMMcaYLuDA2xhjjDHGmC7gwNsY\nYxqIpFMlPV7YXyrptA6/x2GSfi7pRUkbJR3YyfrHA0l/LmmTpFm9bosxxmwpE3vdAGOMMZVMBf4b\nQNIk4E3ALzv8HlcCLwHHk1Zge7TD9RtjjCngEW9jjGkmB7M50J5KWi77vk5VLmkrYD/g5ohYFBF3\nRcS6TtX/xyBpm163wRhjxgMH3sYY0zByUPwONgfe04AHI+Llmue/RtI3JT0haZ2khyV9oXB8NrAB\nEDA3T934nzZ1Tc3HjyiU/W0um1co2yeXHVcoO1TSfElr8nSW+ZKmler/jqTf5WkviyWtBS7Ix7aX\ndImklbmOG4HdK9o4TdIt2W6tpN9I+mYdrYwxpps48DbGmIYgabmkTaSgeBLwo7x/EXBgDmw3Stpz\nhDoE/AiYDVwIfBD4MXCxpHOz2U3Au0iB9xXAYcCJbaq8B3gOmFkoOxpYWyp7D/AKcHtux4HAbcBr\ngVnAqcBkYJGktxXOi2xzLfBd4Nj8F+ByYE6+/hOBR/KxKFzvJOAn+b1n5fO/hqdSGmMaiDsmY4xp\nDscB25CC5vcDHycFx3cAZ5MCWYAVI9RxPCmonh0RV+Wy+ZJ2BM6UdHFErJJ0Vz72+4i4q7ImICJC\n0u2kYPvcHNgfBVwKnC5ph4hYC8wAfhkRL+VT5wLrgJkRsQZA0nzgf4GvAn9ZeJtJwMcj4qZWgaT9\ngJOBf4yICwvX8Rrgs4Vz3wzsBJwVEb/OZbcD/z6CRsYY0xM84m2MMQ0hIh6OiPuBPYDbIuIB0sjy\njsANEXF/3jaMUM2RpPng15bKryYF9YePoWkLgMPz3OuDSCPU3wBezu8HKTBfWGrHTa2gO1/fGuCH\npMC9yCvAzaWyd5K+dNxQKr8ul7dYRhqRv1zSJyQNm4pijDFNwYG3McY0AElbSZogaSJpxHqJpAnA\ndOAJ4Om8PxpTgNUVwflTpIB1yhiatxDYFjiCNLJ9X0Q8A9wJHC3prcAbSAF6sR1PVtT1FPC6Utkz\nERGlsj/Nf/9QKh+yHxEvkIL+J4BvAb+V9ICkj9S4LmOM6SoOvI0xphncShr5fRnYFbgq718B7NY6\nJmn6KPWsBqbkAL7IroXjW0QeeV9Fmsc9k80B9oJC2XpgcakduzKcXYFny29RYdcK2ncplZf3yb8C\nnEQK9g8DHgOuz18IjDGmMTjwNsaYZvAZ4BDSg4SP5deHAM8AX86vpzF6Lu9FwATgpFL5KaTgeMkY\n23cb8D7g3QwNvA8iPfhYTke4CPhAfvgRSNlWgBMYOiWlHb8gBeQfK5WfTHWgTkRsyvPV55I0eEuN\n9zHGmK7hhyuNMaYBRMQyAElzSbm175H0JuD1wJUR8XTNqn5MmgJymaQ3AEtJD1zOAc6LiC0e8c4s\nJE3l2EB62BNSxpM1pOkn80r25+T3XSDpglx2FrB9PjYiEfGopO8C8/IUm7tJD5weV7STdDzpS8uN\nwHLSfPjTgRcY+5cMY4wZFxx4G2NMQ5C0NWnaxrdy0bHAr7Yg6G5lIfkAcB7w98DOpEwiZ0TEP5fN\naTN6XMHCbHt3RLyY32uTpEWklIVDRrEj4gFJM4CvA98hzS9fAkzPU1fK7ajiM6TA/kzSg6G3kka8\n7yzYLCM9gPoV0rzwNaQg/X0RMVL2F2OM6Toa/jyLMcYYY4wxptN4jrcxxhhjjDFdwIG3McYYY4wx\nXcCBtzHGGGOMMV3AgbcxxhhjjDFdwIG3McYYY4wxXcCBtzHGGGOMMV3AgbcxxhhjjDFdwIG3McYY\nY4wxXcCBtzHGGGOMMV3g/wEDTqsVP2bfVAAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x7f028c09bb90>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.figure(figsize=(10.5,4.5))\n",
    "plt.figure(figsize=(10.5,4.5))\n",
    "plt.hist(wiki['length'], 50, color='k', edgecolor='None', histtype='stepfilled', normed=True,\n",
    "         label='Entire Wikipedia', zorder=3, alpha=0.8)\n",
    "plt.hist(nearest_neighbors_euclidean['length'], 50, color='r', edgecolor='None', histtype='stepfilled', normed=True,\n",
    "         label='100 NNs of Obama (Euclidean)', zorder=10, alpha=0.8)\n",
    "plt.hist(nearest_neighbors_cosine['length'], 50, color='b', edgecolor='None', histtype='stepfilled', normed=True,\n",
    "         label='100 NNs of Obama (cosine)', zorder=11, alpha=0.8)\n",
    "plt.axvline(x=wiki['length'][wiki['name'] == 'Barack Obama'][0], color='k', linestyle='--', linewidth=4,\n",
    "           label='Length of Barack Obama', zorder=2)\n",
    "plt.axvline(x=wiki['length'][wiki['name'] == 'Joe Biden'][0], color='g', linestyle='--', linewidth=4,\n",
    "           label='Length of Joe Biden', zorder=1)\n",
    "plt.axis([1000, 5500, 0, 0.004])\n",
    "plt.legend(loc='best', prop={'size':15})\n",
    "plt.title('Distribution of document length')\n",
    "plt.xlabel('# of words')\n",
    "plt.ylabel('Percentage')\n",
    "plt.rcParams.update({'font.size': 16})\n",
    "plt.tight_layout()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Indeed, the 100 nearest neighbors using cosine distance provide a sampling across the range of document lengths, rather than just short articles like Euclidean distance provided."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Moral of the story**: In deciding the features and distance measures, check if they produce results that make sense for your particular application."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Problem with cosine distances: tweets vs. long articles"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Happily ever after? Not so fast. Cosine distances ignore all document lengths, which may be great in certain situations but not in others. For instance, consider the following (admittedly contrived) example."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "```\n",
    "+--------------------------------------------------------+\n",
    "|                                             +--------+ |\n",
    "|  One that shall not be named                | Follow | |\n",
    "|  @username                                  +--------+ |\n",
    "|                                                        |\n",
    "|  Democratic governments control law in response to     |\n",
    "|  popular act.                                          |\n",
    "|                                                        |\n",
    "|  8:05 AM - 16 May 2016                                 |\n",
    "|                                                        |\n",
    "|  Reply   Retweet (1,332)   Like (300)                  |\n",
    "|                                                        |\n",
    "+--------------------------------------------------------+\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "How similar is this tweet to Barack Obama's Wikipedia article? Let's transform the tweet into TF-IDF features, using an encoder fit to the Wikipedia dataset.  (That is, let's treat this tweet as an article in our Wikipedia dataset and see what happens.)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 81,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div style=\"max-height:1000px;max-width:1500px;overflow:auto;\"><table frame=\"box\" rules=\"cols\">\n",
       "    <tr>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">text</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">word_count</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">tf_idf.word_count</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">democratic governments<br>control law in response ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">{'control': 1,<br>'democratic': 1, 'in' ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">{'control':<br>3.721765211295327, ...</td>\n",
       "    </tr>\n",
       "</table>\n",
       "[1 rows x 3 columns]<br/>\n",
       "</div>"
      ],
      "text/plain": [
       "Columns:\n",
       "\ttext\tstr\n",
       "\tword_count\tdict\n",
       "\ttf_idf.word_count\tdict\n",
       "\n",
       "Rows: 1\n",
       "\n",
       "Data:\n",
       "+-------------------------------+-------------------------------+\n",
       "|              text             |           word_count          |\n",
       "+-------------------------------+-------------------------------+\n",
       "| democratic governments con... | {'control': 1, 'democratic... |\n",
       "+-------------------------------+-------------------------------+\n",
       "+-------------------------------+\n",
       "|       tf_idf.word_count       |\n",
       "+-------------------------------+\n",
       "| {'control': 3.721765211295... |\n",
       "+-------------------------------+\n",
       "[1 rows x 3 columns]"
      ]
     },
     "execution_count": 81,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "sf = graphlab.SFrame({'text': ['democratic governments control law in response to popular act']})\n",
    "sf['word_count'] = graphlab.text_analytics.count_words(sf['text'])\n",
    "\n",
    "encoder = graphlab.feature_engineering.TFIDF(features=['word_count'], output_column_prefix='tf_idf')\n",
    "encoder.fit(wiki)\n",
    "sf = encoder.transform(sf)\n",
    "sf"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Let's look at the TF-IDF vectors for this tweet and for Barack Obama's Wikipedia entry, just to visually see their differences."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 82,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'act': 3.4597778278724887,\n",
       " 'control': 3.721765211295327,\n",
       " 'democratic': 3.1026721743330414,\n",
       " 'governments': 4.167571323949673,\n",
       " 'in': 0.0009654063501214492,\n",
       " 'law': 2.4538226269605703,\n",
       " 'popular': 2.764478952022998,\n",
       " 'response': 4.261461747058352,\n",
       " 'to': 0.04694493768179923}"
      ]
     },
     "execution_count": 82,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "tweet_tf_idf = sf[0]['tf_idf.word_count']\n",
    "tweet_tf_idf"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 83,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div style=\"max-height:1000px;max-width:1500px;overflow:auto;\"><table frame=\"box\" rules=\"cols\">\n",
       "    <tr>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">URI</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">name</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">text</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">word_count</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">has_top_words</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">&lt;http://dbpedia.org/resou<br>rce/Barack_Obama&gt; ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">barack hussein obama ii<br>brk husen bm born august ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">{'operations': 1,<br>'represent': 1, 'offi ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">1</td>\n",
       "    </tr>\n",
       "</table>\n",
       "<table frame=\"box\" rules=\"cols\">\n",
       "    <tr>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">tf_idf</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">length</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">{'operations':<br>3.811771079388818, ...</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">3278</td>\n",
       "    </tr>\n",
       "</table>\n",
       "[? rows x 7 columns]<br/>Note: Only the head of the SFrame is printed. This SFrame is lazily evaluated.<br/>You can use sf.materialize() to force materialization.\n",
       "</div>"
      ],
      "text/plain": [
       "Columns:\n",
       "\tURI\tstr\n",
       "\tname\tstr\n",
       "\ttext\tstr\n",
       "\tword_count\tdict\n",
       "\thas_top_words\tint\n",
       "\ttf_idf\tdict\n",
       "\tlength\tint\n",
       "\n",
       "Rows: Unknown\n",
       "\n",
       "Data:\n",
       "+-------------------------------+--------------+-------------------------------+\n",
       "|              URI              |     name     |              text             |\n",
       "+-------------------------------+--------------+-------------------------------+\n",
       "| <http://dbpedia.org/resour... | Barack Obama | barack hussein obama ii br... |\n",
       "+-------------------------------+--------------+-------------------------------+\n",
       "+-------------------------------+---------------+-------------------------------+\n",
       "|           word_count          | has_top_words |             tf_idf            |\n",
       "+-------------------------------+---------------+-------------------------------+\n",
       "| {'operations': 1, 'represe... |       1       | {'operations': 3.811771079... |\n",
       "+-------------------------------+---------------+-------------------------------+\n",
       "+--------+\n",
       "| length |\n",
       "+--------+\n",
       "|  3278  |\n",
       "+--------+\n",
       "[? rows x 7 columns]\n",
       "Note: Only the head of the SFrame is printed. This SFrame is lazily evaluated.\n",
       "You can use sf.materialize() to force materialization."
      ]
     },
     "execution_count": 83,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "obama = wiki[wiki['name'] == 'Barack Obama']\n",
    "obama"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now, compute the cosine distance between the Barack Obama article and this tweet:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 84,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0.7059183777794328"
      ]
     },
     "execution_count": 84,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "obama_tf_idf = obama[0]['tf_idf']\n",
    "graphlab.toolkits.distances.cosine(obama_tf_idf, tweet_tf_idf)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Let's compare this distance to the distance between the Barack Obama article and all of its Wikipedia 10 nearest neighbors:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 85,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<pre>Starting pairwise querying.</pre>"
      ],
      "text/plain": [
       "Starting pairwise querying."
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>+--------------+---------+-------------+--------------+</pre>"
      ],
      "text/plain": [
       "+--------------+---------+-------------+--------------+"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>| Query points | # Pairs | % Complete. | Elapsed Time |</pre>"
      ],
      "text/plain": [
       "| Query points | # Pairs | % Complete. | Elapsed Time |"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>+--------------+---------+-------------+--------------+</pre>"
      ],
      "text/plain": [
       "+--------------+---------+-------------+--------------+"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>| 0            | 1       | 0.00169288  | 27.547ms     |</pre>"
      ],
      "text/plain": [
       "| 0            | 1       | 0.00169288  | 27.547ms     |"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>| Done         |         | 100         | 716.246ms    |</pre>"
      ],
      "text/plain": [
       "| Done         |         | 100         | 716.246ms    |"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<pre>+--------------+---------+-------------+--------------+</pre>"
      ],
      "text/plain": [
       "+--------------+---------+-------------+--------------+"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<div style=\"max-height:1000px;max-width:1500px;overflow:auto;\"><table frame=\"box\" rules=\"cols\">\n",
       "    <tr>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">query_label</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">reference_label</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">distance</th>\n",
       "        <th style=\"padding-left: 1em; padding-right: 1em; text-align: center\">rank</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">0.0</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Joe Biden</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">0.703138676734</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Samantha Power</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">0.742981902328</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Hillary Rodham Clinton</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">0.758358397887</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Eric Stern (politician)</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">0.770561227601</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Robert Gibbs</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">0.784677504751</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Eric Holder</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">0.788039072943</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">7</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Jesse Lee (politician)</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">0.790926415366</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">8</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Henry Waxman</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">0.798322602893</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">9</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Barack Obama</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">Joe the Plumber</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">0.799466360042</td>\n",
       "        <td style=\"padding-left: 1em; padding-right: 1em; text-align: center; vertical-align: top\">10</td>\n",
       "    </tr>\n",
       "</table>\n",
       "[10 rows x 4 columns]<br/>\n",
       "</div>"
      ],
      "text/plain": [
       "Columns:\n",
       "\tquery_label\tstr\n",
       "\treference_label\tstr\n",
       "\tdistance\tfloat\n",
       "\trank\tint\n",
       "\n",
       "Rows: 10\n",
       "\n",
       "Data:\n",
       "+--------------+-------------------------+----------------+------+\n",
       "| query_label  |     reference_label     |    distance    | rank |\n",
       "+--------------+-------------------------+----------------+------+\n",
       "| Barack Obama |       Barack Obama      |      0.0       |  1   |\n",
       "| Barack Obama |        Joe Biden        | 0.703138676734 |  2   |\n",
       "| Barack Obama |      Samantha Power     | 0.742981902328 |  3   |\n",
       "| Barack Obama |  Hillary Rodham Clinton | 0.758358397887 |  4   |\n",
       "| Barack Obama | Eric Stern (politician) | 0.770561227601 |  5   |\n",
       "| Barack Obama |       Robert Gibbs      | 0.784677504751 |  6   |\n",
       "| Barack Obama |       Eric Holder       | 0.788039072943 |  7   |\n",
       "| Barack Obama |  Jesse Lee (politician) | 0.790926415366 |  8   |\n",
       "| Barack Obama |       Henry Waxman      | 0.798322602893 |  9   |\n",
       "| Barack Obama |     Joe the Plumber     | 0.799466360042 |  10  |\n",
       "+--------------+-------------------------+----------------+------+\n",
       "[10 rows x 4 columns]"
      ]
     },
     "execution_count": 85,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "model2_tf_idf.query(obama, label='name', k=10)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "With cosine distances, the tweet is \"nearer\" to Barack Obama than everyone else, except for Joe Biden!  This probably is not something we want. If someone is reading the Barack Obama Wikipedia page, would you want to recommend they read this tweet? Ignoring article lengths completely resulted in nonsensical results. In practice, it is common to enforce maximum or minimum document lengths. After all, when someone is reading a long article from _The Atlantic_, you wouldn't recommend him/her a tweet."
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 2",
   "language": "python",
   "name": "python2"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 2
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython2",
   "version": "2.7.13"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 0
}