answers/01_jupyter_howto.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# What is Jupyter and how do you use it?\n",
    "\n",
    "[Project Jupyter](http://jupyter.org) exists to develop software and standards for interactive computing. Jupyter, which you are using now, provides an interactive notebook which runs on a cloud-server, and with which you interact using a web browser.\n",
    "\n",
    "As installed, Jupyter provides two things:\n",
    "\n",
    "* An interactive Python notebook, which you are using now (this is an interactive notebook!)\n",
    "* An interactive bash terminal (we will use this later)\n",
    "\n",
    "What is an interactive Python notebook? It is a notebook that mixes documentation (like this!) with Python code (like below), with the output of that code.\n",
    "\n",
    "For example, below is the Python code to print \"Hello World\". Click on the below code and then press \"SHIFT+Return\". You should see that the code is run, and below \"Hello World\" will be printed."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Hello World\n"
     ]
    }
   ],
   "source": [
    "print(\"Hello World\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The above code is interactive because it runs when you pressed \"SHIFT+Return\". It is also interactive because you can change it. For example, click again on the code and change \"Hello World\" to \"Hello Jupyter\". Press \"SHIFT+Return\" again and you should see \"Hello Jupyter\" printed.\n",
    "\n",
    "A code cell can have as much or little Python in it as you want. The below cell defines a function and then runs it in a loop. What do you think will be printed out when you select it and press \"SHIFT+Return\"? Have a go. Are you right?"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "10...\n",
      "9...\n",
      "8...\n",
      "7...\n",
      "6...\n",
      "5...\n",
      "4...\n",
      "3...\n",
      "2...\n",
      "1...\n",
      "Lift off!\n"
     ]
    }
   ],
   "source": [
    "def countDown(start):\n",
    "    for i in range(start, 0, -1):\n",
    "        print(\"%d...\" % i)\n",
    "    print(\"Lift off!\")\n",
    "    \n",
    "countDown(10)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Each cell can use the variables and functions defined in previous cells. For example, the next cell sets the value of the variable `x` to 5, while the following cell then uses that to call the `countDown` function."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [],
   "source": [
    "x = 21"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "21...\n",
      "20...\n",
      "19...\n",
      "18...\n",
      "17...\n",
      "16...\n",
      "15...\n",
      "14...\n",
      "13...\n",
      "12...\n",
      "11...\n",
      "10...\n",
      "9...\n",
      "8...\n",
      "7...\n",
      "6...\n",
      "5...\n",
      "4...\n",
      "3...\n",
      "2...\n",
      "1...\n",
      "Lift off!\n"
     ]
    }
   ],
   "source": [
    "countDown(x)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "You can go back up and edit the value of `x`. For example, set `x` to 7 and press SHIFT+Return. This has changed `x`. However, it doesn't re-run any code that depends on `x`. That is for you to do. You need to click on the next cell `countDown(x)` and press SHIFT+Return again. You should then see that the code is run and updated.\n",
    "\n",
    "Because you can change any cell at any time, a notebook can get into a confused state. If we change `x` again to `21`, then the cell `countDown(x)`, is now out of date, as it depends on the old value of `x`. So, how can we know what state each cell is in? The state is based on the order in which cells are executed. This is shown by the little number next to each cell, e.g. see below.\n",
    "\n",
    "![Image showing Jupyter state](images/jupyter_state.jpeg)\n",
    "\n",
    "The number \"10\" shows that the line `x = 21` was the 10th cell executed by Python, while the line `countDown(x)` was the 9th cell executed. As `countDown(x)` was executed before `x = 21`, it was not affected by `x = 21`. If you want it to be affected, you need to execute that cell again (so it is now the 11th cell executed), e.g.\n",
    "\n",
    "![Image showing updated Jupyer state](images/jupyter_state2.jpeg)\n",
    "\n",
    "If you find yourself getting confused, then click \"Kernel | Restart & Clear Output\" from the menu above to clear all outputs, clear the state, and reset back to a clean notebook.\n",
    "\n",
    "![Image showing clear and restart](images/jupyter_restart.jpeg)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Interactive Graphics\n",
    "\n",
    "In addition to mixing documentation with interactive Python, the notebook also allows Python modules to embed interactive graphics. For example, the [BioSimSpace Project](https://biosimspace.org) provides a easy wrapper around the Python molecular viewer [nglview](https://github.com/arose/nglview). This can be used to view molecules from within a notebook.\n",
    "\n",
    "Execute the cell below by selecting it and pressing SHIFT+Return. This will import the `viewMolecules` function from BioSimSpace, which will load the molecules contained in the file `data/complex.pdb` and will display it below."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Reading molecules from '['data/complex.pdb']'\n",
      "Rendering the molecules...\n"
     ]
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "7fe11cc237114eadb39b84e672bddf3d",
       "version_major": 2,
       "version_minor": 0
      },
      "text/html": [
       "<p>Failed to display Jupyter Widget of type <code>NGLWidget</code>.</p>\n",
       "<p>\n",
       "  If you're reading this message in the Jupyter Notebook or JupyterLab Notebook, it may mean\n",
       "  that the widgets JavaScript is still loading. If this message persists, it\n",
       "  likely means that the widgets JavaScript library is either not installed or\n",
       "  not enabled. See the <a href=\"https://ipywidgets.readthedocs.io/en/stable/user_install.html\">Jupyter\n",
       "  Widgets Documentation</a> for setup instructions.\n",
       "</p>\n",
       "<p>\n",
       "  If you're reading this message in another frontend (for example, a static\n",
       "  rendering on GitHub or <a href=\"https://nbviewer.jupyter.org/\">NBViewer</a>),\n",
       "  it may mean that your frontend doesn't currently support widgets.\n",
       "</p>\n"
      ],
      "text/plain": [
       "NGLWidget()"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "de114cb2c0664de99016dfb85a2f452c",
       "version_major": 2,
       "version_minor": 0
      },
      "text/html": [
       "<p>Failed to display Jupyter Widget of type <code>Tab</code>.</p>\n",
       "<p>\n",
       "  If you're reading this message in the Jupyter Notebook or JupyterLab Notebook, it may mean\n",
       "  that the widgets JavaScript is still loading. If this message persists, it\n",
       "  likely means that the widgets JavaScript library is either not installed or\n",
       "  not enabled. See the <a href=\"https://ipywidgets.readthedocs.io/en/stable/user_install.html\">Jupyter\n",
       "  Widgets Documentation</a> for setup instructions.\n",
       "</p>\n",
       "<p>\n",
       "  If you're reading this message in another frontend (for example, a static\n",
       "  rendering on GitHub or <a href=\"https://nbviewer.jupyter.org/\">NBViewer</a>),\n",
       "  it may mean that your frontend doesn't currently support widgets.\n",
       "</p>\n"
      ],
      "text/plain": [
       "Tab(children=(Box(children=(Box(children=(Box(children=(Label(value='step'), IntSlider(value=1, min=-100)), layout=Layout(display='flex', flex_flow='row', justify_content='space-between')), Box(children=(Label(value='delay'), IntSlider(value=100, max=1000, min=10)), layout=Layout(display='flex', flex_flow='row', justify_content='space-between')), Box(children=(Label(value='background'), ColorPicker(value='white')), layout=Layout(display='flex', flex_flow='row', justify_content='space-between')), Box(children=(Label(value='camera'), Dropdown(options=('perspective', 'orthographic'), value='perspective')), layout=Layout(display='flex', flex_flow='row', justify_content='space-between')), Box(children=(Label(value=''), HBox(children=(ToggleButton(value=False, description='Smoothing', tooltip='smoothing trajectory'), Button(description=' Center', icon='bullseye', style=ButtonStyle()), Button(description=' Screenshot', icon='camera', style=ButtonStyle()), Button(description='qtconsole', style=ButtonStyle(), tooltip='pop up qtconsole')), layout=Layout(flex='1 1 auto', width='auto'))), layout=Layout(display='flex', flex_flow='row', justify_content='space-between'))), layout=Layout(align_items='stretch', display='flex', flex_flow='column', width='100%')),)), Box(), Box(), Box(), Box(), Box()), layout=Layout(align_items='stretch', align_self='center'), _titles={'4': 'Extra', '2': 'Preference', '3': 'Theme', '1': 'Representation', '0': 'General', '5': 'Help'})"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "from BioSimSpace import viewMolecules\n",
    "v = viewMolecules(\"data/complex.pdb\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "You can rotate and interact with molecules once they have loaded (the \"[*]\" next to a cell indicates that it is processing. It will turn into a number once processing is complete)\n",
    "\n",
    "You can change molecular representations and interact with the 3D molecule view. Later on we will go through some examples showing what you can do and how you can select parts of the molecule.\n",
    "\n",
    "In addition to viewing molecules, you can also draw graphs. This is achieved using a combination of the [matplotlib](https://matplotlib.org), [numpy](http://www.numpy.org) and [pandas](https://pandas.pydata.org) modules. For example, the below code draws a sine and cosine curve."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<matplotlib.axes._subplots.AxesSubplot at 0x7f07313ecac8>"
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"utf-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       "  \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Created with matplotlib (http://matplotlib.org/) -->\n",
       "<svg height=\"255pt\" version=\"1.1\" viewBox=\"0 0 393 255\" width=\"393pt\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       " <defs>\n",
       "  <style type=\"text/css\">\n",
       "*{stroke-linecap:butt;stroke-linejoin:round;}\n",
       "  </style>\n",
       " </defs>\n",
       " <g id=\"figure_1\">\n",
       "  <g id=\"patch_1\">\n",
       "   <path d=\"M 0 255.889375 \n",
       "L 393.695938 255.889375 \n",
       "L 393.695938 0 \n",
       "L 0 0 \n",
       "z\n",
       "\" style=\"fill:none;\"/>\n",
       "  </g>\n",
       "  <g id=\"axes_1\">\n",
       "   <g id=\"patch_2\">\n",
       "    <path d=\"M 48.195938 228.14 \n",
       "L 382.995938 228.14 \n",
       "L 382.995938 10.7 \n",
       "L 48.195938 10.7 \n",
       "z\n",
       "\" style=\"fill:#ffffff;\"/>\n",
       "   </g>\n",
       "   <g id=\"matplotlib.axis_1\">\n",
       "    <g id=\"xtick_1\">\n",
       "     <g id=\"line2d_1\">\n",
       "      <defs>\n",
       "       <path d=\"M 0 0 \n",
       "L 0 3.5 \n",
       "\" id=\"m46d7f69e4d\" style=\"stroke:#000000;stroke-width:0.8;\"/>\n",
       "      </defs>\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"70.273006\" xlink:href=\"#m46d7f69e4d\" y=\"228.14\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"text_1\">\n",
       "      <!-- −3 -->\n",
       "      <defs>\n",
       "       <path d=\"M 10.59375 35.5 \n",
       "L 73.1875 35.5 \n",
       "L 73.1875 27.203125 \n",
       "L 10.59375 27.203125 \n",
       "z\n",
       "\" id=\"DejaVuSans-2212\"/>\n",
       "       <path d=\"M 40.578125 39.3125 \n",
       "Q 47.65625 37.796875 51.625 33 \n",
       "Q 55.609375 28.21875 55.609375 21.1875 \n",
       "Q 55.609375 10.40625 48.1875 4.484375 \n",
       "Q 40.765625 -1.421875 27.09375 -1.421875 \n",
       "Q 22.515625 -1.421875 17.65625 -0.515625 \n",
       "Q 12.796875 0.390625 7.625 2.203125 \n",
       "L 7.625 11.71875 \n",
       "Q 11.71875 9.328125 16.59375 8.109375 \n",
       "Q 21.484375 6.890625 26.8125 6.890625 \n",
       "Q 36.078125 6.890625 40.9375 10.546875 \n",
       "Q 45.796875 14.203125 45.796875 21.1875 \n",
       "Q 45.796875 27.640625 41.28125 31.265625 \n",
       "Q 36.765625 34.90625 28.71875 34.90625 \n",
       "L 20.21875 34.90625 \n",
       "L 20.21875 43.015625 \n",
       "L 29.109375 43.015625 \n",
       "Q 36.375 43.015625 40.234375 45.921875 \n",
       "Q 44.09375 48.828125 44.09375 54.296875 \n",
       "Q 44.09375 59.90625 40.109375 62.90625 \n",
       "Q 36.140625 65.921875 28.71875 65.921875 \n",
       "Q 24.65625 65.921875 20.015625 65.03125 \n",
       "Q 15.375 64.15625 9.8125 62.3125 \n",
       "L 9.8125 71.09375 \n",
       "Q 15.4375 72.65625 20.34375 73.4375 \n",
       "Q 25.25 74.21875 29.59375 74.21875 \n",
       "Q 40.828125 74.21875 47.359375 69.109375 \n",
       "Q 53.90625 64.015625 53.90625 55.328125 \n",
       "Q 53.90625 49.265625 50.4375 45.09375 \n",
       "Q 46.96875 40.921875 40.578125 39.3125 \n",
       "z\n",
       "\" id=\"DejaVuSans-33\"/>\n",
       "      </defs>\n",
       "      <g transform=\"translate(59.953475 245.777813)scale(0.14 -0.14)\">\n",
       "       <use xlink:href=\"#DejaVuSans-2212\"/>\n",
       "       <use x=\"83.789062\" xlink:href=\"#DejaVuSans-33\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "    </g>\n",
       "    <g id=\"xtick_2\">\n",
       "     <g id=\"line2d_2\">\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"118.713983\" xlink:href=\"#m46d7f69e4d\" y=\"228.14\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"text_2\">\n",
       "      <!-- −2 -->\n",
       "      <defs>\n",
       "       <path d=\"M 19.1875 8.296875 \n",
       "L 53.609375 8.296875 \n",
       "L 53.609375 0 \n",
       "L 7.328125 0 \n",
       "L 7.328125 8.296875 \n",
       "Q 12.9375 14.109375 22.625 23.890625 \n",
       "Q 32.328125 33.6875 34.8125 36.53125 \n",
       "Q 39.546875 41.84375 41.421875 45.53125 \n",
       "Q 43.3125 49.21875 43.3125 52.78125 \n",
       "Q 43.3125 58.59375 39.234375 62.25 \n",
       "Q 35.15625 65.921875 28.609375 65.921875 \n",
       "Q 23.96875 65.921875 18.8125 64.3125 \n",
       "Q 13.671875 62.703125 7.8125 59.421875 \n",
       "L 7.8125 69.390625 \n",
       "Q 13.765625 71.78125 18.9375 73 \n",
       "Q 24.125 74.21875 28.421875 74.21875 \n",
       "Q 39.75 74.21875 46.484375 68.546875 \n",
       "Q 53.21875 62.890625 53.21875 53.421875 \n",
       "Q 53.21875 48.921875 51.53125 44.890625 \n",
       "Q 49.859375 40.875 45.40625 35.40625 \n",
       "Q 44.1875 33.984375 37.640625 27.21875 \n",
       "Q 31.109375 20.453125 19.1875 8.296875 \n",
       "z\n",
       "\" id=\"DejaVuSans-32\"/>\n",
       "      </defs>\n",
       "      <g transform=\"translate(108.394452 245.777813)scale(0.14 -0.14)\">\n",
       "       <use xlink:href=\"#DejaVuSans-2212\"/>\n",
       "       <use x=\"83.789062\" xlink:href=\"#DejaVuSans-32\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "    </g>\n",
       "    <g id=\"xtick_3\">\n",
       "     <g id=\"line2d_3\">\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"167.15496\" xlink:href=\"#m46d7f69e4d\" y=\"228.14\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"text_3\">\n",
       "      <!-- −1 -->\n",
       "      <defs>\n",
       "       <path d=\"M 12.40625 8.296875 \n",
       "L 28.515625 8.296875 \n",
       "L 28.515625 63.921875 \n",
       "L 10.984375 60.40625 \n",
       "L 10.984375 69.390625 \n",
       "L 28.421875 72.90625 \n",
       "L 38.28125 72.90625 \n",
       "L 38.28125 8.296875 \n",
       "L 54.390625 8.296875 \n",
       "L 54.390625 0 \n",
       "L 12.40625 0 \n",
       "z\n",
       "\" id=\"DejaVuSans-31\"/>\n",
       "      </defs>\n",
       "      <g transform=\"translate(156.835429 245.777813)scale(0.14 -0.14)\">\n",
       "       <use xlink:href=\"#DejaVuSans-2212\"/>\n",
       "       <use x=\"83.789062\" xlink:href=\"#DejaVuSans-31\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "    </g>\n",
       "    <g id=\"xtick_4\">\n",
       "     <g id=\"line2d_4\">\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"215.595938\" xlink:href=\"#m46d7f69e4d\" y=\"228.14\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"text_4\">\n",
       "      <!-- 0 -->\n",
       "      <defs>\n",
       "       <path d=\"M 31.78125 66.40625 \n",
       "Q 24.171875 66.40625 20.328125 58.90625 \n",
       "Q 16.5 51.421875 16.5 36.375 \n",
       "Q 16.5 21.390625 20.328125 13.890625 \n",
       "Q 24.171875 6.390625 31.78125 6.390625 \n",
       "Q 39.453125 6.390625 43.28125 13.890625 \n",
       "Q 47.125 21.390625 47.125 36.375 \n",
       "Q 47.125 51.421875 43.28125 58.90625 \n",
       "Q 39.453125 66.40625 31.78125 66.40625 \n",
       "z\n",
       "M 31.78125 74.21875 \n",
       "Q 44.046875 74.21875 50.515625 64.515625 \n",
       "Q 56.984375 54.828125 56.984375 36.375 \n",
       "Q 56.984375 17.96875 50.515625 8.265625 \n",
       "Q 44.046875 -1.421875 31.78125 -1.421875 \n",
       "Q 19.53125 -1.421875 13.0625 8.265625 \n",
       "Q 6.59375 17.96875 6.59375 36.375 \n",
       "Q 6.59375 54.828125 13.0625 64.515625 \n",
       "Q 19.53125 74.21875 31.78125 74.21875 \n",
       "z\n",
       "\" id=\"DejaVuSans-30\"/>\n",
       "      </defs>\n",
       "      <g transform=\"translate(211.142188 245.777813)scale(0.14 -0.14)\">\n",
       "       <use xlink:href=\"#DejaVuSans-30\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "    </g>\n",
       "    <g id=\"xtick_5\">\n",
       "     <g id=\"line2d_5\">\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"264.036915\" xlink:href=\"#m46d7f69e4d\" y=\"228.14\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"text_5\">\n",
       "      <!-- 1 -->\n",
       "      <g transform=\"translate(259.583165 245.777813)scale(0.14 -0.14)\">\n",
       "       <use xlink:href=\"#DejaVuSans-31\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "    </g>\n",
       "    <g id=\"xtick_6\">\n",
       "     <g id=\"line2d_6\">\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"312.477892\" xlink:href=\"#m46d7f69e4d\" y=\"228.14\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"text_6\">\n",
       "      <!-- 2 -->\n",
       "      <g transform=\"translate(308.024142 245.777813)scale(0.14 -0.14)\">\n",
       "       <use xlink:href=\"#DejaVuSans-32\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "    </g>\n",
       "    <g id=\"xtick_7\">\n",
       "     <g id=\"line2d_7\">\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"360.918869\" xlink:href=\"#m46d7f69e4d\" y=\"228.14\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"text_7\">\n",
       "      <!-- 3 -->\n",
       "      <g transform=\"translate(356.465119 245.777813)scale(0.14 -0.14)\">\n",
       "       <use xlink:href=\"#DejaVuSans-33\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "    </g>\n",
       "   </g>\n",
       "   <g id=\"matplotlib.axis_2\">\n",
       "    <g id=\"ytick_1\">\n",
       "     <g id=\"line2d_8\">\n",
       "      <defs>\n",
       "       <path d=\"M 0 0 \n",
       "L -3.5 0 \n",
       "\" id=\"mb36709f698\" style=\"stroke:#000000;stroke-width:0.8;\"/>\n",
       "      </defs>\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"48.195938\" xlink:href=\"#mb36709f698\" y=\"218.256364\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"text_8\">\n",
       "      <!-- −1.0 -->\n",
       "      <defs>\n",
       "       <path d=\"M 10.6875 12.40625 \n",
       "L 21 12.40625 \n",
       "L 21 0 \n",
       "L 10.6875 0 \n",
       "z\n",
       "\" id=\"DejaVuSans-2e\"/>\n",
       "      </defs>\n",
       "      <g transform=\"translate(7.2 223.57527)scale(0.14 -0.14)\">\n",
       "       <use xlink:href=\"#DejaVuSans-2212\"/>\n",
       "       <use x=\"83.789062\" xlink:href=\"#DejaVuSans-31\"/>\n",
       "       <use x=\"147.412109\" xlink:href=\"#DejaVuSans-2e\"/>\n",
       "       <use x=\"179.199219\" xlink:href=\"#DejaVuSans-30\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "    </g>\n",
       "    <g id=\"ytick_2\">\n",
       "     <g id=\"line2d_9\">\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"48.195938\" xlink:href=\"#mb36709f698\" y=\"168.837713\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"text_9\">\n",
       "      <!-- −0.5 -->\n",
       "      <defs>\n",
       "       <path d=\"M 10.796875 72.90625 \n",
       "L 49.515625 72.90625 \n",
       "L 49.515625 64.59375 \n",
       "L 19.828125 64.59375 \n",
       "L 19.828125 46.734375 \n",
       "Q 21.96875 47.46875 24.109375 47.828125 \n",
       "Q 26.265625 48.1875 28.421875 48.1875 \n",
       "Q 40.625 48.1875 47.75 41.5 \n",
       "Q 54.890625 34.8125 54.890625 23.390625 \n",
       "Q 54.890625 11.625 47.5625 5.09375 \n",
       "Q 40.234375 -1.421875 26.90625 -1.421875 \n",
       "Q 22.3125 -1.421875 17.546875 -0.640625 \n",
       "Q 12.796875 0.140625 7.71875 1.703125 \n",
       "L 7.71875 11.625 \n",
       "Q 12.109375 9.234375 16.796875 8.0625 \n",
       "Q 21.484375 6.890625 26.703125 6.890625 \n",
       "Q 35.15625 6.890625 40.078125 11.328125 \n",
       "Q 45.015625 15.765625 45.015625 23.390625 \n",
       "Q 45.015625 31 40.078125 35.4375 \n",
       "Q 35.15625 39.890625 26.703125 39.890625 \n",
       "Q 22.75 39.890625 18.8125 39.015625 \n",
       "Q 14.890625 38.140625 10.796875 36.28125 \n",
       "z\n",
       "\" id=\"DejaVuSans-35\"/>\n",
       "      </defs>\n",
       "      <g transform=\"translate(7.2 174.156619)scale(0.14 -0.14)\">\n",
       "       <use xlink:href=\"#DejaVuSans-2212\"/>\n",
       "       <use x=\"83.789062\" xlink:href=\"#DejaVuSans-30\"/>\n",
       "       <use x=\"147.412109\" xlink:href=\"#DejaVuSans-2e\"/>\n",
       "       <use x=\"179.199219\" xlink:href=\"#DejaVuSans-35\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "    </g>\n",
       "    <g id=\"ytick_3\">\n",
       "     <g id=\"line2d_10\">\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"48.195938\" xlink:href=\"#mb36709f698\" y=\"119.419062\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"text_10\">\n",
       "      <!-- 0.0 -->\n",
       "      <g transform=\"translate(18.931563 124.737969)scale(0.14 -0.14)\">\n",
       "       <use xlink:href=\"#DejaVuSans-30\"/>\n",
       "       <use x=\"63.623047\" xlink:href=\"#DejaVuSans-2e\"/>\n",
       "       <use x=\"95.410156\" xlink:href=\"#DejaVuSans-30\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "    </g>\n",
       "    <g id=\"ytick_4\">\n",
       "     <g id=\"line2d_11\">\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"48.195938\" xlink:href=\"#mb36709f698\" y=\"70.000412\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"text_11\">\n",
       "      <!-- 0.5 -->\n",
       "      <g transform=\"translate(18.931563 75.319318)scale(0.14 -0.14)\">\n",
       "       <use xlink:href=\"#DejaVuSans-30\"/>\n",
       "       <use x=\"63.623047\" xlink:href=\"#DejaVuSans-2e\"/>\n",
       "       <use x=\"95.410156\" xlink:href=\"#DejaVuSans-35\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "    </g>\n",
       "    <g id=\"ytick_5\">\n",
       "     <g id=\"line2d_12\">\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"48.195938\" xlink:href=\"#mb36709f698\" y=\"20.581761\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"text_12\">\n",
       "      <!-- 1.0 -->\n",
       "      <g transform=\"translate(18.931563 25.900667)scale(0.14 -0.14)\">\n",
       "       <use xlink:href=\"#DejaVuSans-31\"/>\n",
       "       <use x=\"63.623047\" xlink:href=\"#DejaVuSans-2e\"/>\n",
       "       <use x=\"95.410156\" xlink:href=\"#DejaVuSans-30\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "    </g>\n",
       "   </g>\n",
       "   <g id=\"line2d_13\">\n",
       "    <path clip-path=\"url(#p1487ba8e57)\" d=\"M 63.414119 218.256364 \n",
       "L 65.801285 218.136374 \n",
       "L 68.188451 217.776698 \n",
       "L 70.575617 217.178208 \n",
       "L 72.962782 216.342357 \n",
       "L 75.349948 215.271174 \n",
       "L 77.737114 213.967262 \n",
       "L 80.12428 212.433784 \n",
       "L 82.511446 210.674466 \n",
       "L 84.898611 208.693578 \n",
       "L 87.285777 206.49593 \n",
       "L 90.866526 202.804846 \n",
       "L 94.447274 198.658339 \n",
       "L 98.028023 194.079053 \n",
       "L 101.608772 189.092001 \n",
       "L 105.18952 183.724419 \n",
       "L 108.770269 178.005624 \n",
       "L 113.544601 169.888471 \n",
       "L 118.318932 161.281454 \n",
       "L 124.286847 149.961468 \n",
       "L 131.448344 135.781961 \n",
       "L 156.513585 85.42408 \n",
       "L 162.481499 74.276841 \n",
       "L 167.255831 65.843972 \n",
       "L 172.030162 57.931111 \n",
       "L 175.610911 52.384134 \n",
       "L 179.191659 47.203279 \n",
       "L 182.772408 42.416841 \n",
       "L 186.353157 38.050963 \n",
       "L 189.933905 34.129489 \n",
       "L 192.321071 31.772744 \n",
       "L 194.708237 29.628807 \n",
       "L 197.095403 27.702881 \n",
       "L 199.482569 25.999644 \n",
       "L 201.869734 24.52323 \n",
       "L 204.2569 23.277225 \n",
       "L 206.644066 22.264654 \n",
       "L 209.031232 21.487975 \n",
       "L 211.418397 20.949075 \n",
       "L 213.805563 20.649261 \n",
       "L 216.192729 20.589262 \n",
       "L 218.579895 20.769223 \n",
       "L 220.96706 21.188707 \n",
       "L 223.354226 21.846697 \n",
       "L 225.741392 22.741593 \n",
       "L 228.128558 23.871224 \n",
       "L 230.515724 25.232847 \n",
       "L 232.902889 26.823155 \n",
       "L 235.290055 28.638288 \n",
       "L 237.677221 30.673837 \n",
       "L 240.064387 32.924862 \n",
       "L 243.645135 36.693318 \n",
       "L 247.225884 40.913593 \n",
       "L 250.806633 45.562639 \n",
       "L 254.387381 50.615062 \n",
       "L 257.96813 56.043269 \n",
       "L 261.548879 61.817612 \n",
       "L 266.32321 70.000412 \n",
       "L 271.097542 78.662877 \n",
       "L 277.065456 90.037021 \n",
       "L 284.226954 104.258245 \n",
       "L 308.098611 152.268114 \n",
       "L 314.066526 163.474639 \n",
       "L 318.840857 171.966849 \n",
       "L 323.615189 179.949022 \n",
       "L 327.195938 185.554126 \n",
       "L 330.776686 190.798022 \n",
       "L 334.357435 195.652071 \n",
       "L 337.938183 200.089762 \n",
       "L 341.518932 204.086858 \n",
       "L 345.099681 207.621528 \n",
       "L 347.486847 209.71143 \n",
       "L 349.874012 211.582101 \n",
       "L 352.261178 213.228999 \n",
       "L 354.648344 214.648125 \n",
       "L 357.03551 215.836033 \n",
       "L 359.422675 216.789839 \n",
       "L 361.809841 217.507227 \n",
       "L 364.197007 217.986456 \n",
       "L 366.584173 218.226362 \n",
       "L 367.777756 218.256364 \n",
       "L 367.777756 218.256364 \n",
       "\" style=\"fill:none;stroke:#1f77b4;stroke-linecap:square;stroke-width:1.5;\"/>\n",
       "   </g>\n",
       "   <g id=\"line2d_14\">\n",
       "    <path clip-path=\"url(#p1487ba8e57)\" d=\"M 63.414119 119.419062 \n",
       "L 75.349948 143.526836 \n",
       "L 81.317863 155.123214 \n",
       "L 86.092194 164.018807 \n",
       "L 90.866526 172.481508 \n",
       "L 95.640857 180.429176 \n",
       "L 99.221606 186.005322 \n",
       "L 102.802355 191.217796 \n",
       "L 106.383103 196.038131 \n",
       "L 109.963852 200.439999 \n",
       "L 113.544601 204.399359 \n",
       "L 117.125349 207.894586 \n",
       "L 119.512515 209.957351 \n",
       "L 121.899681 211.800288 \n",
       "L 124.286847 213.418922 \n",
       "L 126.674012 214.809322 \n",
       "L 129.061178 215.968114 \n",
       "L 131.448344 216.892483 \n",
       "L 133.83551 217.580185 \n",
       "L 136.222675 218.02955 \n",
       "L 138.609841 218.239487 \n",
       "L 140.997007 218.209487 \n",
       "L 143.384173 217.939622 \n",
       "L 145.771339 217.430548 \n",
       "L 148.158504 216.6835 \n",
       "L 150.54567 215.700293 \n",
       "L 152.932836 214.483313 \n",
       "L 155.320002 213.035516 \n",
       "L 157.707167 211.360417 \n",
       "L 160.094333 209.462082 \n",
       "L 162.481499 207.345122 \n",
       "L 164.868665 205.014676 \n",
       "L 168.449413 201.131237 \n",
       "L 172.030162 196.801514 \n",
       "L 175.610911 192.049156 \n",
       "L 179.191659 186.900117 \n",
       "L 182.772408 181.382519 \n",
       "L 186.353157 175.526499 \n",
       "L 191.127488 167.247562 \n",
       "L 195.90182 158.504392 \n",
       "L 201.869734 147.052251 \n",
       "L 209.031232 132.7725 \n",
       "L 230.515724 89.45627 \n",
       "L 236.483638 78.10899 \n",
       "L 241.25797 69.474085 \n",
       "L 246.032301 61.323954 \n",
       "L 249.61305 55.577276 \n",
       "L 253.193798 50.179279 \n",
       "L 256.774547 45.159446 \n",
       "L 260.355296 40.545193 \n",
       "L 263.936044 36.361722 \n",
       "L 267.516793 32.631882 \n",
       "L 269.903959 30.407503 \n",
       "L 272.291125 28.399246 \n",
       "L 274.67829 26.611987 \n",
       "L 277.065456 25.050065 \n",
       "L 279.452622 23.717272 \n",
       "L 281.839788 22.616844 \n",
       "L 284.226954 21.751454 \n",
       "L 286.614119 21.123202 \n",
       "L 289.001285 20.733614 \n",
       "L 291.388451 20.583636 \n",
       "L 293.775617 20.673632 \n",
       "L 296.162782 21.003384 \n",
       "L 298.549948 21.57209 \n",
       "L 300.937114 22.37837 \n",
       "L 303.32428 23.420266 \n",
       "L 305.711446 24.69525 \n",
       "L 308.098611 26.200223 \n",
       "L 310.485777 27.931534 \n",
       "L 312.872943 29.884978 \n",
       "L 315.260109 32.055812 \n",
       "L 317.647274 34.438765 \n",
       "L 321.228023 38.398125 \n",
       "L 324.808772 42.799993 \n",
       "L 328.38952 47.620328 \n",
       "L 331.970269 52.832803 \n",
       "L 335.551018 58.408949 \n",
       "L 340.325349 66.356617 \n",
       "L 345.099681 74.819318 \n",
       "L 349.874012 83.714911 \n",
       "L 355.841927 95.311289 \n",
       "L 364.197007 112.119678 \n",
       "L 367.777756 119.419062 \n",
       "L 367.777756 119.419062 \n",
       "\" style=\"fill:none;stroke:#ff7f0e;stroke-linecap:square;stroke-width:1.5;\"/>\n",
       "   </g>\n",
       "   <g id=\"patch_3\">\n",
       "    <path d=\"M 48.195938 228.14 \n",
       "L 48.195938 10.7 \n",
       "\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\n",
       "   </g>\n",
       "   <g id=\"patch_4\">\n",
       "    <path d=\"M 382.995938 228.14 \n",
       "L 382.995938 10.7 \n",
       "\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\n",
       "   </g>\n",
       "   <g id=\"patch_5\">\n",
       "    <path d=\"M 48.195938 228.14 \n",
       "L 382.995938 228.14 \n",
       "\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\n",
       "   </g>\n",
       "   <g id=\"patch_6\">\n",
       "    <path d=\"M 48.195938 10.7 \n",
       "L 382.995938 10.7 \n",
       "\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\n",
       "   </g>\n",
       "   <g id=\"legend_1\">\n",
       "    <g id=\"patch_7\">\n",
       "     <path d=\"M 57.995938 62.99875 \n",
       "L 126.353125 62.99875 \n",
       "Q 129.153125 62.99875 129.153125 60.19875 \n",
       "L 129.153125 20.5 \n",
       "Q 129.153125 17.7 126.353125 17.7 \n",
       "L 57.995938 17.7 \n",
       "Q 55.195938 17.7 55.195938 20.5 \n",
       "L 55.195938 60.19875 \n",
       "Q 55.195938 62.99875 57.995938 62.99875 \n",
       "z\n",
       "\" style=\"fill:#ffffff;opacity:0.8;stroke:#cccccc;stroke-linejoin:miter;\"/>\n",
       "    </g>\n",
       "    <g id=\"line2d_15\">\n",
       "     <path d=\"M 60.795938 29.037813 \n",
       "L 88.795938 29.037813 \n",
       "\" style=\"fill:none;stroke:#1f77b4;stroke-linecap:square;stroke-width:1.5;\"/>\n",
       "    </g>\n",
       "    <g id=\"line2d_16\"/>\n",
       "    <g id=\"text_13\">\n",
       "     <!-- cos -->\n",
       "     <defs>\n",
       "      <path d=\"M 48.78125 52.59375 \n",
       "L 48.78125 44.1875 \n",
       "Q 44.96875 46.296875 41.140625 47.34375 \n",
       "Q 37.3125 48.390625 33.40625 48.390625 \n",
       "Q 24.65625 48.390625 19.8125 42.84375 \n",
       "Q 14.984375 37.3125 14.984375 27.296875 \n",
       "Q 14.984375 17.28125 19.8125 11.734375 \n",
       "Q 24.65625 6.203125 33.40625 6.203125 \n",
       "Q 37.3125 6.203125 41.140625 7.25 \n",
       "Q 44.96875 8.296875 48.78125 10.40625 \n",
       "L 48.78125 2.09375 \n",
       "Q 45.015625 0.34375 40.984375 -0.53125 \n",
       "Q 36.96875 -1.421875 32.421875 -1.421875 \n",
       "Q 20.0625 -1.421875 12.78125 6.34375 \n",
       "Q 5.515625 14.109375 5.515625 27.296875 \n",
       "Q 5.515625 40.671875 12.859375 48.328125 \n",
       "Q 20.21875 56 33.015625 56 \n",
       "Q 37.15625 56 41.109375 55.140625 \n",
       "Q 45.0625 54.296875 48.78125 52.59375 \n",
       "z\n",
       "\" id=\"DejaVuSans-63\"/>\n",
       "      <path d=\"M 30.609375 48.390625 \n",
       "Q 23.390625 48.390625 19.1875 42.75 \n",
       "Q 14.984375 37.109375 14.984375 27.296875 \n",
       "Q 14.984375 17.484375 19.15625 11.84375 \n",
       "Q 23.34375 6.203125 30.609375 6.203125 \n",
       "Q 37.796875 6.203125 41.984375 11.859375 \n",
       "Q 46.1875 17.53125 46.1875 27.296875 \n",
       "Q 46.1875 37.015625 41.984375 42.703125 \n",
       "Q 37.796875 48.390625 30.609375 48.390625 \n",
       "z\n",
       "M 30.609375 56 \n",
       "Q 42.328125 56 49.015625 48.375 \n",
       "Q 55.71875 40.765625 55.71875 27.296875 \n",
       "Q 55.71875 13.875 49.015625 6.21875 \n",
       "Q 42.328125 -1.421875 30.609375 -1.421875 \n",
       "Q 18.84375 -1.421875 12.171875 6.21875 \n",
       "Q 5.515625 13.875 5.515625 27.296875 \n",
       "Q 5.515625 40.765625 12.171875 48.375 \n",
       "Q 18.84375 56 30.609375 56 \n",
       "z\n",
       "\" id=\"DejaVuSans-6f\"/>\n",
       "      <path d=\"M 44.28125 53.078125 \n",
       "L 44.28125 44.578125 \n",
       "Q 40.484375 46.53125 36.375 47.5 \n",
       "Q 32.28125 48.484375 27.875 48.484375 \n",
       "Q 21.1875 48.484375 17.84375 46.4375 \n",
       "Q 14.5 44.390625 14.5 40.28125 \n",
       "Q 14.5 37.15625 16.890625 35.375 \n",
       "Q 19.28125 33.59375 26.515625 31.984375 \n",
       "L 29.59375 31.296875 \n",
       "Q 39.15625 29.25 43.1875 25.515625 \n",
       "Q 47.21875 21.78125 47.21875 15.09375 \n",
       "Q 47.21875 7.46875 41.1875 3.015625 \n",
       "Q 35.15625 -1.421875 24.609375 -1.421875 \n",
       "Q 20.21875 -1.421875 15.453125 -0.5625 \n",
       "Q 10.6875 0.296875 5.421875 2 \n",
       "L 5.421875 11.28125 \n",
       "Q 10.40625 8.6875 15.234375 7.390625 \n",
       "Q 20.0625 6.109375 24.8125 6.109375 \n",
       "Q 31.15625 6.109375 34.5625 8.28125 \n",
       "Q 37.984375 10.453125 37.984375 14.40625 \n",
       "Q 37.984375 18.0625 35.515625 20.015625 \n",
       "Q 33.0625 21.96875 24.703125 23.78125 \n",
       "L 21.578125 24.515625 \n",
       "Q 13.234375 26.265625 9.515625 29.90625 \n",
       "Q 5.8125 33.546875 5.8125 39.890625 \n",
       "Q 5.8125 47.609375 11.28125 51.796875 \n",
       "Q 16.75 56 26.8125 56 \n",
       "Q 31.78125 56 36.171875 55.265625 \n",
       "Q 40.578125 54.546875 44.28125 53.078125 \n",
       "z\n",
       "\" id=\"DejaVuSans-73\"/>\n",
       "     </defs>\n",
       "     <g transform=\"translate(99.995938 33.937813)scale(0.14 -0.14)\">\n",
       "      <use xlink:href=\"#DejaVuSans-63\"/>\n",
       "      <use x=\"54.980469\" xlink:href=\"#DejaVuSans-6f\"/>\n",
       "      <use x=\"116.162109\" xlink:href=\"#DejaVuSans-73\"/>\n",
       "     </g>\n",
       "    </g>\n",
       "    <g id=\"line2d_17\">\n",
       "     <path d=\"M 60.795938 49.587188 \n",
       "L 88.795938 49.587188 \n",
       "\" style=\"fill:none;stroke:#ff7f0e;stroke-linecap:square;stroke-width:1.5;\"/>\n",
       "    </g>\n",
       "    <g id=\"line2d_18\"/>\n",
       "    <g id=\"text_14\">\n",
       "     <!-- sin -->\n",
       "     <defs>\n",
       "      <path d=\"M 9.421875 54.6875 \n",
       "L 18.40625 54.6875 \n",
       "L 18.40625 0 \n",
       "L 9.421875 0 \n",
       "z\n",
       "M 9.421875 75.984375 \n",
       "L 18.40625 75.984375 \n",
       "L 18.40625 64.59375 \n",
       "L 9.421875 64.59375 \n",
       "z\n",
       "\" id=\"DejaVuSans-69\"/>\n",
       "      <path d=\"M 54.890625 33.015625 \n",
       "L 54.890625 0 \n",
       "L 45.90625 0 \n",
       "L 45.90625 32.71875 \n",
       "Q 45.90625 40.484375 42.875 44.328125 \n",
       "Q 39.84375 48.1875 33.796875 48.1875 \n",
       "Q 26.515625 48.1875 22.3125 43.546875 \n",
       "Q 18.109375 38.921875 18.109375 30.90625 \n",
       "L 18.109375 0 \n",
       "L 9.078125 0 \n",
       "L 9.078125 54.6875 \n",
       "L 18.109375 54.6875 \n",
       "L 18.109375 46.1875 \n",
       "Q 21.34375 51.125 25.703125 53.5625 \n",
       "Q 30.078125 56 35.796875 56 \n",
       "Q 45.21875 56 50.046875 50.171875 \n",
       "Q 54.890625 44.34375 54.890625 33.015625 \n",
       "z\n",
       "\" id=\"DejaVuSans-6e\"/>\n",
       "     </defs>\n",
       "     <g transform=\"translate(99.995938 54.487188)scale(0.14 -0.14)\">\n",
       "      <use xlink:href=\"#DejaVuSans-73\"/>\n",
       "      <use x=\"52.099609\" xlink:href=\"#DejaVuSans-69\"/>\n",
       "      <use x=\"79.882812\" xlink:href=\"#DejaVuSans-6e\"/>\n",
       "     </g>\n",
       "    </g>\n",
       "   </g>\n",
       "  </g>\n",
       " </g>\n",
       " <defs>\n",
       "  <clipPath id=\"p1487ba8e57\">\n",
       "   <rect height=\"217.44\" width=\"334.8\" x=\"48.195938\" y=\"10.7\"/>\n",
       "  </clipPath>\n",
       " </defs>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<matplotlib.figure.Figure at 0x7f0763e5f160>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# First, import pandas, numpy and matplotlib\n",
    "import pandas as pd\n",
    "from pandas import Series, DataFrame\n",
    "import numpy as np\n",
    "import matplotlib.pyplot as plt\n",
    "%config InlineBackend.figure_format = 'svg'   # helps make things look better in Jupyter :-)\n",
    "\n",
    "# now define a sine and cosine curve\n",
    "X = np.linspace(-np.pi, np.pi, 256, endpoint=True)\n",
    "data = {'cos': np.cos(X), 'sin': np.sin(X)}\n",
    "trig = DataFrame(index=X, data=data)\n",
    "\n",
    "trig.plot()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Later on we will go through pandas, matplotlib and numpy and you will learn how to draw lots of different and interesting graphs."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Mixing documentation and code\n",
    "\n",
    "In addition to interactivity, the real benefit of a Jupyter notebook is that it encourages you to include lots of documentation with your code. In effect, a notebook is a combination of code, documentation, and (once it has been run) analysis and data.\n",
    "\n",
    "You can create documentation by changing the type of a cell. The type of a cell is indicated in the drop-down at the top, under the menu. If you click on the graph above, you will see that the type of a code cell is \"Code\".\n",
    "\n",
    "![Image showing code type](images/jupyter_type_code.jpeg)\n",
    "\n",
    "If you now click on this documentation, you should see the cell type change to \"Markdown\"\n",
    "\n",
    "![Image showing markdown type](images/jupyter_type_markdown.jpeg)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Creating your own cells\n",
    "\n",
    "You can create your own cells in two different ways;\n",
    "\n",
    "* either by pressing SHIFT+Return on the last cell (which creates a new cell at the bottom of the notebook),\n",
    "* or by clicking \"Insert | Cell Above\" or \"Insert | Cell Below\" from the menu to insert a new cell above or below the currently selected cell.\n",
    "\n",
    "You can choose whether this should be a code or documentation (markdown) cell by selecting the appropriate value from the drop-down at the top.\n",
    "\n",
    "Code cells can contain any valid Python. Documentation (markdown) cells can contain any text. The text can be formatted, using the [markdown](https://github.com/adam-p/markdown-here/wiki/Markdown-Cheatsheet) standard.\n",
    "\n",
    "Have a go by creating some new documentation and code cells below. If you want some inspiration for documentation, take a look at the documentation cells above by double-clicking on them. You should see how I have inserted images, lists, headings etc.\n",
    "\n",
    "You can then render the documentation using SHIFT+Return (just like running a code cell)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [],
   "source": [
    "a = 10\n",
    "b = 32"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "The answer to life, the universe and everything is 42\n"
     ]
    }
   ],
   "source": [
    "print(\"The answer to life, the universe and everything is %d\" % (a+b))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Controlling the Python kernel\n",
    "\n",
    "The Python process that is interpreting and executing your Python code is referred to as the \"kernel\" of the notebook (hence the \"Kernel\" menu above). When you execute a code cell it sends the code to the Python kernel, and then waits for the kernel to send a result back. The Python kernel can only execute one thing at a time. This means that, for slow functions, you could be executing cells too quickly and leave the Python kernel behind.\n",
    "\n",
    "For example, here is a function that fakes a slow function as it goes to sleep for the specified number of seconds."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [],
   "source": [
    "def sleep(n):\n",
    "    import os\n",
    "    os.system(\"sleep %d\" % n)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Below we will have three code cells that each sleep for a long time. Execute all three quickly one after another..."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [],
   "source": [
    "sleep(30)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [],
   "source": [
    "sleep(30)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {},
   "outputs": [],
   "source": [
    "sleep(30)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "You should see that there is a [*] next to each code cell. This is because they are all waiting for the Python kernel to finish executing and return.\n",
    "\n",
    "![Jupyter is sleeping](images/jupyter_sleep.jpeg)\n",
    "\n",
    "If you wait you will see each sleep finishing and control then passing to the next.\n",
    "\n",
    "Sometimes you don't want to be patient, and you want to stop the Python kernel from running a function. To stop (interupt) the kernel, either click the \"Stop\" icon at the top of the screen, or select \"Kernel | Interupt\" from the menu.\n",
    "\n",
    "![Jupyter stop button](images/jupyter_stop.jpeg)\n",
    "\n",
    "Other useful buttons up there are \"restart the kernel\" (same as the menu Kernel | Restart & Clear Output) and the arrows that can move the selected cell up and down the notebook.\n",
    "\n",
    "Have a play. Explore the buttons and menu items. Take a look at the \"Help\" in the menu. Remember that, if everything goes wrong, you can always click \"Stop\" or select \"Kernel | Restart & Clear Output\" from the menu."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Running external programs in a code cell\n",
    "\n",
    "You can do more than just execute Python in the code cells. You can run *any command* you want! Just put an exclamation mark first, and then type the command normally as you would in a terminal. For example, the below cell is running `ls`"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "01_jupyter_howto.ipynb\t      09_exceptions.ipynb\t    data\r\n",
      "02_lists.ipynb\t\t      10_error_handling.ipynb\t    images\r\n",
      "03_dictionaries.ipynb\t      11_modules.ipynb\t\t    morse.py\r\n",
      "04_functions.ipynb\t      12_pandas.ipynb\t\t    __pycache__\r\n",
      "05_objects.ipynb\t      13_basic_numpy.ipynb\t    superhero2.py\r\n",
      "06_classes.ipynb\t      14_more_numpy.ipynb\t    superhero.py\r\n",
      "07_documentation.ipynb\t      15_matplotlib.ipynb\r\n",
      "08_class_documentation.ipynb  17_regular_expressions.ipynb\r\n"
     ]
    }
   ],
   "source": [
    "! ls"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "You can run any command that you want, exactly as you would typing in a terminal. For example, lets use `cat` to read the LICENSE file..."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "MIT License\r\n",
      "\r\n",
      "Copyright (c) 2018 Matt Williams, Lester Hedges, Christopher Woods\r\n",
      "\r\n",
      "Permission is hereby granted, free of charge, to any person obtaining a copy\r\n",
      "of this software and associated documentation files (the \"Software\"), to deal\r\n",
      "in the Software without restriction, including without limitation the rights\r\n",
      "to use, copy, modify, merge, publish, distribute, sublicense, and/or sell\r\n",
      "copies of the Software, and to permit persons to whom the Software is\r\n",
      "furnished to do so, subject to the following conditions:\r\n",
      "\r\n",
      "The above copyright notice and this permission notice shall be included in all\r\n",
      "copies or substantial portions of the Software.\r\n",
      "\r\n",
      "THE SOFTWARE IS PROVIDED \"AS IS\", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR\r\n",
      "IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,\r\n",
      "FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE\r\n",
      "AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER\r\n",
      "LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,\r\n",
      "OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE\r\n",
      "SOFTWARE.\r\n"
     ]
    }
   ],
   "source": [
    "! cat LICENSE"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "You can work with directories as well. For example, here we will copy the `dioxin.pdb` file from `data` into the current directory and will then view it using viewMolecules..."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {},
   "outputs": [],
   "source": [
    "! cp data/dioxin.pdb ./"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Reading molecules from '['dioxin.pdb']'\n",
      "Rendering the molecules...\n"
     ]
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "6f4988dd79c04f4aace8a49516e4f333",
       "version_major": 2,
       "version_minor": 0
      },
      "text/html": [
       "<p>Failed to display Jupyter Widget of type <code>NGLWidget</code>.</p>\n",
       "<p>\n",
       "  If you're reading this message in the Jupyter Notebook or JupyterLab Notebook, it may mean\n",
       "  that the widgets JavaScript is still loading. If this message persists, it\n",
       "  likely means that the widgets JavaScript library is either not installed or\n",
       "  not enabled. See the <a href=\"https://ipywidgets.readthedocs.io/en/stable/user_install.html\">Jupyter\n",
       "  Widgets Documentation</a> for setup instructions.\n",
       "</p>\n",
       "<p>\n",
       "  If you're reading this message in another frontend (for example, a static\n",
       "  rendering on GitHub or <a href=\"https://nbviewer.jupyter.org/\">NBViewer</a>),\n",
       "  it may mean that your frontend doesn't currently support widgets.\n",
       "</p>\n"
      ],
      "text/plain": [
       "NGLWidget()"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "45a61f22196c4fbcadaca31f50b04243",
       "version_major": 2,
       "version_minor": 0
      },
      "text/html": [
       "<p>Failed to display Jupyter Widget of type <code>Tab</code>.</p>\n",
       "<p>\n",
       "  If you're reading this message in the Jupyter Notebook or JupyterLab Notebook, it may mean\n",
       "  that the widgets JavaScript is still loading. If this message persists, it\n",
       "  likely means that the widgets JavaScript library is either not installed or\n",
       "  not enabled. See the <a href=\"https://ipywidgets.readthedocs.io/en/stable/user_install.html\">Jupyter\n",
       "  Widgets Documentation</a> for setup instructions.\n",
       "</p>\n",
       "<p>\n",
       "  If you're reading this message in another frontend (for example, a static\n",
       "  rendering on GitHub or <a href=\"https://nbviewer.jupyter.org/\">NBViewer</a>),\n",
       "  it may mean that your frontend doesn't currently support widgets.\n",
       "</p>\n"
      ],
      "text/plain": [
       "Tab(children=(Box(children=(Box(children=(Box(children=(Label(value='step'), IntSlider(value=1, min=-100)), layout=Layout(display='flex', flex_flow='row', justify_content='space-between')), Box(children=(Label(value='delay'), IntSlider(value=100, max=1000, min=10)), layout=Layout(display='flex', flex_flow='row', justify_content='space-between')), Box(children=(Label(value='background'), ColorPicker(value='white')), layout=Layout(display='flex', flex_flow='row', justify_content='space-between')), Box(children=(Label(value='camera'), Dropdown(options=('perspective', 'orthographic'), value='perspective')), layout=Layout(display='flex', flex_flow='row', justify_content='space-between')), Box(children=(Label(value=''), HBox(children=(ToggleButton(value=False, description='Smoothing', tooltip='smoothing trajectory'), Button(description=' Center', icon='bullseye', style=ButtonStyle()), Button(description=' Screenshot', icon='camera', style=ButtonStyle()), Button(description='qtconsole', style=ButtonStyle(), tooltip='pop up qtconsole')), layout=Layout(flex='1 1 auto', width='auto'))), layout=Layout(display='flex', flex_flow='row', justify_content='space-between'))), layout=Layout(align_items='stretch', display='flex', flex_flow='column', width='100%')),)), Box(), Box(), Box(), Box(), Box()), layout=Layout(align_items='stretch', align_self='center'), _titles={'4': 'Extra', '2': 'Preference', '3': 'Theme', '1': 'Representation', '0': 'General', '5': 'Help'})"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/plain": [
       "<BioSimSpace.Notebook.view.View at 0x7f07313dfd68>"
      ]
     },
     "execution_count": 25,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from BioSimSpace import viewMolecules  # importing again in case we restarted the kernel\n",
    "viewMolecules(\"dioxin.pdb\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Saving the notebook\n",
    "\n",
    "At the top of the screen is the name of the notebook, and its current save state.\n",
    "\n",
    "![Jupyter file info](images/jupyter_files.jpeg)\n",
    "\n",
    "The current save state tells you when the last checkpoint was saved, and whether or not the notebook contains any unsaved changes. Checkpoints provide points in the notebook that you can refer back to, using the menu item \"File | Revert to Checkpoint\". You are always able to revert to the last checkpoint, meaning that if you make a mistake, you can go back to a previous safe version.\n",
    "\n",
    "If you click \"File | Save and Checkpoint\", or click the \"Save\" icon (floppy disk icon on the far left), then the current state of the notebook will be saved. This includes not just the code and documentation you have written, but also all of the outputs and graphs that you have created. This is really useful, as it lets you save your work, and then come back later.\n",
    "\n",
    "For example, what don't you save now, and then close this window and then open the notebook again? You should see that everything you have done, and everything that was output is restored. Did it work?\n",
    "\n",
    "The notebook was saved to a file called `01_jupyter_howto.ipynb`. The `.ipynb` signifies that the file is a Jupyter notebook (formerly called an interactive python notebook). You can change the name by clicking on the name of the notebook above, and then choosing a different name in the window that opens.\n",
    "\n",
    "Alternatively, you can save a copy of this notebook under a different name by clicking \"File | Make a Copy...\" in the menu. You can then copy this file or send it to someone else. As a notebook contains the code, data, outputs and analysis, sharing notebooks is the closest thing we have to interactive papers. This is a really powerful concept and, I believe, will fundementally change how we report and share the results of computational and data analysis in science."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# The Jupyter Hub\n",
    "\n",
    "When you first logged into this website you launched this notebook by clicking on its name in the Jupyter Hub. This was the page that looked like a file browser and that (hopefully) is still open in one of the tabs in your browser. The Jupyter Hub is not just a file brower. It is the gateway to do a lot more than just interact with a single notebook.\n",
    "\n",
    "The first thing to note is that this Jupyter Hub is running on the cloud and consumes resources. It is important that you click \"Logout\" (top right) when you have finished, as this will free up the hub to be used by someone else. There is a timer that will automatically log you out 40 minutes after your web browser is closed. However, please remember to log out if you can.\n",
    "\n",
    "![Jupyter hub](images/jupyter_hub.jpeg)\n",
    "\n",
    "The main view of the hub is the file browser that shows all of your files. You can navigate through the files and directories like any normal file browser. For example, you can see above the `01_jupyter_howto.ipynb` file that contains this notebook. You should see that the file has a green icon next to it, as well as a `Running` indicator on the right. This indicates that the notebook is currently running.\n",
    "\n",
    "Running notebooks consume cloud resources, which are limited. You can only have 1.8 GB of data in memory and have limited CPU. You should thus shutdown any running notebooks that you aren't using any more. To do this, click the checkbox to the left of the notebook filename. This will bring up some buttons at the top of the screen. Click the \"Shutdown\" button to shut down the notebook.\n",
    "\n",
    "![Shutdown running kernels](images/jupyter_shutdown.jpeg)\n",
    "\n",
    "Alternatively, you can go to the \"Running\" tab to see everything of your's that is currently running in the hub. Click the \"Shutdown\" button on the right for anything that you aren't using and want to shut down.\n",
    "\n",
    "![Running tab](images/jupyter_running.jpeg)\n",
    "\n",
    "Back in the \"Files\" tab, clicking the checkbox next to a file brings up buttons that let you download files. You can use the hub to download files by selecting them and clicking the \"Download\" button that will appear. Other buttons will appear depending on the type of file, e.g. \"Duplicate\", \"View\", \"Edit\" etc. The bin icon will delete the file.\n",
    "\n",
    "![Download a file](images/jupyter_download.jpeg)\n",
    "\n",
    "You can create new notebooks or files by clicking on the \"New\" button on the right. This will open a drop-down menu for you to select the type of thing to create.\n",
    "\n",
    "![New dropdown](images/jupyter_new.jpeg)\n",
    "\n",
    "As well as letting you create a new jupyter notebook (by clicking \"New | Python3\"), you can also create new text files (\"New | Text File\") or new folders (\"New | Folder\"). Most interestingly, is that you can also create a new bash terminal. If you click \"New | Terminal\" it will open a new tab in which you will have a fully functional bash terminal shell. This is running on the same cloud server as your notebook. It is 100% completely a fully functional terminal within your web browser. You could even use it to run the normal command-line python ;-)\n",
    "\n",
    "![Bash in the browser](images/jupyter_shell.jpeg)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The cloud server on which this is running comes with lots of useful software that you can run from within the bash shell. For example you have;\n",
    "\n",
    "* `update_workshops` : This command will update all of the software and workshop material to the latest version. Useful if you delete anything by accident or the tutor needs to make a last-minute fix\n",
    "* `git` : Git is installed. The workshop material is downloaded and updated from git repositories, e.g. https://github.com/ccpbiosim/python_and_data. You could also use git to push things back to the cloud, e.g. if you want to download lots of files.\n",
    "* `anaconda python3` : A full anaconda python3 is installed, with pandas, matplotlib, numpy etc. etc.\n",
    "* `wget` : This tool lets you quickly download (or should that be sideload?) files onto the cloud server\n",
    "* `top` : Process monitor. You can use this to see which processes are consuming lots of resources. Any process that uses more than 1.8 GB of memory will automatically be killed by the cloud server. You can kill them yourself using the `kill` command.\n",
    "* `tar` and `bzip2` : useful for packing/unpacking and compressing/uncompressing files\n",
    "* `AmberTools` : The full [AmberTools](http://ambermd.org/AmberTools.php) suite is installed in directory `$AMBERHOME`\n",
    "* `ProtoMS` : The full [ProtoMS](http://protoms.org) package is installed in directory `$PROTOMSHOME`\n",
    "* `wham` and `wham-2d` : Tools used for weighted histogram analysis\n",
    "* `Sire` and `BioSimSpace` : The [Sire](https://siremol.org) and [BioSimSpace](https://biosimspace.org) python simulation framework and workflow node packages.\n",
    "\n",
    "The cloud server was build with docker. If you want to download it yourself to run on your own computer at home after the workshop then please install docker and type\n",
    "\n",
    "```\n",
    "docker run -it --rm -p 8888:8888 chryswoods/bss-workshop:latest\n",
    "```\n",
    "\n",
    "This will download and run the image from dockerhub and will make it available at the web address that will be printed to the screen (e.g. it will look something like `http://localhost:8888/?token=641396480e6421eae8b18261d82a75f958fe166e1c8b20a8`). Simply open that address in your browser :-). You can see and download the DockerFile used to generate this image [from here](https://github.com/michellab/BioSimSpaceWebsite/tree/master/docker/bss-workshop).\n",
    "\n",
    "Thanks to the [Microsoft Azure Kubernetes Service](https://docs.microsoft.com/en-us/azure/aks/) on which this Jupyter image is running."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.5.2"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}