p4sec_p4dpdk_pcap.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "id": "4a1498e2-8abe-4ae2-99ee-46b19879d4cd",
   "metadata": {
    "jp-MarkdownHeadingCollapsed": true,
    "tags": []
   },
   "source": [
    "# Creating a network with a SmartNIC\n",
    "\n",
    "This Jupyter notebook will walk you through creating an experiment that contains a SmartNIC. The SmartNIC is Connectx-6, from NVIDIA (Mellanox). Specifically, the experiment deploys a slice with two nodes: one server with a SmartNIC connected to another server with a basic NIC.\n",
    "\n",
    "\n",
    "# Step 1:  Configure the Environment\n",
    "\n",
    "Before running this notebook, you will need to configure your environment using the [Configure Environment](./prepare_env.ipynb) notebook. Please stop here, open and run that notebook, then return to this notebook.\n",
    "\n",
    "If you are using the FABRIC JupyterHub many of the environment variables will be automatically configured for you.  You will still need to set your bastion username, upload your bastion private key, and set the path to where you put your bastion private key. Your bastion username and private key should already be in your possession.  \n",
    "\n",
    "If you are using the FABRIC API outside of the JupyterHub you will need to configure all of the environment variables. Defaults below will be correct in many situations but you will need to confirm your configuration.  If you have questions about this configuration, please contact the FABRIC admins using the [FABRIC User Forum](https://learn.fabric-testbed.net/forums/) \n",
    "\n",
    "More information about accessing your experiments through the FABRIC bastion hosts can be found [here](https://learn.fabric-testbed.net/knowledge-base/logging-into-fabric-vms/).\n",
    " "
   ]
  },
  {
   "cell_type": "markdown",
   "id": "863cac3b-937d-47fb-9c0b-58af33e5b545",
   "metadata": {
    "jp-MarkdownHeadingCollapsed": true,
    "tags": []
   },
   "source": [
    "# Step 2: Import the FABlib Library"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "id": "6aa85e85-eaf8-48ac-bb82-a1332380513f",
   "metadata": {},
   "outputs": [],
   "source": [
    "from fabrictestbed_extensions.fablib.fablib import FablibManager as fablib_manager\n",
    "fablib = fablib_manager()"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "abbd4d0b-dd3c-4bb8-a773-5f2c7d0de215",
   "metadata": {
    "jp-MarkdownHeadingCollapsed": true,
    "tags": []
   },
   "source": [
    "# Step 3: Create the Experiment Slice\n",
    "\n",
    "The following creates three node with basic compute and networking capabilities. You build a slice by creating a new slice and adding resources to the slice. After you build the slice, you must submit a request for the slice to be instantiated.   "
   ]
  },
  {
   "cell_type": "markdown",
   "id": "1ac2a84f-0eae-4942-a93f-c292e2be32f6",
   "metadata": {
    "tags": []
   },
   "source": [
    "### Step 3.1: Create a slice\n",
    "The code below creates a new slice"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "id": "825b0a05-4b69-4df1-abc8-29f91ca62b08",
   "metadata": {
    "tags": []
   },
   "outputs": [],
   "source": [
    "slice = fablib.new_slice(name=\"p4sec_fabric_samesite_pcap1\")\n",
    "#slice = fablib.get_slice(name=\"smartnic222\")"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "88b7fa0f-14aa-49f1-bc63-9e143560cecf",
   "metadata": {
    "tags": []
   },
   "source": [
    "### Step 3.2: Define the sites\n",
    "The code below requests three sites from FABRIC: MICH, STAR, and NCSA"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "599fb388-d8d5-4b5e-9703-a7425096f1c4",
   "metadata": {},
   "source": [
    "<img src=\"./figs/fabric_sites.png\" width=\"40%\"><br>"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "id": "f94710b2-a57f-4c7e-9031-f82df3592fb5",
   "metadata": {
    "tags": []
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "The selected sites are SEAT, SEAT, SEAT\n"
     ]
    }
   ],
   "source": [
    "# site1='FIU'\n",
    "# site2='FIU'\n",
    "\n",
    "cx5_column_name = 'nic_connectx_6_available'\n",
    "\n",
    "# find two sites with available ConnectX-5 \n",
    "# sites = fablib.get_random_sites(count=1, filter_function=lambda x: x[cx5_column_name] > 2)\n",
    "\n",
    "#site1 = sites[0]\n",
    "#site2 = sites[0]\n",
    "\n",
    "site = 'SEAT'\n",
    "site1= site\n",
    "site2= site\n",
    "site3= site\n",
    "\n",
    "\n",
    "print (f'The selected sites are {site1}, {site2}, {site3}') "
   ]
  },
  {
   "cell_type": "markdown",
   "id": "7a51f3ef-1db9-4eb5-95e0-73c580edec32",
   "metadata": {
    "tags": []
   },
   "source": [
    "### Step 3.3: Creating the nodes\n",
    "The code below creates three nodes: server1, switch, and server2. The servers (server1 and server2) use the following\n",
    "<ul>\n",
    "    <li> 4 CPU cores</li>\n",
    "    <li> 8GB RAM </li>\n",
    "    <li> 20GB disc size </li>\n",
    "    <li> Image: Ubuntu 20.04\n",
    "</ul>\n",
    "\n",
    "server1 will be created in site1 and server3 will be created in site3\n",
    "\n",
    "<img src=\"./figs/creating_nodes.PNG\" width=\"40%\"><br>"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "id": "f8256615-eb4b-429b-98ca-2fda276ca50d",
   "metadata": {
    "tags": []
   },
   "outputs": [],
   "source": [
    "server1 = slice.add_node(name=\"server1\", \n",
    "                      site=site1, \n",
    "                      cores=24, \n",
    "                      ram=8, \n",
    "                      disk=20, \n",
    "                      image='default_ubuntu_20')\n",
    "\n",
    "server2 = slice.add_node(name=\"server2\", \n",
    "                      site=site2, \n",
    "                      cores=24, \n",
    "                      ram=8, \n",
    "                      disk=20, \n",
    "                      image='default_ubuntu_20')\n",
    "server3 = slice.add_node(name=\"server3\", \n",
    "                      site=site3, \n",
    "                      cores=24, \n",
    "                      ram=8, \n",
    "                      disk=20, \n",
    "                      image='default_ubuntu_20')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "8c5b106a-df0e-4a10-b870-c7b8143c727f",
   "metadata": {
    "tags": []
   },
   "source": [
    "### Step 3.4: Adding the interfaces to the servers\n",
    "The code below adds a Network Interface Card (NIC) to each server.\n",
    "\n",
    "<img src=\"./figs/adding_nics.PNG\" width=\"40%\"><br>"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "id": "b6bbc9ac-d4de-41ac-9780-29896904054a",
   "metadata": {
    "tags": []
   },
   "outputs": [],
   "source": [
    "server1_iface = server1.add_component(model='NIC_ConnectX_6', name='nic').get_interfaces()[0]\n",
    "server21_iface = server2.add_component(model='NIC_ConnectX_6', name='nic2').get_interfaces()[0]\n",
    "server23_iface = server2.get_component(name='nic2').get_interfaces()[1]\n",
    "server3_iface = server3.add_component(model='NIC_ConnectX_6', name='nic3').get_interfaces()[0]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "id": "b1a24f38-ca96-4a0e-82ab-efa4b08ffcc3",
   "metadata": {},
   "outputs": [],
   "source": [
    "# print(server2.get_component(name='nic2').get_interfaces()[0])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "id": "fe916356-c83f-419b-89c5-4ebcbff65384",
   "metadata": {},
   "outputs": [],
   "source": [
    "# print(server2.get_component(name='nic2').get_interfaces()[1])"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "01d90c97-a26b-4708-ac1e-76336723cc0e",
   "metadata": {},
   "source": [
    "### Step 3.5: Connecting site1 and site2 and site3\n",
    "Create a site-to-site network between site1 and site2 connecting server1 and the P4 switch\n",
    "\n",
    "<img src=\"./figs/connecting_nodes_server1_switch.PNG\" width=\"40%\"><br>"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "id": "10390967-4806-48a9-96b9-e1b0a8294eee",
   "metadata": {},
   "outputs": [],
   "source": [
    "net1 = slice.add_l2network(name='net1', interfaces=[server1_iface, server21_iface])\n",
    "net2 = slice.add_l2network(name='net2', interfaces=[server23_iface, server3_iface])"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "6d14ab1a-9a09-4f5b-966e-2f9699d9017b",
   "metadata": {},
   "source": [
    "### Step 3.6: Submitting the slice\n",
    "The code below submits the slice. \n",
    "By default, the submit function will block until the node is ready and will display the progress of your slice being built."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "id": "5eeae3da-f74c-4218-b43b-f9f8ba54c644",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n",
      "Retry: 11, Time: 354 sec\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<style type=\"text/css\">\n",
       "#T_b4062 tr:nth-child(even) {\n",
       "  background: #dbf3ff;\n",
       "  color: #231f20;\n",
       "}\n",
       "#T_b4062 tr:nth-child(odd) {\n",
       "  background: #ffffff;\n",
       "  color: #231f20;\n",
       "}\n",
       "#T_b4062 caption {\n",
       "  text-align: center;\n",
       "  font-size: 150%;\n",
       "}\n",
       "#T_b4062_row0_col0, #T_b4062_row0_col1, #T_b4062_row1_col0, #T_b4062_row1_col1, #T_b4062_row2_col0, #T_b4062_row2_col1, #T_b4062_row3_col0, #T_b4062_row3_col1, #T_b4062_row4_col0, #T_b4062_row4_col1, #T_b4062_row5_col0 {\n",
       "  text-align: left;\n",
       "  border: 1px #231f20 solid !important;\n",
       "  overwrite: False;\n",
       "  background-color: ;\n",
       "}\n",
       "#T_b4062_row5_col1 {\n",
       "  text-align: left;\n",
       "  border: 1px #231f20 solid !important;\n",
       "  overwrite: False;\n",
       "  background-color: #c3ffc4;\n",
       "}\n",
       "</style>\n",
       "<table id=\"T_b4062\">\n",
       "  <caption>Slice</caption>\n",
       "  <thead>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td id=\"T_b4062_row0_col0\" class=\"data row0 col0\" >ID</td>\n",
       "      <td id=\"T_b4062_row0_col1\" class=\"data row0 col1\" >038c3f71-9b7f-4fa9-b6eb-468d96b96808</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td id=\"T_b4062_row1_col0\" class=\"data row1 col0\" >Name</td>\n",
       "      <td id=\"T_b4062_row1_col1\" class=\"data row1 col1\" >p4sec_fabric_samesite_pcap1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td id=\"T_b4062_row2_col0\" class=\"data row2 col0\" >Lease Expiration (UTC)</td>\n",
       "      <td id=\"T_b4062_row2_col1\" class=\"data row2 col1\" >2024-04-09 18:01:26 +0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td id=\"T_b4062_row3_col0\" class=\"data row3 col0\" >Lease Start (UTC)</td>\n",
       "      <td id=\"T_b4062_row3_col1\" class=\"data row3 col1\" >2024-04-08 18:01:27 +0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td id=\"T_b4062_row4_col0\" class=\"data row4 col0\" >Project ID</td>\n",
       "      <td id=\"T_b4062_row4_col1\" class=\"data row4 col1\" >8eaa3ec2-65e7-49a3-8c09-e1761141a6ad</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td id=\"T_b4062_row5_col0\" class=\"data row5 col0\" >State</td>\n",
       "      <td id=\"T_b4062_row5_col1\" class=\"data row5 col1\" >StableOK</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n"
      ],
      "text/plain": [
       "<pandas.io.formats.style.Styler at 0x7fcbfc610550>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<style type=\"text/css\">\n",
       "#T_2f034 caption {\n",
       "  text-align: center;\n",
       "  font-size: 150%;\n",
       "  caption-side: top;\n",
       "}\n",
       "#T_2f034 th {\n",
       "  text-align: left;\n",
       "}\n",
       "#T_2f034 tr:nth-child(even) {\n",
       "  background: #ffffff;\n",
       "  color: #231f20;\n",
       "}\n",
       "#T_2f034 tr:nth-child(odd) {\n",
       "  background: #dbf3ff;\n",
       "  color: #231f20;\n",
       "}\n",
       "#T_2f034 .level0 {\n",
       "  border: 1px black solid !important;\n",
       "  background: #ffffff;\n",
       "  color: #231f20;\n",
       "}\n",
       "#T_2f034_row0_col0, #T_2f034_row0_col1, #T_2f034_row0_col2, #T_2f034_row0_col3, #T_2f034_row0_col4, #T_2f034_row0_col5, #T_2f034_row0_col6, #T_2f034_row0_col7, #T_2f034_row0_col8, #T_2f034_row0_col9, #T_2f034_row0_col10, #T_2f034_row0_col13, #T_2f034_row0_col14, #T_2f034_row0_col15, #T_2f034_row1_col0, #T_2f034_row1_col1, #T_2f034_row1_col2, #T_2f034_row1_col3, #T_2f034_row1_col4, #T_2f034_row1_col5, #T_2f034_row1_col6, #T_2f034_row1_col7, #T_2f034_row1_col8, #T_2f034_row1_col9, #T_2f034_row1_col10, #T_2f034_row1_col13, #T_2f034_row1_col14, #T_2f034_row1_col15, #T_2f034_row2_col0, #T_2f034_row2_col1, #T_2f034_row2_col2, #T_2f034_row2_col3, #T_2f034_row2_col4, #T_2f034_row2_col5, #T_2f034_row2_col6, #T_2f034_row2_col7, #T_2f034_row2_col8, #T_2f034_row2_col9, #T_2f034_row2_col10, #T_2f034_row2_col13, #T_2f034_row2_col14, #T_2f034_row2_col15 {\n",
       "  text-align: left;\n",
       "  border: 1px #231f20 solid !important;\n",
       "  overwrite: False;\n",
       "}\n",
       "#T_2f034_row0_col11, #T_2f034_row1_col11, #T_2f034_row2_col11 {\n",
       "  text-align: left;\n",
       "  border: 1px #231f20 solid !important;\n",
       "  overwrite: False;\n",
       "  background-color: #c3ffc4;\n",
       "}\n",
       "#T_2f034_row0_col12, #T_2f034_row1_col12, #T_2f034_row2_col12 {\n",
       "  text-align: left;\n",
       "  border: 1px #231f20 solid !important;\n",
       "  overwrite: False;\n",
       "  background-color: ;\n",
       "}\n",
       "</style>\n",
       "<table id=\"T_2f034\">\n",
       "  <caption>Nodes</caption>\n",
       "  <thead>\n",
       "    <tr>\n",
       "      <th id=\"T_2f034_level0_col0\" class=\"col_heading level0 col0\" >ID</th>\n",
       "      <th id=\"T_2f034_level0_col1\" class=\"col_heading level0 col1\" >Name</th>\n",
       "      <th id=\"T_2f034_level0_col2\" class=\"col_heading level0 col2\" >Cores</th>\n",
       "      <th id=\"T_2f034_level0_col3\" class=\"col_heading level0 col3\" >RAM</th>\n",
       "      <th id=\"T_2f034_level0_col4\" class=\"col_heading level0 col4\" >Disk</th>\n",
       "      <th id=\"T_2f034_level0_col5\" class=\"col_heading level0 col5\" >Image</th>\n",
       "      <th id=\"T_2f034_level0_col6\" class=\"col_heading level0 col6\" >Image Type</th>\n",
       "      <th id=\"T_2f034_level0_col7\" class=\"col_heading level0 col7\" >Host</th>\n",
       "      <th id=\"T_2f034_level0_col8\" class=\"col_heading level0 col8\" >Site</th>\n",
       "      <th id=\"T_2f034_level0_col9\" class=\"col_heading level0 col9\" >Username</th>\n",
       "      <th id=\"T_2f034_level0_col10\" class=\"col_heading level0 col10\" >Management IP</th>\n",
       "      <th id=\"T_2f034_level0_col11\" class=\"col_heading level0 col11\" >State</th>\n",
       "      <th id=\"T_2f034_level0_col12\" class=\"col_heading level0 col12\" >Error</th>\n",
       "      <th id=\"T_2f034_level0_col13\" class=\"col_heading level0 col13\" >SSH Command</th>\n",
       "      <th id=\"T_2f034_level0_col14\" class=\"col_heading level0 col14\" >Public SSH Key File</th>\n",
       "      <th id=\"T_2f034_level0_col15\" class=\"col_heading level0 col15\" >Private SSH Key File</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td id=\"T_2f034_row0_col0\" class=\"data row0 col0\" >ec05e141-7217-4608-af96-75c2377408c4</td>\n",
       "      <td id=\"T_2f034_row0_col1\" class=\"data row0 col1\" >server1</td>\n",
       "      <td id=\"T_2f034_row0_col2\" class=\"data row0 col2\" >24</td>\n",
       "      <td id=\"T_2f034_row0_col3\" class=\"data row0 col3\" >8</td>\n",
       "      <td id=\"T_2f034_row0_col4\" class=\"data row0 col4\" >100</td>\n",
       "      <td id=\"T_2f034_row0_col5\" class=\"data row0 col5\" >default_ubuntu_20</td>\n",
       "      <td id=\"T_2f034_row0_col6\" class=\"data row0 col6\" >qcow2</td>\n",
       "      <td id=\"T_2f034_row0_col7\" class=\"data row0 col7\" >seat-w1.fabric-testbed.net</td>\n",
       "      <td id=\"T_2f034_row0_col8\" class=\"data row0 col8\" >SEAT</td>\n",
       "      <td id=\"T_2f034_row0_col9\" class=\"data row0 col9\" >ubuntu</td>\n",
       "      <td id=\"T_2f034_row0_col10\" class=\"data row0 col10\" >2001:400:a100:3080:f816:3eff:fec5:ac2b</td>\n",
       "      <td id=\"T_2f034_row0_col11\" class=\"data row0 col11\" >Active</td>\n",
       "      <td id=\"T_2f034_row0_col12\" class=\"data row0 col12\" ></td>\n",
       "      <td id=\"T_2f034_row0_col13\" class=\"data row0 col13\" >ssh -i /home/fabric/work/fabric_config/slice_key -F /home/fabric/work/fabric_config/ssh_config ubuntu@2001:400:a100:3080:f816:3eff:fec5:ac2b</td>\n",
       "      <td id=\"T_2f034_row0_col14\" class=\"data row0 col14\" >/home/fabric/work/fabric_config/slice_key.pub</td>\n",
       "      <td id=\"T_2f034_row0_col15\" class=\"data row0 col15\" >/home/fabric/work/fabric_config/slice_key</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td id=\"T_2f034_row1_col0\" class=\"data row1 col0\" >07c6dfb5-1a74-4b24-840b-e696f87dbb4d</td>\n",
       "      <td id=\"T_2f034_row1_col1\" class=\"data row1 col1\" >server2</td>\n",
       "      <td id=\"T_2f034_row1_col2\" class=\"data row1 col2\" >24</td>\n",
       "      <td id=\"T_2f034_row1_col3\" class=\"data row1 col3\" >8</td>\n",
       "      <td id=\"T_2f034_row1_col4\" class=\"data row1 col4\" >100</td>\n",
       "      <td id=\"T_2f034_row1_col5\" class=\"data row1 col5\" >default_ubuntu_20</td>\n",
       "      <td id=\"T_2f034_row1_col6\" class=\"data row1 col6\" >qcow2</td>\n",
       "      <td id=\"T_2f034_row1_col7\" class=\"data row1 col7\" >seat-w1.fabric-testbed.net</td>\n",
       "      <td id=\"T_2f034_row1_col8\" class=\"data row1 col8\" >SEAT</td>\n",
       "      <td id=\"T_2f034_row1_col9\" class=\"data row1 col9\" >ubuntu</td>\n",
       "      <td id=\"T_2f034_row1_col10\" class=\"data row1 col10\" >2001:400:a100:3080:f816:3eff:fefc:8b37</td>\n",
       "      <td id=\"T_2f034_row1_col11\" class=\"data row1 col11\" >Active</td>\n",
       "      <td id=\"T_2f034_row1_col12\" class=\"data row1 col12\" ></td>\n",
       "      <td id=\"T_2f034_row1_col13\" class=\"data row1 col13\" >ssh -i /home/fabric/work/fabric_config/slice_key -F /home/fabric/work/fabric_config/ssh_config ubuntu@2001:400:a100:3080:f816:3eff:fefc:8b37</td>\n",
       "      <td id=\"T_2f034_row1_col14\" class=\"data row1 col14\" >/home/fabric/work/fabric_config/slice_key.pub</td>\n",
       "      <td id=\"T_2f034_row1_col15\" class=\"data row1 col15\" >/home/fabric/work/fabric_config/slice_key</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td id=\"T_2f034_row2_col0\" class=\"data row2 col0\" >928b8a2c-4a53-423b-8a4a-d03494e54911</td>\n",
       "      <td id=\"T_2f034_row2_col1\" class=\"data row2 col1\" >server3</td>\n",
       "      <td id=\"T_2f034_row2_col2\" class=\"data row2 col2\" >24</td>\n",
       "      <td id=\"T_2f034_row2_col3\" class=\"data row2 col3\" >8</td>\n",
       "      <td id=\"T_2f034_row2_col4\" class=\"data row2 col4\" >100</td>\n",
       "      <td id=\"T_2f034_row2_col5\" class=\"data row2 col5\" >default_ubuntu_20</td>\n",
       "      <td id=\"T_2f034_row2_col6\" class=\"data row2 col6\" >qcow2</td>\n",
       "      <td id=\"T_2f034_row2_col7\" class=\"data row2 col7\" >seat-w1.fabric-testbed.net</td>\n",
       "      <td id=\"T_2f034_row2_col8\" class=\"data row2 col8\" >SEAT</td>\n",
       "      <td id=\"T_2f034_row2_col9\" class=\"data row2 col9\" >ubuntu</td>\n",
       "      <td id=\"T_2f034_row2_col10\" class=\"data row2 col10\" >2001:400:a100:3080:f816:3eff:fe02:a0dc</td>\n",
       "      <td id=\"T_2f034_row2_col11\" class=\"data row2 col11\" >Active</td>\n",
       "      <td id=\"T_2f034_row2_col12\" class=\"data row2 col12\" ></td>\n",
       "      <td id=\"T_2f034_row2_col13\" class=\"data row2 col13\" >ssh -i /home/fabric/work/fabric_config/slice_key -F /home/fabric/work/fabric_config/ssh_config ubuntu@2001:400:a100:3080:f816:3eff:fe02:a0dc</td>\n",
       "      <td id=\"T_2f034_row2_col14\" class=\"data row2 col14\" >/home/fabric/work/fabric_config/slice_key.pub</td>\n",
       "      <td id=\"T_2f034_row2_col15\" class=\"data row2 col15\" >/home/fabric/work/fabric_config/slice_key</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n"
      ],
      "text/plain": [
       "<pandas.io.formats.style.Styler at 0x7fcbfc611420>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<style type=\"text/css\">\n",
       "#T_f985b caption {\n",
       "  text-align: center;\n",
       "  font-size: 150%;\n",
       "  caption-side: top;\n",
       "}\n",
       "#T_f985b th {\n",
       "  text-align: left;\n",
       "}\n",
       "#T_f985b tr:nth-child(even) {\n",
       "  background: #ffffff;\n",
       "  color: #231f20;\n",
       "}\n",
       "#T_f985b tr:nth-child(odd) {\n",
       "  background: #dbf3ff;\n",
       "  color: #231f20;\n",
       "}\n",
       "#T_f985b .level0 {\n",
       "  border: 1px black solid !important;\n",
       "  background: #ffffff;\n",
       "  color: #231f20;\n",
       "}\n",
       "#T_f985b_row0_col0, #T_f985b_row0_col1, #T_f985b_row0_col2, #T_f985b_row0_col3, #T_f985b_row0_col4, #T_f985b_row0_col5, #T_f985b_row0_col6, #T_f985b_row1_col0, #T_f985b_row1_col1, #T_f985b_row1_col2, #T_f985b_row1_col3, #T_f985b_row1_col4, #T_f985b_row1_col5, #T_f985b_row1_col6 {\n",
       "  text-align: left;\n",
       "  border: 1px #231f20 solid !important;\n",
       "  overwrite: False;\n",
       "}\n",
       "#T_f985b_row0_col7, #T_f985b_row1_col7 {\n",
       "  text-align: left;\n",
       "  border: 1px #231f20 solid !important;\n",
       "  overwrite: False;\n",
       "  background-color: #c3ffc4;\n",
       "}\n",
       "#T_f985b_row0_col8, #T_f985b_row1_col8 {\n",
       "  text-align: left;\n",
       "  border: 1px #231f20 solid !important;\n",
       "  overwrite: False;\n",
       "  background-color: ;\n",
       "}\n",
       "</style>\n",
       "<table id=\"T_f985b\">\n",
       "  <caption>Networks</caption>\n",
       "  <thead>\n",
       "    <tr>\n",
       "      <th id=\"T_f985b_level0_col0\" class=\"col_heading level0 col0\" >ID</th>\n",
       "      <th id=\"T_f985b_level0_col1\" class=\"col_heading level0 col1\" >Name</th>\n",
       "      <th id=\"T_f985b_level0_col2\" class=\"col_heading level0 col2\" >Layer</th>\n",
       "      <th id=\"T_f985b_level0_col3\" class=\"col_heading level0 col3\" >Type</th>\n",
       "      <th id=\"T_f985b_level0_col4\" class=\"col_heading level0 col4\" >Site</th>\n",
       "      <th id=\"T_f985b_level0_col5\" class=\"col_heading level0 col5\" >Subnet</th>\n",
       "      <th id=\"T_f985b_level0_col6\" class=\"col_heading level0 col6\" >Gateway</th>\n",
       "      <th id=\"T_f985b_level0_col7\" class=\"col_heading level0 col7\" >State</th>\n",
       "      <th id=\"T_f985b_level0_col8\" class=\"col_heading level0 col8\" >Error</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td id=\"T_f985b_row0_col0\" class=\"data row0 col0\" >81869e27-ea0d-4b12-be14-317a1aa832d4</td>\n",
       "      <td id=\"T_f985b_row0_col1\" class=\"data row0 col1\" >net1</td>\n",
       "      <td id=\"T_f985b_row0_col2\" class=\"data row0 col2\" >L2</td>\n",
       "      <td id=\"T_f985b_row0_col3\" class=\"data row0 col3\" >L2Bridge</td>\n",
       "      <td id=\"T_f985b_row0_col4\" class=\"data row0 col4\" >SEAT</td>\n",
       "      <td id=\"T_f985b_row0_col5\" class=\"data row0 col5\" >None</td>\n",
       "      <td id=\"T_f985b_row0_col6\" class=\"data row0 col6\" >None</td>\n",
       "      <td id=\"T_f985b_row0_col7\" class=\"data row0 col7\" >Active</td>\n",
       "      <td id=\"T_f985b_row0_col8\" class=\"data row0 col8\" ></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td id=\"T_f985b_row1_col0\" class=\"data row1 col0\" >8c0bf37c-3e3e-4b71-a8e6-b00e28b4a3ad</td>\n",
       "      <td id=\"T_f985b_row1_col1\" class=\"data row1 col1\" >net2</td>\n",
       "      <td id=\"T_f985b_row1_col2\" class=\"data row1 col2\" >L2</td>\n",
       "      <td id=\"T_f985b_row1_col3\" class=\"data row1 col3\" >L2Bridge</td>\n",
       "      <td id=\"T_f985b_row1_col4\" class=\"data row1 col4\" >SEAT</td>\n",
       "      <td id=\"T_f985b_row1_col5\" class=\"data row1 col5\" >None</td>\n",
       "      <td id=\"T_f985b_row1_col6\" class=\"data row1 col6\" >None</td>\n",
       "      <td id=\"T_f985b_row1_col7\" class=\"data row1 col7\" >Active</td>\n",
       "      <td id=\"T_f985b_row1_col8\" class=\"data row1 col8\" ></td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n"
      ],
      "text/plain": [
       "<pandas.io.formats.style.Styler at 0x7fcc0c607460>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<style type=\"text/css\">\n",
       "#T_78784 caption {\n",
       "  text-align: center;\n",
       "  font-size: 150%;\n",
       "  caption-side: top;\n",
       "}\n",
       "#T_78784 th {\n",
       "  text-align: left;\n",
       "}\n",
       "#T_78784 tr:nth-child(even) {\n",
       "  background: #ffffff;\n",
       "  color: #231f20;\n",
       "}\n",
       "#T_78784 tr:nth-child(odd) {\n",
       "  background: #dbf3ff;\n",
       "  color: #231f20;\n",
       "}\n",
       "#T_78784 .level0 {\n",
       "  border: 1px black solid !important;\n",
       "  background: #ffffff;\n",
       "  color: #231f20;\n",
       "}\n",
       "#T_78784_row0_col0, #T_78784_row0_col1, #T_78784_row0_col2, #T_78784_row0_col3, #T_78784_row0_col4, #T_78784_row0_col5, #T_78784_row0_col6, #T_78784_row0_col7, #T_78784_row0_col8, #T_78784_row0_col9, #T_78784_row0_col10, #T_78784_row0_col11, #T_78784_row1_col0, #T_78784_row1_col1, #T_78784_row1_col2, #T_78784_row1_col3, #T_78784_row1_col4, #T_78784_row1_col5, #T_78784_row1_col6, #T_78784_row1_col7, #T_78784_row1_col8, #T_78784_row1_col9, #T_78784_row1_col10, #T_78784_row1_col11, #T_78784_row2_col0, #T_78784_row2_col1, #T_78784_row2_col2, #T_78784_row2_col3, #T_78784_row2_col4, #T_78784_row2_col5, #T_78784_row2_col6, #T_78784_row2_col7, #T_78784_row2_col8, #T_78784_row2_col9, #T_78784_row2_col10, #T_78784_row2_col11, #T_78784_row3_col0, #T_78784_row3_col1, #T_78784_row3_col2, #T_78784_row3_col3, #T_78784_row3_col4, #T_78784_row3_col5, #T_78784_row3_col6, #T_78784_row3_col7, #T_78784_row3_col8, #T_78784_row3_col9, #T_78784_row3_col10, #T_78784_row3_col11, #T_78784_row4_col0, #T_78784_row4_col1, #T_78784_row4_col2, #T_78784_row4_col3, #T_78784_row4_col4, #T_78784_row4_col5, #T_78784_row4_col6, #T_78784_row4_col7, #T_78784_row4_col8, #T_78784_row4_col9, #T_78784_row4_col10, #T_78784_row4_col11, #T_78784_row5_col0, #T_78784_row5_col1, #T_78784_row5_col2, #T_78784_row5_col3, #T_78784_row5_col4, #T_78784_row5_col5, #T_78784_row5_col6, #T_78784_row5_col7, #T_78784_row5_col8, #T_78784_row5_col9, #T_78784_row5_col10, #T_78784_row5_col11 {\n",
       "  text-align: left;\n",
       "  border: 1px #231f20 solid !important;\n",
       "  overwrite: False;\n",
       "}\n",
       "</style>\n",
       "<table id=\"T_78784\">\n",
       "  <caption>Interfaces</caption>\n",
       "  <thead>\n",
       "    <tr>\n",
       "      <th id=\"T_78784_level0_col0\" class=\"col_heading level0 col0\" >Name</th>\n",
       "      <th id=\"T_78784_level0_col1\" class=\"col_heading level0 col1\" >Short Name</th>\n",
       "      <th id=\"T_78784_level0_col2\" class=\"col_heading level0 col2\" >Node</th>\n",
       "      <th id=\"T_78784_level0_col3\" class=\"col_heading level0 col3\" >Network</th>\n",
       "      <th id=\"T_78784_level0_col4\" class=\"col_heading level0 col4\" >Bandwidth</th>\n",
       "      <th id=\"T_78784_level0_col5\" class=\"col_heading level0 col5\" >Mode</th>\n",
       "      <th id=\"T_78784_level0_col6\" class=\"col_heading level0 col6\" >VLAN</th>\n",
       "      <th id=\"T_78784_level0_col7\" class=\"col_heading level0 col7\" >MAC</th>\n",
       "      <th id=\"T_78784_level0_col8\" class=\"col_heading level0 col8\" >Physical Device</th>\n",
       "      <th id=\"T_78784_level0_col9\" class=\"col_heading level0 col9\" >Device</th>\n",
       "      <th id=\"T_78784_level0_col10\" class=\"col_heading level0 col10\" >IP Address</th>\n",
       "      <th id=\"T_78784_level0_col11\" class=\"col_heading level0 col11\" >Numa Node</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td id=\"T_78784_row0_col0\" class=\"data row0 col0\" >server1-nic-p1</td>\n",
       "      <td id=\"T_78784_row0_col1\" class=\"data row0 col1\" >p1</td>\n",
       "      <td id=\"T_78784_row0_col2\" class=\"data row0 col2\" >server1</td>\n",
       "      <td id=\"T_78784_row0_col3\" class=\"data row0 col3\" >net1</td>\n",
       "      <td id=\"T_78784_row0_col4\" class=\"data row0 col4\" >100</td>\n",
       "      <td id=\"T_78784_row0_col5\" class=\"data row0 col5\" >config</td>\n",
       "      <td id=\"T_78784_row0_col6\" class=\"data row0 col6\" ></td>\n",
       "      <td id=\"T_78784_row0_col7\" class=\"data row0 col7\" >10:70:FD:E5:E7:78</td>\n",
       "      <td id=\"T_78784_row0_col8\" class=\"data row0 col8\" >enp7s0</td>\n",
       "      <td id=\"T_78784_row0_col9\" class=\"data row0 col9\" >enp7s0</td>\n",
       "      <td id=\"T_78784_row0_col10\" class=\"data row0 col10\" >None</td>\n",
       "      <td id=\"T_78784_row0_col11\" class=\"data row0 col11\" >2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td id=\"T_78784_row1_col0\" class=\"data row1 col0\" >server1-nic-p2</td>\n",
       "      <td id=\"T_78784_row1_col1\" class=\"data row1 col1\" >p2</td>\n",
       "      <td id=\"T_78784_row1_col2\" class=\"data row1 col2\" >server1</td>\n",
       "      <td id=\"T_78784_row1_col3\" class=\"data row1 col3\" >None</td>\n",
       "      <td id=\"T_78784_row1_col4\" class=\"data row1 col4\" >100</td>\n",
       "      <td id=\"T_78784_row1_col5\" class=\"data row1 col5\" >config</td>\n",
       "      <td id=\"T_78784_row1_col6\" class=\"data row1 col6\" ></td>\n",
       "      <td id=\"T_78784_row1_col7\" class=\"data row1 col7\" >10:70:FD:E5:E7:79</td>\n",
       "      <td id=\"T_78784_row1_col8\" class=\"data row1 col8\" >enp8s0</td>\n",
       "      <td id=\"T_78784_row1_col9\" class=\"data row1 col9\" >enp8s0</td>\n",
       "      <td id=\"T_78784_row1_col10\" class=\"data row1 col10\" >None</td>\n",
       "      <td id=\"T_78784_row1_col11\" class=\"data row1 col11\" >2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td id=\"T_78784_row2_col0\" class=\"data row2 col0\" >server2-nic2-p2</td>\n",
       "      <td id=\"T_78784_row2_col1\" class=\"data row2 col1\" >p2</td>\n",
       "      <td id=\"T_78784_row2_col2\" class=\"data row2 col2\" >server2</td>\n",
       "      <td id=\"T_78784_row2_col3\" class=\"data row2 col3\" >net2</td>\n",
       "      <td id=\"T_78784_row2_col4\" class=\"data row2 col4\" >100</td>\n",
       "      <td id=\"T_78784_row2_col5\" class=\"data row2 col5\" >config</td>\n",
       "      <td id=\"T_78784_row2_col6\" class=\"data row2 col6\" ></td>\n",
       "      <td id=\"T_78784_row2_col7\" class=\"data row2 col7\" >10:70:FD:E5:EC:41</td>\n",
       "      <td id=\"T_78784_row2_col8\" class=\"data row2 col8\" >enp8s0</td>\n",
       "      <td id=\"T_78784_row2_col9\" class=\"data row2 col9\" >enp8s0</td>\n",
       "      <td id=\"T_78784_row2_col10\" class=\"data row2 col10\" >None</td>\n",
       "      <td id=\"T_78784_row2_col11\" class=\"data row2 col11\" >6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td id=\"T_78784_row3_col0\" class=\"data row3 col0\" >server2-nic2-p1</td>\n",
       "      <td id=\"T_78784_row3_col1\" class=\"data row3 col1\" >p1</td>\n",
       "      <td id=\"T_78784_row3_col2\" class=\"data row3 col2\" >server2</td>\n",
       "      <td id=\"T_78784_row3_col3\" class=\"data row3 col3\" >net1</td>\n",
       "      <td id=\"T_78784_row3_col4\" class=\"data row3 col4\" >100</td>\n",
       "      <td id=\"T_78784_row3_col5\" class=\"data row3 col5\" >config</td>\n",
       "      <td id=\"T_78784_row3_col6\" class=\"data row3 col6\" ></td>\n",
       "      <td id=\"T_78784_row3_col7\" class=\"data row3 col7\" >10:70:FD:E5:EC:40</td>\n",
       "      <td id=\"T_78784_row3_col8\" class=\"data row3 col8\" >enp7s0</td>\n",
       "      <td id=\"T_78784_row3_col9\" class=\"data row3 col9\" >enp7s0</td>\n",
       "      <td id=\"T_78784_row3_col10\" class=\"data row3 col10\" >None</td>\n",
       "      <td id=\"T_78784_row3_col11\" class=\"data row3 col11\" >6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td id=\"T_78784_row4_col0\" class=\"data row4 col0\" >server3-nic3-p1</td>\n",
       "      <td id=\"T_78784_row4_col1\" class=\"data row4 col1\" >p1</td>\n",
       "      <td id=\"T_78784_row4_col2\" class=\"data row4 col2\" >server3</td>\n",
       "      <td id=\"T_78784_row4_col3\" class=\"data row4 col3\" >net2</td>\n",
       "      <td id=\"T_78784_row4_col4\" class=\"data row4 col4\" >100</td>\n",
       "      <td id=\"T_78784_row4_col5\" class=\"data row4 col5\" >config</td>\n",
       "      <td id=\"T_78784_row4_col6\" class=\"data row4 col6\" ></td>\n",
       "      <td id=\"T_78784_row4_col7\" class=\"data row4 col7\" >10:70:FD:E5:E5:F8</td>\n",
       "      <td id=\"T_78784_row4_col8\" class=\"data row4 col8\" >enp7s0</td>\n",
       "      <td id=\"T_78784_row4_col9\" class=\"data row4 col9\" >enp7s0</td>\n",
       "      <td id=\"T_78784_row4_col10\" class=\"data row4 col10\" >None</td>\n",
       "      <td id=\"T_78784_row4_col11\" class=\"data row4 col11\" >1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td id=\"T_78784_row5_col0\" class=\"data row5 col0\" >server3-nic3-p2</td>\n",
       "      <td id=\"T_78784_row5_col1\" class=\"data row5 col1\" >p2</td>\n",
       "      <td id=\"T_78784_row5_col2\" class=\"data row5 col2\" >server3</td>\n",
       "      <td id=\"T_78784_row5_col3\" class=\"data row5 col3\" >None</td>\n",
       "      <td id=\"T_78784_row5_col4\" class=\"data row5 col4\" >100</td>\n",
       "      <td id=\"T_78784_row5_col5\" class=\"data row5 col5\" >config</td>\n",
       "      <td id=\"T_78784_row5_col6\" class=\"data row5 col6\" ></td>\n",
       "      <td id=\"T_78784_row5_col7\" class=\"data row5 col7\" >10:70:FD:E5:E5:F9</td>\n",
       "      <td id=\"T_78784_row5_col8\" class=\"data row5 col8\" >enp8s0</td>\n",
       "      <td id=\"T_78784_row5_col9\" class=\"data row5 col9\" >enp8s0</td>\n",
       "      <td id=\"T_78784_row5_col10\" class=\"data row5 col10\" >None</td>\n",
       "      <td id=\"T_78784_row5_col11\" class=\"data row5 col11\" >1</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n"
      ],
      "text/plain": [
       "<pandas.io.formats.style.Styler at 0x7fcbfc5a8550>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n",
      "Time to print interfaces 362 seconds\n"
     ]
    }
   ],
   "source": [
    "#Submit Slice Request\n",
    "slice.submit();"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "742c54f2-4a8b-4ec1-bc9c-f32074db43e9",
   "metadata": {
    "jp-MarkdownHeadingCollapsed": true,
    "tags": []
   },
   "source": [
    "# Step 4: Set the workspace\n",
    "\n",
    "These steps apply to all servers  "
   ]
  },
  {
   "cell_type": "markdown",
   "id": "653c12ab-fc9d-469f-ae78-0c21d2d84175",
   "metadata": {
    "jp-MarkdownHeadingCollapsed": true,
    "tags": []
   },
   "source": [
    "### Upload .sh file (ask)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "id": "14485ef7-1a32-48f6-833e-48579478ac1d",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[31m sudo: unable to resolve host server1: Temporary failure in name resolution\n",
      "sudo: unable to resolve host server1: Name or service not known\n",
      "sudo: unable to resolve host server1: Name or service not known\n",
      " \u001b[0m* Applying /etc/sysctl.d/10-console-messages.conf ...\n",
      "kernel.printk = 4 4 1 7\n",
      "* Applying /etc/sysctl.d/10-ipv6-privacy.conf ...\n",
      "net.ipv6.conf.all.use_tempaddr = 2\n",
      "net.ipv6.conf.default.use_tempaddr = 2\n",
      "* Applying /etc/sysctl.d/10-kernel-hardening.conf ...\n",
      "kernel.kptr_restrict = 1\n",
      "* Applying /etc/sysctl.d/10-link-restrictions.conf ...\n",
      "fs.protected_hardlinks = 1\n",
      "fs.protected_symlinks = 1\n",
      "* Applying /etc/sysctl.d/10-magic-sysrq.conf ...\n",
      "kernel.sysrq = 176\n",
      "* Applying /etc/sysctl.d/10-network-security.conf ...\n",
      "net.ipv4.conf.default.rp_filter = 2\n",
      "net.ipv4.conf.all.rp_filter = 2\n",
      "* Applying /etc/sysctl.d/10-ptrace.conf ...\n",
      "kernel.yama.ptrace_scope = 1\n",
      "* Applying /etc/sysctl.d/10-zeropage.conf ...\n",
      "vm.mmap_min_addr = 65536\n",
      "* Applying /usr/lib/sysctl.d/50-default.conf ...\n",
      "net.ipv4.conf.default.promote_secondaries = 1\n",
      "\u001b[31m sudo: unable to resolve host server1: Name or service not known\n",
      "sysctl: setting key \"net.ipv4.conf.all.promote_secondaries\": Invalid argument\n",
      " \u001b[0mnet.ipv4.ping_group_range = 0 2147483647\n",
      "net.core.default_qdisc = fq_codel\n",
      "fs.protected_regular = 1\n",
      "fs.protected_fifos = 1\n",
      "* Applying /usr/lib/sysctl.d/50-pid-max.conf ...\n",
      "kernel.pid_max = 4194304\n",
      "* Applying /etc/sysctl.d/99-cloudimg-ipv6.conf ...\n",
      "net.ipv6.conf.all.use_tempaddr = 0\n",
      "net.ipv6.conf.default.use_tempaddr = 0\n",
      "* Applying /etc/sysctl.d/99-sysctl.conf ...\n",
      "net.core.rmem_max = 536870912\n",
      "net.core.wmem_max = 536870912\n",
      "net.ipv4.tcp_rmem = 4096 87380 536870912\n",
      "net.ipv4.tcp_wmem = 4096 65536 536870912\n",
      "net.ipv4.tcp_congestion_control = bbr\n",
      "net.ipv4.tcp_mtu_probing = 1\n",
      "net.core.default_qdisc = fq\n",
      "* Applying /usr/lib/sysctl.d/protect-links.conf ...\n",
      "fs.protected_fifos = 1\n",
      "fs.protected_hardlinks = 1\n",
      "fs.protected_regular = 2\n",
      "fs.protected_symlinks = 1\n",
      "* Applying /etc/sysctl.conf ...\n",
      "net.core.rmem_max = 536870912\n",
      "net.core.wmem_max = 536870912\n",
      "net.ipv4.tcp_rmem = 4096 87380 536870912\n",
      "net.ipv4.tcp_wmem = 4096 65536 536870912\n",
      "net.ipv4.tcp_congestion_control = bbr\n",
      "net.ipv4.tcp_mtu_probing = 1\n",
      "net.core.default_qdisc = fq\n"
     ]
    }
   ],
   "source": [
    "from ipaddress import ip_address, IPv6Address\n",
    "\n",
    "server1 = slice.get_node(name=\"server1\")     \n",
    "\n",
    "# If the node is an IPv6 Node then configure NAT64\n",
    "if type(ip_address(server1.get_management_ip())) is IPv6Address:\n",
    "    server1.upload_file('nat64.sh', 'nat64.sh')\n",
    "    stdout, stderr = server1.execute(f'chmod +x nat64.sh && ./nat64.sh')\n",
    "\n",
    "server1.upload_file('host_tune.sh', 'host_tune.sh')\n",
    "stdout, stderr = server1.execute(f'chmod +x host_tune.sh && sudo ./host_tune.sh')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "id": "027438ee-7b07-4744-8d47-a41359057d39",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[31m sudo: unable to resolve host server2: Temporary failure in name resolution\n",
      "sudo: unable to resolve host server2: Name or service not known\n",
      "sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m* Applying /etc/sysctl.d/10-console-messages.conf ...\n",
      "kernel.printk = 4 4 1 7\n",
      "* Applying /etc/sysctl.d/10-ipv6-privacy.conf ...\n",
      "net.ipv6.conf.all.use_tempaddr = 2\n",
      "net.ipv6.conf.default.use_tempaddr = 2\n",
      "* Applying /etc/sysctl.d/10-kernel-hardening.conf ...\n",
      "kernel.kptr_restrict = 1\n",
      "* Applying /etc/sysctl.d/10-link-restrictions.conf ...\n",
      "fs.protected_hardlinks = 1\n",
      "fs.protected_symlinks = 1\n",
      "* Applying /etc/sysctl.d/10-magic-sysrq.conf ...\n",
      "kernel.sysrq = 176\n",
      "* Applying /etc/sysctl.d/10-network-security.conf ...\n",
      "net.ipv4.conf.default.rp_filter = 2\n",
      "net.ipv4.conf.all.rp_filter = 2\n",
      "* Applying /etc/sysctl.d/10-ptrace.conf ...\n",
      "kernel.yama.ptrace_scope = 1\n",
      "* Applying /etc/sysctl.d/10-zeropage.conf ...\n",
      "vm.mmap_min_addr = 65536\n",
      "* Applying /usr/lib/sysctl.d/50-default.conf ...\n",
      "net.ipv4.conf.default.promote_secondaries = 1\n",
      "\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      "sysctl: setting key \"net.ipv4.conf.all.promote_secondaries\": Invalid argument\n",
      " \u001b[0mnet.ipv4.ping_group_range = 0 2147483647\n",
      "net.core.default_qdisc = fq_codel\n",
      "fs.protected_regular = 1\n",
      "fs.protected_fifos = 1\n",
      "* Applying /usr/lib/sysctl.d/50-pid-max.conf ...\n",
      "kernel.pid_max = 4194304\n",
      "* Applying /etc/sysctl.d/99-cloudimg-ipv6.conf ...\n",
      "net.ipv6.conf.all.use_tempaddr = 0\n",
      "net.ipv6.conf.default.use_tempaddr = 0\n",
      "* Applying /etc/sysctl.d/99-sysctl.conf ...\n",
      "net.core.rmem_max = 536870912\n",
      "net.core.wmem_max = 536870912\n",
      "net.ipv4.tcp_rmem = 4096 87380 536870912\n",
      "net.ipv4.tcp_wmem = 4096 65536 536870912\n",
      "net.ipv4.tcp_congestion_control = bbr\n",
      "net.ipv4.tcp_mtu_probing = 1\n",
      "net.core.default_qdisc = fq\n",
      "* Applying /usr/lib/sysctl.d/protect-links.conf ...\n",
      "fs.protected_fifos = 1\n",
      "fs.protected_hardlinks = 1\n",
      "fs.protected_regular = 2\n",
      "fs.protected_symlinks = 1\n",
      "* Applying /etc/sysctl.conf ...\n",
      "net.core.rmem_max = 536870912\n",
      "net.core.wmem_max = 536870912\n",
      "net.ipv4.tcp_rmem = 4096 87380 536870912\n",
      "net.ipv4.tcp_wmem = 4096 65536 536870912\n",
      "net.ipv4.tcp_congestion_control = bbr\n",
      "net.ipv4.tcp_mtu_probing = 1\n",
      "net.core.default_qdisc = fq\n"
     ]
    }
   ],
   "source": [
    "from ipaddress import ip_address, IPv6Address\n",
    "\n",
    "server2 = slice.get_node(name=\"server2\")     \n",
    "\n",
    "# If the node is an IPv6 Node then configure NAT64\n",
    "if type(ip_address(server2.get_management_ip())) is IPv6Address:\n",
    "    server2.upload_file('nat64.sh', 'nat64.sh')\n",
    "\n",
    "    stdout, stderr = server2.execute(f'chmod +x nat64.sh && ./nat64.sh')\n",
    "\n",
    "server2.upload_file('host_tune.sh', 'host_tune.sh')\n",
    "stdout, stderr = server2.execute(f'chmod +x host_tune.sh && sudo ./host_tune.sh')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "id": "a1092ea8-c332-42d7-a717-253b9081f974",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[31m sudo: unable to resolve host server3: Temporary failure in name resolution\n",
      "sudo: unable to resolve host server3: Name or service not known\n",
      "sudo: unable to resolve host server3: Name or service not known\n",
      " \u001b[0m* Applying /etc/sysctl.d/10-console-messages.conf ...\n",
      "kernel.printk = 4 4 1 7\n",
      "* Applying /etc/sysctl.d/10-ipv6-privacy.conf ...\n",
      "net.ipv6.conf.all.use_tempaddr = 2\n",
      "net.ipv6.conf.default.use_tempaddr = 2\n",
      "* Applying /etc/sysctl.d/10-kernel-hardening.conf ...\n",
      "kernel.kptr_restrict = 1\n",
      "* Applying /etc/sysctl.d/10-link-restrictions.conf ...\n",
      "fs.protected_hardlinks = 1\n",
      "fs.protected_symlinks = 1\n",
      "* Applying /etc/sysctl.d/10-magic-sysrq.conf ...\n",
      "kernel.sysrq = 176\n",
      "* Applying /etc/sysctl.d/10-network-security.conf ...\n",
      "net.ipv4.conf.default.rp_filter = 2\n",
      "net.ipv4.conf.all.rp_filter = 2\n",
      "* Applying /etc/sysctl.d/10-ptrace.conf ...\n",
      "kernel.yama.ptrace_scope = 1\n",
      "* Applying /etc/sysctl.d/10-zeropage.conf ...\n",
      "vm.mmap_min_addr = 65536\n",
      "* Applying /usr/lib/sysctl.d/50-default.conf ...\n",
      "net.ipv4.conf.default.promote_secondaries = 1\n",
      "\u001b[31m sudo: unable to resolve host server3: Name or service not known\n",
      "sysctl: setting key \"net.ipv4.conf.all.promote_secondaries\": Invalid argument\n",
      " \u001b[0mnet.ipv4.ping_group_range = 0 2147483647\n",
      "net.core.default_qdisc = fq_codel\n",
      "fs.protected_regular = 1\n",
      "fs.protected_fifos = 1\n",
      "* Applying /usr/lib/sysctl.d/50-pid-max.conf ...\n",
      "kernel.pid_max = 4194304\n",
      "* Applying /etc/sysctl.d/99-cloudimg-ipv6.conf ...\n",
      "net.ipv6.conf.all.use_tempaddr = 0\n",
      "net.ipv6.conf.default.use_tempaddr = 0\n",
      "* Applying /etc/sysctl.d/99-sysctl.conf ...\n",
      "net.core.rmem_max = 536870912\n",
      "net.core.wmem_max = 536870912\n",
      "net.ipv4.tcp_rmem = 4096 87380 536870912\n",
      "net.ipv4.tcp_wmem = 4096 65536 536870912\n",
      "net.ipv4.tcp_congestion_control = bbr\n",
      "net.ipv4.tcp_mtu_probing = 1\n",
      "net.core.default_qdisc = fq\n",
      "* Applying /usr/lib/sysctl.d/protect-links.conf ...\n",
      "fs.protected_fifos = 1\n",
      "fs.protected_hardlinks = 1\n",
      "fs.protected_regular = 2\n",
      "fs.protected_symlinks = 1\n",
      "* Applying /etc/sysctl.conf ...\n",
      "net.core.rmem_max = 536870912\n",
      "net.core.wmem_max = 536870912\n",
      "net.ipv4.tcp_rmem = 4096 87380 536870912\n",
      "net.ipv4.tcp_wmem = 4096 65536 536870912\n",
      "net.ipv4.tcp_congestion_control = bbr\n",
      "net.ipv4.tcp_mtu_probing = 1\n",
      "net.core.default_qdisc = fq\n"
     ]
    }
   ],
   "source": [
    "from ipaddress import ip_address, IPv6Address\n",
    "\n",
    "server3 = slice.get_node(name=\"server3\")     \n",
    "\n",
    "# If the node is an IPv6 Node then configure NAT64\n",
    "if type(ip_address(server3.get_management_ip())) is IPv6Address:\n",
    "    server3.upload_file('nat64.sh', 'nat64.sh')\n",
    "\n",
    "    stdout, stderr = server3.execute(f'chmod +x nat64.sh && ./nat64.sh')\n",
    "\n",
    "server3.upload_file('host_tune.sh', 'host_tune.sh')\n",
    "stdout, stderr = server3.execute(f'chmod +x host_tune.sh && sudo ./host_tune.sh')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "19b87b4a-bd7b-440e-aa5d-9babce9bfec0",
   "metadata": {
    "jp-MarkdownHeadingCollapsed": true,
    "tags": []
   },
   "source": [
    "### Pinning numa nodes"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "id": "262f4fed-1eb0-48d9-8ad2-09d3b586854d",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Pinning Node: server1 CPUs for component: nic to Numa Node: 2\n",
      "Pinning Node: server2 CPUs for component: nic2 to Numa Node: 1\n",
      "Pinning Node: server3 CPUs for component: nic3 to Numa Node: 6\n",
      "Numa tune Node: server1 Memory to Numa  Nodes: ['2']\n",
      "Numa tune Node: server2 Memory to Numa  Nodes: ['1']\n"
     ]
    },
    {
     "ename": "Exception",
     "evalue": "Failed to issue POA - numainfo Error (500)\nReason: INTERNAL SERVER ERROR\nHTTP response headers: HTTPHeaderDict({'Server': 'nginx/1.21.6', 'Date': 'Mon, 01 Apr 2024 21:01:09 GMT', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '306', 'Connection': 'keep-alive', 'Access-Control-Allow-Credentials': 'true', 'Access-Control-Allow-Headers': 'DNT, User-Agent, X-Requested-With, If-Modified-Since, Cache-Control, Content-Type, Range, Authorization', 'Access-Control-Allow-Methods': 'GET, POST, PUT, PATCH, DELETE, OPTIONS', 'Access-Control-Allow-Origin': '*', 'Access-Control-Expose-Headers': 'Content-Length, Content-Range, X-Error', 'X-Error': 'Failed to trigger POA: error: Reservation has a pending operation. Internal Error occurrederror: Reservation has a pending operation'})\nHTTP response body: b'{\\n    \"errors\": [\\n        {\\n            \"details\": \"Failed to trigger POA: error: Reservation has a pending operation. Internal Error occurrederror: Reservation has a pending operation\",\\n            \"message\": \"Internal Server Error\"\\n        }\\n    ],\\n    \"size\": 1,\\n    \"status\": 500,\\n    \"type\": \"error\"\\n}'\n",
     "output_type": "error",
     "traceback": [
      "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m",
      "\u001b[0;31mException\u001b[0m                                 Traceback (most recent call last)",
      "Cell \u001b[0;32mIn[13], line 11\u001b[0m\n\u001b[1;32m      9\u001b[0m server1\u001b[38;5;241m.\u001b[39mnuma_tune()\n\u001b[1;32m     10\u001b[0m server2\u001b[38;5;241m.\u001b[39mnuma_tune()\n\u001b[0;32m---> 11\u001b[0m \u001b[43mserver3\u001b[49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43mnuma_tune\u001b[49m\u001b[43m(\u001b[49m\u001b[43m)\u001b[49m\n\u001b[1;32m     13\u001b[0m \u001b[38;5;66;03m# Reboot the VM\u001b[39;00m\n\u001b[1;32m     14\u001b[0m \u001b[38;5;66;03m# .os_reboot()\u001b[39;00m\n",
      "File \u001b[0;32m/opt/conda/lib/python3.10/site-packages/fabrictestbed_extensions/fablib/node.py:3422\u001b[0m, in \u001b[0;36mNode.numa_tune\u001b[0;34m(self)\u001b[0m\n\u001b[1;32m   3420\u001b[0m logging\u001b[38;5;241m.\u001b[39mgetLogger()\u001b[38;5;241m.\u001b[39merror(traceback\u001b[38;5;241m.\u001b[39mformat_exc())\n\u001b[1;32m   3421\u001b[0m logging\u001b[38;5;241m.\u001b[39mgetLogger(\u001b[38;5;124mf\u001b[39m\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mFailed to Numa tune for node: \u001b[39m\u001b[38;5;132;01m{\u001b[39;00m\u001b[38;5;28mself\u001b[39m\u001b[38;5;241m.\u001b[39mget_name()\u001b[38;5;132;01m}\u001b[39;00m\u001b[38;5;124m e: \u001b[39m\u001b[38;5;132;01m{\u001b[39;00me\u001b[38;5;132;01m}\u001b[39;00m\u001b[38;5;124m\"\u001b[39m)\n\u001b[0;32m-> 3422\u001b[0m \u001b[38;5;28;01mraise\u001b[39;00m e\n",
      "File \u001b[0;32m/opt/conda/lib/python3.10/site-packages/fabrictestbed_extensions/fablib/node.py:3337\u001b[0m, in \u001b[0;36mNode.numa_tune\u001b[0;34m(self)\u001b[0m\n\u001b[1;32m   3332\u001b[0m \u001b[38;5;250m\u001b[39m\u001b[38;5;124;03m\"\"\"\u001b[39;00m\n\u001b[1;32m   3333\u001b[0m \u001b[38;5;124;03mPin the memory for the VM to the numa node associated with the components\u001b[39;00m\n\u001b[1;32m   3334\u001b[0m \u001b[38;5;124;03m\"\"\"\u001b[39;00m\n\u001b[1;32m   3335\u001b[0m \u001b[38;5;28;01mtry\u001b[39;00m:\n\u001b[1;32m   3336\u001b[0m     \u001b[38;5;66;03m# Get CPU Info for the VM and Host on which VM resides\u001b[39;00m\n\u001b[0;32m-> 3337\u001b[0m     numa_info \u001b[38;5;241m=\u001b[39m \u001b[38;5;28;43mself\u001b[39;49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43mget_numa_info\u001b[49m\u001b[43m(\u001b[49m\u001b[43m)\u001b[49m\n\u001b[1;32m   3339\u001b[0m     total_available_memory \u001b[38;5;241m=\u001b[39m \u001b[38;5;241m0\u001b[39m\n\u001b[1;32m   3341\u001b[0m     numa_nodes \u001b[38;5;241m=\u001b[39m []\n",
      "File \u001b[0;32m/opt/conda/lib/python3.10/site-packages/fabrictestbed_extensions/fablib/node.py:3228\u001b[0m, in \u001b[0;36mNode.get_numa_info\u001b[0;34m(self)\u001b[0m\n\u001b[1;32m   3204\u001b[0m \u001b[38;5;250m\u001b[39m\u001b[38;5;124;03m\"\"\"\u001b[39;00m\n\u001b[1;32m   3205\u001b[0m \u001b[38;5;124;03mHost INFO looks like:\u001b[39;00m\n\u001b[1;32m   3206\u001b[0m \u001b[38;5;124;03m{'available': '8 nodes (0-7)',\u001b[39;00m\n\u001b[0;32m   (...)\u001b[0m\n\u001b[1;32m   3225\u001b[0m \u001b[38;5;124;03m'Total': {'Heap': '6', 'Huge': '0', 'Private': '32813', 'Stack': '0', 'Total': '32818'}}\u001b[39;00m\n\u001b[1;32m   3226\u001b[0m \u001b[38;5;124;03m\"\"\"\u001b[39;00m\n\u001b[1;32m   3227\u001b[0m \u001b[38;5;66;03m# Get Numa Info for the VM and Host on which VM resides\u001b[39;00m\n\u001b[0;32m-> 3228\u001b[0m numa_info \u001b[38;5;241m=\u001b[39m \u001b[38;5;28;43mself\u001b[39;49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43mpoa\u001b[49m\u001b[43m(\u001b[49m\u001b[43moperation\u001b[49m\u001b[38;5;241;43m=\u001b[39;49m\u001b[38;5;124;43m\"\u001b[39;49m\u001b[38;5;124;43mnumainfo\u001b[39;49m\u001b[38;5;124;43m\"\u001b[39;49m\u001b[43m)\u001b[49m\n\u001b[1;32m   3229\u001b[0m logging\u001b[38;5;241m.\u001b[39mgetLogger()\u001b[38;5;241m.\u001b[39minfo(\u001b[38;5;124mf\u001b[39m\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mHOST Numa INFO: \u001b[39m\u001b[38;5;132;01m{\u001b[39;00mnuma_info\u001b[38;5;241m.\u001b[39mget(\u001b[38;5;28mself\u001b[39m\u001b[38;5;241m.\u001b[39mget_host())\u001b[38;5;132;01m}\u001b[39;00m\u001b[38;5;124m\"\u001b[39m)\n\u001b[1;32m   3230\u001b[0m logging\u001b[38;5;241m.\u001b[39mgetLogger()\u001b[38;5;241m.\u001b[39minfo(\n\u001b[1;32m   3231\u001b[0m     \u001b[38;5;124mf\u001b[39m\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mInstance Numa INFO: \u001b[39m\u001b[38;5;132;01m{\u001b[39;00mnuma_info\u001b[38;5;241m.\u001b[39mget(\u001b[38;5;28mself\u001b[39m\u001b[38;5;241m.\u001b[39mget_instance_name())\u001b[38;5;132;01m}\u001b[39;00m\u001b[38;5;124m\"\u001b[39m\n\u001b[1;32m   3232\u001b[0m )\n",
      "File \u001b[0;32m/opt/conda/lib/python3.10/site-packages/fabrictestbed_extensions/fablib/node.py:3110\u001b[0m, in \u001b[0;36mNode.poa\u001b[0;34m(self, operation, vcpu_cpu_map, node_set, keys)\u001b[0m\n\u001b[1;32m   3108\u001b[0m logger \u001b[38;5;241m=\u001b[39m logging\u001b[38;5;241m.\u001b[39mgetLogger()\n\u001b[1;32m   3109\u001b[0m \u001b[38;5;28;01mif\u001b[39;00m status \u001b[38;5;241m!=\u001b[39m Status\u001b[38;5;241m.\u001b[39mOK:\n\u001b[0;32m-> 3110\u001b[0m     \u001b[38;5;28;01mraise\u001b[39;00m \u001b[38;5;167;01mException\u001b[39;00m(\u001b[38;5;124mf\u001b[39m\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mFailed to issue POA - \u001b[39m\u001b[38;5;132;01m{\u001b[39;00moperation\u001b[38;5;132;01m}\u001b[39;00m\u001b[38;5;124m Error \u001b[39m\u001b[38;5;132;01m{\u001b[39;00mpoa_info\u001b[38;5;132;01m}\u001b[39;00m\u001b[38;5;124m\"\u001b[39m)\n\u001b[1;32m   3112\u001b[0m logger\u001b[38;5;241m.\u001b[39minfo(\n\u001b[1;32m   3113\u001b[0m     \u001b[38;5;124mf\u001b[39m\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mPOA \u001b[39m\u001b[38;5;132;01m{\u001b[39;00mpoa_info[\u001b[38;5;241m0\u001b[39m]\u001b[38;5;241m.\u001b[39mpoa_id\u001b[38;5;132;01m}\u001b[39;00m\u001b[38;5;124m/\u001b[39m\u001b[38;5;132;01m{\u001b[39;00moperation\u001b[38;5;132;01m}\u001b[39;00m\u001b[38;5;124m submitted for \u001b[39m\u001b[38;5;132;01m{\u001b[39;00m\u001b[38;5;28mself\u001b[39m\u001b[38;5;241m.\u001b[39mget_reservation_id()\u001b[38;5;132;01m}\u001b[39;00m\u001b[38;5;124m/\u001b[39m\u001b[38;5;132;01m{\u001b[39;00m\u001b[38;5;28mself\u001b[39m\u001b[38;5;241m.\u001b[39mget_name()\u001b[38;5;132;01m}\u001b[39;00m\u001b[38;5;124m\"\u001b[39m\n\u001b[1;32m   3114\u001b[0m )\n\u001b[1;32m   3116\u001b[0m poa_state \u001b[38;5;241m=\u001b[39m \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mNascent\u001b[39m\u001b[38;5;124m\"\u001b[39m\n",
      "\u001b[0;31mException\u001b[0m: Failed to issue POA - numainfo Error (500)\nReason: INTERNAL SERVER ERROR\nHTTP response headers: HTTPHeaderDict({'Server': 'nginx/1.21.6', 'Date': 'Mon, 01 Apr 2024 21:01:09 GMT', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '306', 'Connection': 'keep-alive', 'Access-Control-Allow-Credentials': 'true', 'Access-Control-Allow-Headers': 'DNT, User-Agent, X-Requested-With, If-Modified-Since, Cache-Control, Content-Type, Range, Authorization', 'Access-Control-Allow-Methods': 'GET, POST, PUT, PATCH, DELETE, OPTIONS', 'Access-Control-Allow-Origin': '*', 'Access-Control-Expose-Headers': 'Content-Length, Content-Range, X-Error', 'X-Error': 'Failed to trigger POA: error: Reservation has a pending operation. Internal Error occurrederror: Reservation has a pending operation'})\nHTTP response body: b'{\\n    \"errors\": [\\n        {\\n            \"details\": \"Failed to trigger POA: error: Reservation has a pending operation. Internal Error occurrederror: Reservation has a pending operation\",\\n            \"message\": \"Internal Server Error\"\\n        }\\n    ],\\n    \"size\": 1,\\n    \"status\": 500,\\n    \"type\": \"error\"\\n}'\n"
     ]
    }
   ],
   "source": [
    "server1.pin_cpu(component_name='nic')\n",
    "server2.pin_cpu(component_name='nic2')\n",
    "server3.pin_cpu(component_name='nic3')\n",
    "    \n",
    "# User can also pass in the range of the vCPUs to be pinned \n",
    "#node.pin_cpu(component_name=nic_name, cpu_range_to_pin=\"0-3\")\n",
    "    \n",
    "# Pin memmory for VM to same Numa node as the components\n",
    "server1.numa_tune()\n",
    "server2.numa_tune()\n",
    "server3.numa_tune()\n",
    "        \n",
    "# Reboot the VM\n",
    "# .os_reboot()"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "140c3d65-b23a-406b-a634-c9a58a663287",
   "metadata": {
    "jp-MarkdownHeadingCollapsed": true,
    "tags": []
   },
   "source": [
    "### Reboot servers"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "id": "8418925d-b005-454d-acd2-7cc4b10ba045",
   "metadata": {},
   "outputs": [
    {
     "ename": "Exception",
     "evalue": "Failed to issue POA - reboot Error (500)\nReason: INTERNAL SERVER ERROR\nHTTP response headers: HTTPHeaderDict({'Server': 'nginx/1.21.6', 'Date': 'Mon, 01 Apr 2024 21:03:09 GMT', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '306', 'Connection': 'keep-alive', 'Access-Control-Allow-Credentials': 'true', 'Access-Control-Allow-Headers': 'DNT, User-Agent, X-Requested-With, If-Modified-Since, Cache-Control, Content-Type, Range, Authorization', 'Access-Control-Allow-Methods': 'GET, POST, PUT, PATCH, DELETE, OPTIONS', 'Access-Control-Allow-Origin': '*', 'Access-Control-Expose-Headers': 'Content-Length, Content-Range, X-Error', 'X-Error': 'Failed to trigger POA: error: Reservation has a pending operation. Internal Error occurrederror: Reservation has a pending operation'})\nHTTP response body: b'{\\n    \"errors\": [\\n        {\\n            \"details\": \"Failed to trigger POA: error: Reservation has a pending operation. Internal Error occurrederror: Reservation has a pending operation\",\\n            \"message\": \"Internal Server Error\"\\n        }\\n    ],\\n    \"size\": 1,\\n    \"status\": 500,\\n    \"type\": \"error\"\\n}'\n",
     "output_type": "error",
     "traceback": [
      "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m",
      "\u001b[0;31mException\u001b[0m                                 Traceback (most recent call last)",
      "Cell \u001b[0;32mIn[14], line 3\u001b[0m\n\u001b[1;32m      1\u001b[0m server1\u001b[38;5;241m.\u001b[39mos_reboot()\n\u001b[1;32m      2\u001b[0m server2\u001b[38;5;241m.\u001b[39mos_reboot()\n\u001b[0;32m----> 3\u001b[0m \u001b[43mserver3\u001b[49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43mos_reboot\u001b[49m\u001b[43m(\u001b[49m\u001b[43m)\u001b[49m\n",
      "File \u001b[0;32m/opt/conda/lib/python3.10/site-packages/fabrictestbed_extensions/fablib/node.py:3326\u001b[0m, in \u001b[0;36mNode.os_reboot\u001b[0;34m(self)\u001b[0m\n\u001b[1;32m   3322\u001b[0m \u001b[38;5;28;01mdef\u001b[39;00m \u001b[38;5;21mos_reboot\u001b[39m(\u001b[38;5;28mself\u001b[39m):\n\u001b[1;32m   3323\u001b[0m \u001b[38;5;250m    \u001b[39m\u001b[38;5;124;03m\"\"\"\u001b[39;00m\n\u001b[1;32m   3324\u001b[0m \u001b[38;5;124;03m    Reboot the node.\u001b[39;00m\n\u001b[1;32m   3325\u001b[0m \u001b[38;5;124;03m    \"\"\"\u001b[39;00m\n\u001b[0;32m-> 3326\u001b[0m     status \u001b[38;5;241m=\u001b[39m \u001b[38;5;28;43mself\u001b[39;49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43mpoa\u001b[49m\u001b[43m(\u001b[49m\u001b[43moperation\u001b[49m\u001b[38;5;241;43m=\u001b[39;49m\u001b[38;5;124;43m\"\u001b[39;49m\u001b[38;5;124;43mreboot\u001b[39;49m\u001b[38;5;124;43m\"\u001b[39;49m\u001b[43m)\u001b[49m\n\u001b[1;32m   3327\u001b[0m     \u001b[38;5;28;01mif\u001b[39;00m status \u001b[38;5;241m==\u001b[39m \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mFailed\u001b[39m\u001b[38;5;124m\"\u001b[39m:\n\u001b[1;32m   3328\u001b[0m         \u001b[38;5;28;01mraise\u001b[39;00m \u001b[38;5;167;01mException\u001b[39;00m(\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mFailed to reboot the server\u001b[39m\u001b[38;5;124m\"\u001b[39m)\n",
      "File \u001b[0;32m/opt/conda/lib/python3.10/site-packages/fabrictestbed_extensions/fablib/node.py:3110\u001b[0m, in \u001b[0;36mNode.poa\u001b[0;34m(self, operation, vcpu_cpu_map, node_set, keys)\u001b[0m\n\u001b[1;32m   3108\u001b[0m logger \u001b[38;5;241m=\u001b[39m logging\u001b[38;5;241m.\u001b[39mgetLogger()\n\u001b[1;32m   3109\u001b[0m \u001b[38;5;28;01mif\u001b[39;00m status \u001b[38;5;241m!=\u001b[39m Status\u001b[38;5;241m.\u001b[39mOK:\n\u001b[0;32m-> 3110\u001b[0m     \u001b[38;5;28;01mraise\u001b[39;00m \u001b[38;5;167;01mException\u001b[39;00m(\u001b[38;5;124mf\u001b[39m\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mFailed to issue POA - \u001b[39m\u001b[38;5;132;01m{\u001b[39;00moperation\u001b[38;5;132;01m}\u001b[39;00m\u001b[38;5;124m Error \u001b[39m\u001b[38;5;132;01m{\u001b[39;00mpoa_info\u001b[38;5;132;01m}\u001b[39;00m\u001b[38;5;124m\"\u001b[39m)\n\u001b[1;32m   3112\u001b[0m logger\u001b[38;5;241m.\u001b[39minfo(\n\u001b[1;32m   3113\u001b[0m     \u001b[38;5;124mf\u001b[39m\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mPOA \u001b[39m\u001b[38;5;132;01m{\u001b[39;00mpoa_info[\u001b[38;5;241m0\u001b[39m]\u001b[38;5;241m.\u001b[39mpoa_id\u001b[38;5;132;01m}\u001b[39;00m\u001b[38;5;124m/\u001b[39m\u001b[38;5;132;01m{\u001b[39;00moperation\u001b[38;5;132;01m}\u001b[39;00m\u001b[38;5;124m submitted for \u001b[39m\u001b[38;5;132;01m{\u001b[39;00m\u001b[38;5;28mself\u001b[39m\u001b[38;5;241m.\u001b[39mget_reservation_id()\u001b[38;5;132;01m}\u001b[39;00m\u001b[38;5;124m/\u001b[39m\u001b[38;5;132;01m{\u001b[39;00m\u001b[38;5;28mself\u001b[39m\u001b[38;5;241m.\u001b[39mget_name()\u001b[38;5;132;01m}\u001b[39;00m\u001b[38;5;124m\"\u001b[39m\n\u001b[1;32m   3114\u001b[0m )\n\u001b[1;32m   3116\u001b[0m poa_state \u001b[38;5;241m=\u001b[39m \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mNascent\u001b[39m\u001b[38;5;124m\"\u001b[39m\n",
      "\u001b[0;31mException\u001b[0m: Failed to issue POA - reboot Error (500)\nReason: INTERNAL SERVER ERROR\nHTTP response headers: HTTPHeaderDict({'Server': 'nginx/1.21.6', 'Date': 'Mon, 01 Apr 2024 21:03:09 GMT', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '306', 'Connection': 'keep-alive', 'Access-Control-Allow-Credentials': 'true', 'Access-Control-Allow-Headers': 'DNT, User-Agent, X-Requested-With, If-Modified-Since, Cache-Control, Content-Type, Range, Authorization', 'Access-Control-Allow-Methods': 'GET, POST, PUT, PATCH, DELETE, OPTIONS', 'Access-Control-Allow-Origin': '*', 'Access-Control-Expose-Headers': 'Content-Length, Content-Range, X-Error', 'X-Error': 'Failed to trigger POA: error: Reservation has a pending operation. Internal Error occurrederror: Reservation has a pending operation'})\nHTTP response body: b'{\\n    \"errors\": [\\n        {\\n            \"details\": \"Failed to trigger POA: error: Reservation has a pending operation. Internal Error occurrederror: Reservation has a pending operation\",\\n            \"message\": \"Internal Server Error\"\\n        }\\n    ],\\n    \"size\": 1,\\n    \"status\": 500,\\n    \"type\": \"error\"\\n}'\n"
     ]
    }
   ],
   "source": [
    "server1.os_reboot()\n",
    "server2.os_reboot()\n",
    "server3.os_reboot()"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "fb41eb0e-ccfa-45c7-aad1-fa52fd493c3a",
   "metadata": {
    "jp-MarkdownHeadingCollapsed": true,
    "tags": []
   },
   "source": [
    "### Install needed dependencies"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "id": "c2779300-9bb6-4605-9f63-b1d8796607ce",
   "metadata": {},
   "outputs": [],
   "source": [
    "stdout, stderr = server1.execute(f'sudo apt-get update', quiet = True)\n",
    "stdout, stderr = server1.execute(f'sudo apt-get install -y build-essential', quiet = True)\n",
    "stdout, stderr = server1.execute(f'sudo apt-get install -y python3-pip', quiet = True)\n",
    "stdout, stderr = server1.execute(f'sudo pip3 install meson ninja', quiet = True)\n",
    "stdout, stderr = server1.execute(f'sudo apt install -y python3-pyelftools', quiet = True)\n",
    "stdout, stderr = server1.execute(f'sudo apt install -y libnuma-dev', quiet = True)\n",
    "stdout, stderr = server1.execute(f'sudo apt install -y pkg-config', quiet = True)\n",
    "stdout, stderr = server1.execute(f'sudo apt install net-tools', quiet = True)\n",
    "stdout, stderr = server1.execute(f'sudo apt install iperf3', quiet = True)\n",
    "stdout, stderr = server1.execute(f'sudo apt install hping3', quiet = True)\n",
    "stdout, stderr = server1.execute(f'sudo apt install tcpdump', quiet = True)\n",
    "\n",
    "#stdout, stderr = server1.execute(f'sudo echo 1024 > /sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "id": "5585a4a4-1416-4088-a23d-25d81ccccfb3",
   "metadata": {},
   "outputs": [],
   "source": [
    "stdout, stderr = server2.execute(f'sudo apt-get update', quiet = True)\n",
    "stdout, stderr = server2.execute(f'sudo apt-get install -y build-essential', quiet = True)\n",
    "stdout, stderr = server2.execute(f'sudo apt-get install -y python3-pip', quiet = True)\n",
    "stdout, stderr = server2.execute(f'sudo pip3 install meson ninja', quiet = True)\n",
    "stdout, stderr = server2.execute(f'sudo apt install -y python3-pyelftools', quiet = True)\n",
    "stdout, stderr = server2.execute(f'sudo apt install -y libnuma-dev', quiet = True)\n",
    "stdout, stderr = server2.execute(f'sudo apt install -y pkg-config', quiet = True)\n",
    "stdout, stderr = server2.execute(f'sudo apt install net-tools', quiet = True)\n",
    "stdout, stderr = server2.execute(f'sudo apt install iperf3', quiet = True)\n",
    "stdout, stderr = server2.execute(f'sudo apt install hping3', quiet = True)\n",
    "stdout, stderr = server2.execute(f'sudo apt install tcpdump', quiet = True)\n",
    "\n",
    "#stdout, stderr = server1.execute(f'sudo echo 1024 > /sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "id": "94b94191-7899-497b-99b4-5de3cfee4195",
   "metadata": {},
   "outputs": [],
   "source": [
    "stdout, stderr = server3.execute(f'sudo apt-get update', quiet = True)\n",
    "stdout, stderr = server3.execute(f'sudo apt-get install -y build-essential', quiet = True)\n",
    "stdout, stderr = server3.execute(f'sudo apt-get install -y python3-pip', quiet = True)\n",
    "stdout, stderr = server3.execute(f'sudo pip3 install meson ninja', quiet = True)\n",
    "stdout, stderr = server3.execute(f'sudo apt install -y python3-pyelftools', quiet = True)\n",
    "stdout, stderr = server3.execute(f'sudo apt install -y libnuma-dev', quiet = True)\n",
    "stdout, stderr = server3.execute(f'sudo apt install -y pkg-config', quiet = True)\n",
    "stdout, stderr = server3.execute(f'sudo apt install net-tools', quiet = True)\n",
    "stdout, stderr = server3.execute(f'sudo apt install iperf3', quiet = True)\n",
    "stdout, stderr = server3.execute(f'sudo apt install hping3', quiet = True)\n",
    "stdout, stderr = server3.execute(f'sudo apt install tcpdump', quiet = True)\n",
    "\n",
    "#stdout, stderr = server1.execute(f'sudo echo 1024 > /sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "52b6def8-e9a1-4f37-ab3b-a2373ae83eaa",
   "metadata": {
    "jp-MarkdownHeadingCollapsed": true,
    "tags": []
   },
   "source": [
    "### Download, unzip and install Mellanox libraries and enable DPDK"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "id": "943f662c-fd1e-474b-86fa-8319c2e7c5f4",
   "metadata": {},
   "outputs": [],
   "source": [
    "stdout, stderr = server1.execute(f'wget https://content.mellanox.com/ofed/MLNX_OFED-23.07-0.5.0.0/MLNX_OFED_LINUX-23.07-0.5.0.0-ubuntu20.04-x86_64.tgz', quiet = True)\n",
    "stdout, stderr = server1.execute(f'tar xvfz MLNX_OFED_LINUX-23.07-0.5.0.0-ubuntu20.04-x86_64.tgz', quiet=True)\n",
    "stdout, stderr = server1.execute(f'cd MLNX_OFED_LINUX-23.07-0.5.0.0-ubuntu20.04-x86_64 && echo \"y\" | sudo ./mlnxofedinstall --upstream-libs --dpdk --basic --without-fw-update', quiet=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "id": "4c82ae6f-2faf-44d8-b03d-c48e58e3ca01",
   "metadata": {},
   "outputs": [],
   "source": [
    "stdout, stderr = server2.execute(f'wget https://content.mellanox.com/ofed/MLNX_OFED-23.07-0.5.0.0/MLNX_OFED_LINUX-23.07-0.5.0.0-ubuntu20.04-x86_64.tgz', quiet = True)\n",
    "stdout, stderr = server2.execute(f'tar xvfz MLNX_OFED_LINUX-23.07-0.5.0.0-ubuntu20.04-x86_64.tgz', quiet=True)\n",
    "stdout, stderr = server2.execute(f'cd MLNX_OFED_LINUX-23.07-0.5.0.0-ubuntu20.04-x86_64 && echo \"y\" | sudo ./mlnxofedinstall --upstream-libs --dpdk --basic --without-fw-update', quiet=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "id": "272fc2cb-fffe-482a-8c75-8977ab3b1723",
   "metadata": {},
   "outputs": [],
   "source": [
    "stdout, stderr = server3.execute(f'wget https://content.mellanox.com/ofed/MLNX_OFED-23.07-0.5.0.0/MLNX_OFED_LINUX-23.07-0.5.0.0-ubuntu20.04-x86_64.tgz', quiet = True)\n",
    "stdout, stderr = server3.execute(f'tar xvfz MLNX_OFED_LINUX-23.07-0.5.0.0-ubuntu20.04-x86_64.tgz', quiet=True)\n",
    "stdout, stderr = server3.execute(f'cd MLNX_OFED_LINUX-23.07-0.5.0.0-ubuntu20.04-x86_64 && echo \"y\" | sudo ./mlnxofedinstall --upstream-libs --dpdk --basic --without-fw-update', quiet=True)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "1174b961-74cc-4b35-bbbf-b28bb7455943",
   "metadata": {
    "jp-MarkdownHeadingCollapsed": true,
    "tags": []
   },
   "source": [
    "### Clone, build and install DPDK"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "id": "bc8de722-aadc-4c36-89aa-5303f8c19b8d",
   "metadata": {},
   "outputs": [],
   "source": [
    "stdout, stderr = server1.execute(f'git clone http://dpdk.org/git/dpdk', quiet = True)\n",
    "stdout, stderr = server1.execute(f'cd dpdk &&  sudo meson build && cd build && sudo ninja && sudo ninja install && sudo ldconfig', quiet = True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "id": "a9b0212f-2e36-447b-b677-d23937caecfb",
   "metadata": {},
   "outputs": [],
   "source": [
    "# stdout, stderr = server2.execute(f'git clone http://dpdk.org/git/dpdk', quiet = True)\n",
    "stdout, stderr = server2.execute(f'git clone https://github.com/ekfoury/dpdk.git', quiet = True)\n",
    "stdout, stderr = server2.execute(f'cd dpdk &&  sudo meson build && cd build && sudo ninja && sudo ninja install && sudo ldconfig', quiet = True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "id": "f003be77-0540-4550-8e85-f86857874e73",
   "metadata": {},
   "outputs": [],
   "source": [
    "stdout, stderr = server3.execute(f'git clone http://dpdk.org/git/dpdk', quiet = True)\n",
    "stdout, stderr = server3.execute(f'cd dpdk &&  sudo meson build && cd build && sudo ninja && sudo ninja install && sudo ldconfig', quiet = True)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "f14ca09e-3423-46b4-988e-8082cbad7270",
   "metadata": {
    "jp-MarkdownHeadingCollapsed": true,
    "tags": []
   },
   "source": [
    "### Restart to enable configuration (mlnx)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "id": "f6fb844e-e25f-4d7c-a330-64022675c340",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Unloading HCA driver:\u001b[60G[  \u001b[1;32mOK\u001b[0;39m  ]\n",
      "\u001b[31m sudo: unable to resolve host server1: Name or service not known\n",
      " \u001b[0mLoading HCA driver and Access Layer:\u001b[60G[  \u001b[1;32mOK\u001b[0;39m  ]\n"
     ]
    }
   ],
   "source": [
    "stdout, stderr = server1.execute(f'sudo /etc/init.d/openibd restart')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "id": "40b2616f-da51-4bbe-b7f3-41d8d9632fad",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Unloading HCA driver:\u001b[60G[  \u001b[1;32mOK\u001b[0;39m  ]\n",
      "\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0mLoading HCA driver and Access Layer:\u001b[60G[  \u001b[1;32mOK\u001b[0;39m  ]\n"
     ]
    }
   ],
   "source": [
    "stdout, stderr = server2.execute(f'sudo /etc/init.d/openibd restart')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "id": "f79e255b-1664-4e2a-9cf8-e3d0d15794d2",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Unloading HCA driver:\u001b[60G[  \u001b[1;32mOK\u001b[0;39m  ]\n",
      "\u001b[31m sudo: unable to resolve host server3: Name or service not known\n",
      " \u001b[0mLoading HCA driver and Access Layer:\u001b[60G[  \u001b[1;32mOK\u001b[0;39m  ]\n"
     ]
    }
   ],
   "source": [
    "stdout, stderr = server3.execute(f'sudo /etc/init.d/openibd restart')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "35d86e35-0e30-40b7-a04b-e488672a0f77",
   "metadata": {
    "tags": []
   },
   "source": [
    "# Step 5: Setup pipeline on server 2"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "dd8b969b-1a1e-46ce-b41a-b4579f25896d",
   "metadata": {
    "tags": []
   },
   "source": [
    "## Run the Cmake file of the dpdk pipeline"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "id": "9ae2dde7-d909-4b1d-9cfc-9f98c591f70e",
   "metadata": {},
   "outputs": [],
   "source": [
    "stdout, stderr = server2.execute(f'cd dpdk/examples/pipeline && sudo make', quiet=True)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "2cc204f1-f56f-47a7-8567-59e16f5792b6",
   "metadata": {},
   "source": [
    "## Upload the needed files to run the pipeline to the server\n",
    "Before running this block make sure you edit the .io and .cli files"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "id": "dfb835c4-56f2-41a7-8dff-4956af2e41f6",
   "metadata": {},
   "outputs": [],
   "source": [
    "# server2.upload_file('test.p4','test.p4')\n",
    "# server2.upload_file('test.cli','test.cli')\n",
    "# server2.upload_file('ethdev.io','ethdev.io')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "f90ee2e8-04fc-4bd6-83b1-ef9de6a2e3c4",
   "metadata": {},
   "source": [
    "## Setup the p4c compiler"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "id": "57e05849-0060-4036-b311-961a044b6928",
   "metadata": {
    "tags": []
   },
   "outputs": [],
   "source": [
    "stdout, stderr = server2.execute('source /etc/lsb-release && echo \"deb http://download.opensuse.org/repositories/home:/p4lang/xUbuntu_${DISTRIB_RELEASE}/ /\" | sudo tee /etc/apt/sources.list.d/home:p4lang.list && curl -fsSL https://download.opensuse.org/repositories/home:p4lang/xUbuntu_${DISTRIB_RELEASE}/Release.key | gpg --dearmor | sudo tee /etc/apt/trusted.gpg.d/home_p4lang.gpg > /dev/null && sudo apt-get update && sudo apt install -y p4lang-p4c', quiet = True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "id": "cf7560df-c090-454c-8a73-df615356981c",
   "metadata": {},
   "outputs": [],
   "source": [
    "# stdout, stderr = server1.execute(f'sudo p4c-dpdk --arch=psa test.p4 -o test.spec && cp test.spec dpdk/examples/pipeline/examples/ && cp ethdev.io dpdk/examples/pipeline/examples/')\n",
    "# stdout, stderr = server1.execute(f'cp test.cli dpdk/examples/pipeline/examples/')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "126ffed0-69ce-446e-b6c7-522f11f4aec1",
   "metadata": {},
   "source": [
    "## Reserve memory resources"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "id": "01aa2ce7-9be5-4084-9aaa-2b9ff0b143cd",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[31m sudo: unable to resolve host server1: Name or service not known\n",
      " \u001b[0m"
     ]
    }
   ],
   "source": [
    "stdout, stderr = server1.execute(f' sudo sh -c  \"echo 1024 > /sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages\"')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "413c4ecb-498c-4faa-b810-65a14a14a14f",
   "metadata": {},
   "source": [
    "2048"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "id": "d69e159e-c34a-4fc5-b1c2-d1e177b361c5",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m"
     ]
    }
   ],
   "source": [
    "stdout, stderr = server2.execute(f' sudo sh -c  \"echo 1024 > /sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages\"')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "id": "c4fb6dd2-53ba-4b0e-a836-d368c27cfc93",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[31m sudo: unable to resolve host server3: Name or service not known\n",
      " \u001b[0m"
     ]
    }
   ],
   "source": [
    "stdout, stderr = server3.execute(f' sudo sh -c  \"echo 1024 > /sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages\"')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "b5de3dd5-2d03-45bb-aac5-30195ef623fd",
   "metadata": {},
   "source": [
    "## (in server 2 terminal) run MLNX Commands"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "id": "15800803-dfbd-4560-a3c0-7d8833741fff",
   "metadata": {},
   "outputs": [],
   "source": [
    "# stdout, stderr = server2.execute(f'sudo ibdev2netdev')\n",
    "# stdout, stderr = server2.execute(f'sudo mst status')\n",
    "# stdout, stderr = server2.execute(f'sudo mst start')\n",
    "# stdout, stderr = server2.execute(f'sudo mst status')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "b5c2564d-3780-42f0-bf29-f52499f6c223",
   "metadata": {
    "jp-MarkdownHeadingCollapsed": true,
    "tags": []
   },
   "source": [
    "# Step 6: Setup communication requirements on servers"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "d1e97f2a-43e9-465b-86a0-e81244728fbe",
   "metadata": {
    "tags": []
   },
   "source": [
    "## Set IP Addresses on all servers\n",
    "use \"ifconfig\" to see turned-up interfaces\n",
    "\n",
    "use \"lspci\" to see connected interfaces \n",
    "\n",
    "use \"ip link\" to know the correct interface name\n",
    "\n",
    "use \"ip route\" to see routing table\n",
    "\n",
    "use \"arp\" to see arp routes"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "id": "866535ba-4d0f-4458-975d-0d8bedeb4d92",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[31m sudo: unable to resolve host server1: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server1: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server1: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server1: Name or service not known\n",
      " \u001b[0m"
     ]
    }
   ],
   "source": [
    "server1 = slice.get_node(name=\"server1\")     \n",
    "\n",
    "stdout, stderr = server1.execute(f'sudo apt-get update && sudo apt-get install -y net-tools', quiet=True)\n",
    "stdout, stderr = server1.execute(f'sudo ip link set dev enp7s0np0 up')\n",
    "stdout, stderr = server1.execute(f'sudo ifconfig enp7s0np0 198.18.0.10/24')\n",
    "stdout, stderr = server1.execute(f'sudo ifconfig enp7s0np0 hw ether 00:10:00:00:00:00')\n",
    "stdout, stderr = server1.execute(f'sudo arp -s 198.18.0.20 00:21:00:00:00:00')\n",
    "#stdout, stderr = server1.execute(f'sudo hping3 198.18.0.20 --flood --data 1460') #use multi process, nload, htop\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "id": "6a7c0bca-a67f-4eef-88e4-d7ef1b5c8021",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m"
     ]
    }
   ],
   "source": [
    "server2 = slice.get_node(name=\"server2\")     \n",
    "\n",
    "stdout, stderr = server2.execute(f'sudo apt-get update && sudo apt-get install -y net-tools', quiet=True)\n",
    "\n",
    "stdout, stderr = server2.execute(f'sudo ip link set dev enp7s0np0 up')\n",
    "stdout, stderr = server2.execute(f'sudo ifconfig enp7s0np0 198.18.0.20/24')\n",
    "stdout, stderr = server2.execute(f'sudo ifconfig enp7s0np0 hw ether 00:21:00:00:00:00')\n",
    "\n",
    "stdout, stderr = server2.execute(f'sudo ip link set dev enp8s0np1 up')\n",
    "stdout, stderr = server2.execute(f'sudo ifconfig enp8s0np1 198.18.1.20/24')\n",
    "stdout, stderr = server2.execute(f'sudo ifconfig enp8s0np1 hw ether 00:22:00:00:00:00')\n",
    "\n",
    "stdout, stderr = server2.execute(f'sudo arp -s 198.18.0.10 00:10:00:00:00:00')\n",
    "stdout, stderr = server2.execute(f'sudo arp -s 198.18.1.30 00:30:00:00:00:00')\n",
    "#stdout, stderr = server2.execute(f'sudo hping3 198.18.0.20 --flood --data 1460') #use multi process, nload, htop\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "id": "9aa915bf-cbd8-4ff5-a979-7a9590ecba62",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[31m sudo: unable to resolve host server3: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server3: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server3: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server3: Name or service not known\n",
      " \u001b[0m"
     ]
    }
   ],
   "source": [
    "server3 = slice.get_node(name=\"server3\")     \n",
    "\n",
    "stdout, stderr = server3.execute(f'sudo apt-get update && sudo apt-get install -y net-tools', quiet=True)\n",
    "stdout, stderr = server3.execute(f'sudo ip link set dev enp7s0np0 up')\n",
    "stdout, stderr = server3.execute(f'sudo ifconfig enp7s0np0 198.18.1.30/24')\n",
    "stdout, stderr = server3.execute(f'sudo ifconfig enp7s0np0 hw ether 00:30:00:00:00:00')\n",
    "stdout, stderr = server3.execute(f'sudo arp -s 198.18.1.20 00:22:00:00:00:00')\n",
    "#stdout, stderr = server3.execute(f'sudo hping3 198.18.0.20 --flood --data 1460') #use multi process, nload, htop\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 45,
   "id": "b075f3cc-d695-4d8b-b376-c416cdaa375f",
   "metadata": {},
   "outputs": [],
   "source": [
    "# stdout, stderr = server3.execute(f'sudo ip link set dev enp8s0np1 down')\n",
    "# stdout, stderr = server3.execute(f'sudo ifconfig enp8s0np1 198.18.2.30/24')\n",
    "# stdout, stderr = server3.execute(f'sudo ifconfig enp8s0np1 hw ether 00:32:00:00:00:00')\n",
    "# stdout, stderr = server3.execute(f'sudo arp -s 198.18.1.20 00:22:00:00:00:00')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "121e9ddb-3b61-4329-8acf-e3dc40f59ebe",
   "metadata": {},
   "source": [
    "## Download PCAP file on servers 1 & 3 (use terminal)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 40,
   "id": "2f911d75-d91f-4712-9168-9e31b3f30f12",
   "metadata": {},
   "outputs": [],
   "source": [
    "stdout, stderr = server1.execute(f' sudo wget http://mawi.nezu.wide.ad.jp/mawi/samplepoint-F/2024/202401011400.pcap.gz', quiet = True)\n",
    "stdout, stderr = server1.execute(f'gzip -dk 202401011400.pcap.gz', quiet=True)\n",
    "# stdout, stderr = server1.execute(f'tcpdump -qns 0 -X -r 202401011400.pcap', quiet=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "f4062e57-2236-4312-b1b0-2c57587d2f40",
   "metadata": {},
   "outputs": [],
   "source": [
    "stdout, stderr = server3.execute(f'sudo wget http://mawi.nezu.wide.ad.jp/mawi/samplepoint-F/2024/202401011400.pcap.gz', quiet = True)\n",
    "stdout, stderr = server3.execute(f'gzip -dk 202401011400.pcap.gz', quiet=True)\n",
    "# stdout, stderr = server3.execute(f'tcpdump -qns 0 -X -r 202401011400.pcap', quiet=True)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "58111b86-c38e-45fb-9b84-f9c5065728ee",
   "metadata": {
    "jp-MarkdownHeadingCollapsed": true,
    "tags": []
   },
   "source": [
    "## Clone Pktgen-DPDK on servers 1 & 3"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "id": "9af37c5f-57f4-487c-bd35-2a509d82001b",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[31m sudo: unable to resolve host server1: Name or service not known\n",
      "Cloning into 'Pktgen-DPDK'...\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server1: Name or service not known\n",
      " \u001b[0m"
     ]
    }
   ],
   "source": [
    "stdout, stderr = server1.execute(f'sudo git clone https://github.com/pktgen/Pktgen-DPDK')\n",
    "stdout, stderr = server1.execute(\"sudo sed -i '40s/.*/deps += [dependency('\\'numa\\'', required: false)]/' /home/ubuntu/Pktgen-DPDK/app/meson.build\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "id": "766d947f-bfb4-4776-8f7a-b03b83ebfc7b",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[31m sudo: unable to resolve host server3: Name or service not known\n",
      "Cloning into 'Pktgen-DPDK'...\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server3: Name or service not known\n",
      " \u001b[0m"
     ]
    }
   ],
   "source": [
    "stdout, stderr = server3.execute(f'sudo git clone https://github.com/pktgen/Pktgen-DPDK')\n",
    "stdout, stderr = server3.execute(\"sudo sed -i '40s/.*/deps += [dependency('\\'numa\\'', required: false)]/' /home/ubuntu/Pktgen-DPDK/app/meson.build\")"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "6484b73d-87de-4e13-a339-2f51c58aeda5",
   "metadata": {},
   "source": [
    "For the second instruction, make sure there is single quotes around numa in the file (to make changes, run in server 1terminal: cd Pktgen-DPDK/app && sudo vim meson.build)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 35,
   "id": "e4ac14c1-6380-4ae8-9010-b85106f076ca",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Reading package lists...\n",
      "Building dependency tree...\u001b[31m sudo: unable to resolve host server1: Name or service not known\n",
      " \u001b[0m\n",
      "Reading state information...\n",
      "The following additional packages will be installed:\n",
      "  cmake-data libjsoncpp1 librhash0\n",
      "Suggested packages:\n",
      "  cmake-doc ninja-build\n",
      "The following NEW packages will be installed:\n",
      "  cmake cmake-data libjsoncpp1 librhash0\n",
      "0 upgraded, 4 newly installed, 0 to remove and 74 not upgraded.\n",
      "Need to get 5470 kB of archives.\n",
      "After this operation, 28.3 MB of additional disk space will be used.\n",
      "Get:1 http://nova.clouds.archive.ubuntu.com/ubuntu focal-updates/main amd64 cmake-data all 3.16.3-1ubuntu1.20.04.1 [1613 kB]\n",
      "Get:2 http://nova.clouds.archive.ubuntu.com/ubuntu focal/main amd64 libjsoncpp1 amd64 1.7.4-3.1ubuntu2 [75.6 kB]\n",
      "Get:3 http://nova.clouds.archive.ubuntu.com/ubuntu focal/main amd64 librhash0 amd64 1.3.9-1 [113 kB]\n",
      "Get:4 http://nova.clouds.archive.ubuntu.com/ubuntu focal-updates/main amd64 cmake amd64 3.16.3-1ubuntu1.20.04.1 [3668 kB]\n",
      "\u001b[31m debconf: unable to initialize frontend: Dialog\n",
      "debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.)\n",
      "debconf: falling back to frontend: Readline\n",
      " \u001b[0m\u001b[31m debconf: unable to initialize frontend: Readline\n",
      "debconf: (This frontend requires a controlling tty.)\n",
      "debconf: falling back to frontend: Teletype\n",
      " \u001b[0m\u001b[31m dpkg-preconfigure: unable to re-open stdin: \n",
      " \u001b[0mFetched 5470 kB in 1s (4208 kB/s)\n",
      "Selecting previously unselected package cmake-data.\n",
      "(Reading database ... 77137 files and directories currently installed.)\n",
      "Preparing to unpack .../cmake-data_3.16.3-1ubuntu1.20.04.1_all.deb ...\n",
      "Unpacking cmake-data (3.16.3-1ubuntu1.20.04.1) ...\n",
      "Selecting previously unselected package libjsoncpp1:amd64.\n",
      "Preparing to unpack .../libjsoncpp1_1.7.4-3.1ubuntu2_amd64.deb ...\n",
      "Unpacking libjsoncpp1:amd64 (1.7.4-3.1ubuntu2) ...\n",
      "Selecting previously unselected package librhash0:amd64.\n",
      "Preparing to unpack .../librhash0_1.3.9-1_amd64.deb ...\n",
      "Unpacking librhash0:amd64 (1.3.9-1) ...\n",
      "Selecting previously unselected package cmake.\n",
      "Preparing to unpack .../cmake_3.16.3-1ubuntu1.20.04.1_amd64.deb ...\n",
      "Unpacking cmake (3.16.3-1ubuntu1.20.04.1) ...\n",
      "Setting up librhash0:amd64 (1.3.9-1) ...\n",
      "Setting up cmake-data (3.16.3-1ubuntu1.20.04.1) ...\n",
      "Setting up libjsoncpp1:amd64 (1.7.4-3.1ubuntu2) ...\n",
      "Setting up cmake (3.16.3-1ubuntu1.20.04.1) ...\n",
      "Processing triggers for man-db (2.9.1-1) ...\n",
      "Processing triggers for libc-bin (2.31-0ubuntu9.14) ...\n",
      "Reading package lists...\n",
      "\u001b[31m sudo: unable to resolve host server1: Name or service not known\n",
      " \u001b[0mBuilding dependency tree...\n",
      "Reading state information...\n",
      "The following additional packages will be installed:\n",
      "  libpcap0.8-dev\n",
      "The following NEW packages will be installed:\n",
      "  libpcap-dev libpcap0.8-dev\n",
      "0 upgraded, 2 newly installed, 0 to remove and 74 not upgraded.\n",
      "Need to get 248 kB of archives.\n",
      "After this operation, 852 kB of additional disk space will be used.\n",
      "Get:1 http://nova.clouds.archive.ubuntu.com/ubuntu focal/main amd64 libpcap0.8-dev amd64 1.9.1-3 [244 kB]\n",
      "Get:2 http://nova.clouds.archive.ubuntu.com/ubuntu focal/main amd64 libpcap-dev amd64 1.9.1-3 [3484 B]\n",
      "\u001b[31m debconf: unable to initialize frontend: Dialog\n",
      "debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.)\n",
      "debconf: falling back to frontend: Readline\n",
      " \u001b[0m\u001b[31m debconf: unable to initialize frontend: Readline\n",
      "debconf: (This frontend requires a controlling tty.)\n",
      "debconf: falling back to frontend: Teletype\n",
      " \u001b[0m\u001b[31m dpkg-preconfigure: unable to re-open stdin: \n",
      " \u001b[0mFetched 248 kB in 1s (271 kB/s)\n",
      "Selecting previously unselected package libpcap0.8-dev:amd64.\n",
      "(Reading database ... 79928 files and directories currently installed.)\n",
      "Preparing to unpack .../libpcap0.8-dev_1.9.1-3_amd64.deb ...\n",
      "Unpacking libpcap0.8-dev:amd64 (1.9.1-3) ...\n",
      "Selecting previously unselected package libpcap-dev:amd64.\n",
      "Preparing to unpack .../libpcap-dev_1.9.1-3_amd64.deb ...\n",
      "Unpacking libpcap-dev:amd64 (1.9.1-3) ...\n",
      "Setting up libpcap0.8-dev:amd64 (1.9.1-3) ...\n",
      "Setting up libpcap-dev:amd64 (1.9.1-3) ...\n",
      "Processing triggers for man-db (2.9.1-1) ...\n",
      "The Meson build system\n",
      "Version: 1.4.0\n",
      "Source dir: /home/ubuntu/Pktgen-DPDK\n",
      "Build dir: /home/ubuntu/Pktgen-DPDK/build\n",
      "Build type: native build\n",
      "Program cat found: YES (/usr/bin/cat)\n",
      "Project name: pktgen\n",
      "Project version: 24.03.1\n",
      "C compiler for the host machine: cc (gcc 9.4.0 \"cc (Ubuntu 9.4.0-1ubuntu1~20.04.2) 9.4.0\")\n",
      "C linker for the host machine: cc ld.bfd 2.34\n",
      "Host machine cpu family: x86_64\n",
      "Host machine cpu: x86_64\n",
      "Compiler for C supports arguments -mavx: YES \n",
      "Compiler for C supports arguments -mavx2: YES \n",
      "Compiler for C supports arguments -Wno-pedantic: YES \n",
      "Compiler for C supports arguments -Wno-format-truncation: YES \n",
      "Found pkg-config: YES (/usr/bin/pkg-config) 0.29.1\n",
      "Run-time dependency libdpdk found: YES 24.07.0-rc0\n",
      "Message: prefix: /usr/local libdir: lib/x86_64-linux-gnu\n",
      "Message: DPDK lib path: /usr/local/lib/x86_64-linux-gnu\n",
      "WARNING: find_library('librte_net_bond') starting in \"lib\" only works by accident and is not portable\n",
      "Library librte_net_bond found: YES\n",
      "Program python3 found: YES (/usr/bin/python3)\n",
      "Library rte_net_i40e found: YES\n",
      "Library rte_net_ixgbe found: YES\n",
      "Library rte_net_ice found: YES\n",
      "Library rte_bus_vdev found: YES\n",
      "Run-time dependency threads found: YES\n",
      "Found CMake: /usr/bin/cmake (3.16.3)\n",
      "DEPRECATION: CMake support for versions <3.17 is deprecated since Meson 0.62.0.\n",
      "|\n",
      "|   However, Meson was only able to find CMake 3.16.3.\n",
      "|\n",
      "|   Support for all CMake versions below 3.17.0 will be removed once\n",
      "|   newer CMake versions are more widely adopted. If you encounter\n",
      "|   any errors please try upgrading CMake to a newer version first.\n",
      "\n",
      "Run-time dependency numa found: NO (tried pkgconfig and cmake)\n",
      "Run-time dependency pcap found: YES 1.9.1\n",
      "Library dl found: YES\n",
      "Library m found: YES\n",
      "Program doxygen found: NO\n",
      "Program sphinx-build found: NO\n",
      "Build targets in project: 9\n",
      "NOTICE: Future-deprecated features used:\n",
      " * 0.56.0: {'dependency.get_pkgconfig_variable'}\n",
      "\n",
      "Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja\n",
      "WARNING: Running the setup command as `meson [options]` instead of `meson setup [options]` is ambiguous and deprecated.\n",
      "\u001b[31m sudo: unable to resolve host server1: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server1: Name or service not known\n",
      " \u001b[0mninja: Entering directory `build'\n",
      "[1/69] Compiling C object lib/common/libcommon.a.p/cmdline_parse_args.c.o\n",
      "[2/69] Compiling C object lib/cli/libcli.a.p/cli_cmap.c.o\n",
      "[3/69] Compiling C object lib/common/libcommon.a.p/coremap.c.o\n",
      "[4/69] Compiling C object lib/common/libcommon.a.p/core_info.c.o\n",
      "[5/69] Compiling C object lib/utils/libutils.a.p/heap.c.o\n",
      "[6/69] Compiling C object lib/utils/libutils.a.p/portlist.c.o\n",
      "[7/69] Compiling C object lib/common/libcommon.a.p/copyright_info.c.o\n",
      "[8/69] Compiling C object lib/common/libcommon.a.p/utils.c.o\n",
      "[9/69] Compiling C object lib/utils/libutils.a.p/_atoip.c.o\n",
      "[10/69] Compiling C object lib/common/libcommon.a.p/pg_pcap.c.o\n",
      "[11/69] Compiling C object lib/common/libcommon.a.p/port_config.c.o\n",
      "[12/69] Compiling C object lib/lua/liblua.a.p/lua_config.c.o\n",
      "[13/69] Linking static target lib/utils/libutils.a\n",
      "[14/69] Compiling C object lib/cli/libcli.a.p/cli_file.c.o\n",
      "[15/69] Compiling C object lib/common/libcommon.a.p/lscpu.c.o\n",
      "[16/69] Compiling C object lib/cli/libcli.a.p/cli_env.c.o\n",
      "[17/69] Compiling C object lib/fgen/libfgen.a.p/unparse.c.o\n",
      "[18/69] Linking static target lib/lua/liblua.a\n",
      "[19/69] Compiling C object lib/common/libcommon.a.p/l2p.c.o\n",
      "[20/69] Compiling C object lib/fgen/libfgen.a.p/fgen.c.o\n",
      "[21/69] Compiling C object lib/cli/libcli.a.p/cli_gapbuf.c.o\n",
      "[22/69] Compiling C object lib/vec/libvec.a.p/vec.c.o\n",
      "[23/69] Compiling C object lib/common/libcommon.a.p/pg_strings.c.o\n",
      "[24/69] Compiling C object lib/common/libcommon.a.p/cksum.c.o\n",
      "[25/69] Compiling C object lib/plugin/libplugin.a.p/plugin.c.o\n",
      "[26/69] Linking static target lib/vec/libvec.a\n",
      "[27/69] Linking static target lib/common/libcommon.a\n",
      "[28/69] Compiling C object lib/cli/libcli.a.p/cli_help.c.o\n",
      "[29/69] Linking static target lib/plugin/libplugin.a\n",
      "[30/69] Compiling C object lib/cli/libcli.a.p/cli_cmds.c.o\n",
      "[31/69] Compiling C object lib/cli/libcli.a.p/cli_auto_complete.c.o\n",
      "[32/69] Compiling C object lib/cli/libcli.a.p/cli_history.c.o\n",
      "[33/69] Compiling C object lib/cli/libcli.a.p/cli.c.o\n",
      "[34/69] Compiling C object lib/cli/libcli.a.p/cli_map.c.o\n",
      "[35/69] Compiling C object lib/cli/libcli.a.p/cli_scrn.c.o\n",
      "[36/69] Compiling C object lib/cli/libcli.a.p/cli_search.c.o\n",
      "[37/69] Compiling C object lib/cli/libcli.a.p/cli_input.c.o\n",
      "[38/69] Compiling C object lib/fgen/libfgen.a.p/parse.c.o\n",
      "[39/69] Compiling C object app/pktgen.p/pktgen-cfg.c.o\n",
      "[40/69] Compiling C object app/pktgen.p/pktgen-seq.c.o\n",
      "[41/69] Linking static target lib/fgen/libfgen.a\n",
      "[42/69] Compiling C object app/pktgen.p/pktgen-dump.c.o\n",
      "[43/69] Compiling C object app/pktgen.p/pktgen-cpu.c.o\n",
      "[44/69] Compiling C object app/pktgen.p/pktgen-ipv6.c.o\n",
      "[45/69] Compiling C object app/pktgen.p/pktgen-main.c.o\n",
      "[46/69] Compiling C object app/pktgen.p/pktgen-gre.c.o\n",
      "[47/69] Compiling C object app/pktgen.p/pktgen-pcap.c.o\n",
      "[48/69] Compiling C object app/pktgen.p/pktgen-capture.c.o\n",
      "[49/69] Compiling C object app/pktgen.p/pktgen-ether.c.o\n",
      "[50/69] Compiling C object lib/cli/libcli.a.p/cli_vt100.c.o\n",
      "[51/69] Linking static target lib/cli/libcli.a\n",
      "[52/69] Compiling C object app/pktgen.p/pktgen-range.c.o\n",
      "[53/69] Compiling C object app/pktgen.p/pktgen-ipv4.c.o\n",
      "[54/69] Compiling C object app/pktgen.p/pktgen-arp.c.o\n",
      "[55/69] Compiling C object app/pktgen.p/pktgen-tcp.c.o\n",
      "[56/69] Compiling C object app/pktgen.p/pktgen-stats.c.o\n",
      "[57/69] Compiling C object app/pktgen.p/pktgen-vlan.c.o\n",
      "[58/69] Compiling C object app/pktgen.p/pktgen-udp.c.o\n",
      "[59/69] Compiling C object app/pktgen.p/pktgen-port-cfg.c.o\n",
      "[60/69] Compiling C object app/pktgen.p/pktgen-random.c.o\n",
      "[61/69] Compiling C object app/pktgen.p/pktgen-gtpu.c.o\n",
      "[62/69] Compiling C object app/pktgen.p/pktgen-log.c.o\n",
      "[63/69] Compiling C object app/pktgen.p/pktgen-display.c.o\n",
      "[64/69] Compiling C object app/pktgen.p/pktgen-latency.c.o\n",
      "[65/69] Compiling C object app/pktgen.p/pktgen-rate.c.o\n",
      "[66/69] Compiling C object app/pktgen.p/pktgen.c.o\n",
      "[67/69] Compiling C object app/pktgen.p/cli-functions.c.o\n",
      "[68/69] Compiling C object app/pktgen.p/pktgen-cmds.c.o\n",
      "[69/69] Linking target app/pktgen\n",
      "\u001b[31m sudo: unable to resolve host server1: Name or service not known\n",
      " \u001b[0mninja: Entering directory `/home/ubuntu/Pktgen-DPDK/build'\n",
      "ninja: no work to do.\n",
      "Installing app/pktgen to /usr/local/bin\n"
     ]
    }
   ],
   "source": [
    "stdout, stderr = server1.execute(f'sudo apt-get install -y cmake')\n",
    "stdout, stderr = server1.execute(f'sudo apt-get install -y libpcap-dev')\n",
    "stdout, stderr = server1.execute(f'cd Pktgen-DPDK &&  sudo meson build && sudo ninja -C build && cd build/ && sudo meson install')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 36,
   "id": "a48f4abb-c151-416a-ae59-30f677d62928",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Reading package lists...\n",
      "\u001b[31m sudo: unable to resolve host server3: Name or service not known\n",
      " \u001b[0mBuilding dependency tree...\n",
      "Reading state information...\n",
      "The following additional packages will be installed:\n",
      "  cmake-data libjsoncpp1 librhash0\n",
      "Suggested packages:\n",
      "  cmake-doc ninja-build\n",
      "The following NEW packages will be installed:\n",
      "  cmake cmake-data libjsoncpp1 librhash0\n",
      "0 upgraded, 4 newly installed, 0 to remove and 74 not upgraded.\n",
      "Need to get 5470 kB of archives.\n",
      "After this operation, 28.3 MB of additional disk space will be used.\n",
      "Get:1 http://nova.clouds.archive.ubuntu.com/ubuntu focal-updates/main amd64 cmake-data all 3.16.3-1ubuntu1.20.04.1 [1613 kB]\n",
      "Get:2 http://nova.clouds.archive.ubuntu.com/ubuntu focal/main amd64 libjsoncpp1 amd64 1.7.4-3.1ubuntu2 [75.6 kB]\n",
      "Get:3 http://nova.clouds.archive.ubuntu.com/ubuntu focal/main amd64 librhash0 amd64 1.3.9-1 [113 kB]\n",
      "Get:4 http://nova.clouds.archive.ubuntu.com/ubuntu focal-updates/main amd64 cmake amd64 3.16.3-1ubuntu1.20.04.1 [3668 kB]\n",
      "\u001b[31m debconf: unable to initialize frontend: Dialog\n",
      "debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.)\n",
      "debconf: falling back to frontend: Readline\n",
      " \u001b[0m\u001b[31m debconf: unable to initialize frontend: Readline\n",
      "debconf: (This frontend requires a controlling tty.)\n",
      "debconf: falling back to frontend: Teletype\n",
      "dpkg-preconfigure: unable to re-open stdin: \n",
      " \u001b[0mFetched 5470 kB in 1s (4284 kB/s)\n",
      "Selecting previously unselected package cmake-data.\n",
      "(Reading database ... 77137 files and directories currently installed.)\n",
      "Preparing to unpack .../cmake-data_3.16.3-1ubuntu1.20.04.1_all.deb ...\n",
      "Unpacking cmake-data (3.16.3-1ubuntu1.20.04.1) ...\n",
      "Selecting previously unselected package libjsoncpp1:amd64.\n",
      "Preparing to unpack .../libjsoncpp1_1.7.4-3.1ubuntu2_amd64.deb ...\n",
      "Unpacking libjsoncpp1:amd64 (1.7.4-3.1ubuntu2) ...\n",
      "Selecting previously unselected package librhash0:amd64.\n",
      "Preparing to unpack .../librhash0_1.3.9-1_amd64.deb ...\n",
      "Unpacking librhash0:amd64 (1.3.9-1) ...\n",
      "Selecting previously unselected package cmake.\n",
      "Preparing to unpack .../cmake_3.16.3-1ubuntu1.20.04.1_amd64.deb ...\n",
      "Unpacking cmake (3.16.3-1ubuntu1.20.04.1) ...\n",
      "Setting up librhash0:amd64 (1.3.9-1) ...\n",
      "Setting up cmake-data (3.16.3-1ubuntu1.20.04.1) ...\n",
      "Setting up libjsoncpp1:amd64 (1.7.4-3.1ubuntu2) ...\n",
      "Setting up cmake (3.16.3-1ubuntu1.20.04.1) ...\n",
      "Processing triggers for man-db (2.9.1-1) ...\n",
      "Processing triggers for libc-bin (2.31-0ubuntu9.14) ...\n",
      "Reading package lists...\n",
      "Building dependency tree...\u001b[31m sudo: unable to resolve host server3: Name or service not known\n",
      " \u001b[0m\n",
      "Reading state information...\n",
      "The following additional packages will be installed:\n",
      "  libpcap0.8-dev\n",
      "The following NEW packages will be installed:\n",
      "  libpcap-dev libpcap0.8-dev\n",
      "0 upgraded, 2 newly installed, 0 to remove and 74 not upgraded.\n",
      "Need to get 248 kB of archives.\n",
      "After this operation, 852 kB of additional disk space will be used.\n",
      "Get:1 http://nova.clouds.archive.ubuntu.com/ubuntu focal/main amd64 libpcap0.8-dev amd64 1.9.1-3 [244 kB]\n",
      "Get:2 http://nova.clouds.archive.ubuntu.com/ubuntu focal/main amd64 libpcap-dev amd64 1.9.1-3 [3484 B]\n",
      "\u001b[31m debconf: unable to initialize frontend: Dialog\n",
      "debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.)\n",
      "debconf: falling back to frontend: Readline\n",
      " \u001b[0m\u001b[31m debconf: unable to initialize frontend: Readline\n",
      "debconf: (This frontend requires a controlling tty.)\n",
      "debconf: falling back to frontend: Teletype\n",
      " \u001b[0m\u001b[31m dpkg-preconfigure: unable to re-open stdin: \n",
      " \u001b[0mFetched 248 kB in 1s (269 kB/s)\n",
      "Selecting previously unselected package libpcap0.8-dev:amd64.\n",
      "(Reading database ... 79928 files and directories currently installed.)\n",
      "Preparing to unpack .../libpcap0.8-dev_1.9.1-3_amd64.deb ...\n",
      "Unpacking libpcap0.8-dev:amd64 (1.9.1-3) ...\n",
      "Selecting previously unselected package libpcap-dev:amd64.\n",
      "Preparing to unpack .../libpcap-dev_1.9.1-3_amd64.deb ...\n",
      "Unpacking libpcap-dev:amd64 (1.9.1-3) ...\n",
      "Setting up libpcap0.8-dev:amd64 (1.9.1-3) ...\n",
      "Setting up libpcap-dev:amd64 (1.9.1-3) ...\n",
      "Processing triggers for man-db (2.9.1-1) ...\n",
      "The Meson build system\n",
      "Version: 1.4.0\n",
      "Source dir: /home/ubuntu/Pktgen-DPDK\n",
      "Build dir: /home/ubuntu/Pktgen-DPDK/build\n",
      "Build type: native build\n",
      "Program cat found: YES (/usr/bin/cat)\n",
      "Project name: pktgen\n",
      "Project version: 24.03.1\n",
      "C compiler for the host machine: cc (gcc 9.4.0 \"cc (Ubuntu 9.4.0-1ubuntu1~20.04.2) 9.4.0\")\n",
      "C linker for the host machine: cc ld.bfd 2.34\n",
      "Host machine cpu family: x86_64\n",
      "Host machine cpu: x86_64\n",
      "Compiler for C supports arguments -mavx: YES \n",
      "Compiler for C supports arguments -mavx2: YES \n",
      "Compiler for C supports arguments -Wno-pedantic: YES \n",
      "Compiler for C supports arguments -Wno-format-truncation: YES \n",
      "Found pkg-config: YES (/usr/bin/pkg-config) 0.29.1\n",
      "Run-time dependency libdpdk found: YES 24.07.0-rc0\n",
      "Message: prefix: /usr/local libdir: lib/x86_64-linux-gnu\n",
      "Message: DPDK lib path: /usr/local/lib/x86_64-linux-gnu\n",
      "WARNING: find_library('librte_net_bond') starting in \"lib\" only works by accident and is not portable\n",
      "Library librte_net_bond found: YES\n",
      "Program python3 found: YES (/usr/bin/python3)\n",
      "Library rte_net_i40e found: YES\n",
      "Library rte_net_ixgbe found: YES\n",
      "Library rte_net_ice found: YES\n",
      "Library rte_bus_vdev found: YES\n",
      "Run-time dependency threads found: YES\n",
      "Found CMake: /usr/bin/cmake (3.16.3)\n",
      "DEPRECATION: CMake support for versions <3.17 is deprecated since Meson 0.62.0.\n",
      "|\n",
      "|   However, Meson was only able to find CMake 3.16.3.\n",
      "|\n",
      "|   Support for all CMake versions below 3.17.0 will be removed once\n",
      "|   newer CMake versions are more widely adopted. If you encounter\n",
      "|   any errors please try upgrading CMake to a newer version first.\n",
      "\n",
      "Run-time dependency numa found: NO (tried pkgconfig and cmake)\n",
      "Run-time dependency pcap found: YES 1.9.1\n",
      "Library dl found: YES\n",
      "Library m found: YES\n",
      "Program doxygen found: NO\n",
      "Program sphinx-build found: NO\n",
      "Build targets in project: 9\n",
      "NOTICE: Future-deprecated features used:\n",
      " * 0.56.0: {'dependency.get_pkgconfig_variable'}\n",
      "\n",
      "Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja\n",
      "WARNING: Running the setup command as `meson [options]` instead of `meson setup [options]` is ambiguous and deprecated.\n",
      "\u001b[31m sudo: unable to resolve host server3: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server3: Name or service not known\n",
      " \u001b[0mninja: Entering directory `build'\n",
      "[1/69] Compiling C object lib/common/libcommon.a.p/cmdline_parse_args.c.o\n",
      "[2/69] Compiling C object lib/cli/libcli.a.p/cli_cmap.c.o\n",
      "[3/69] Compiling C object lib/common/libcommon.a.p/copyright_info.c.o\n",
      "[4/69] Compiling C object lib/common/libcommon.a.p/core_info.c.o\n",
      "[5/69] Compiling C object lib/utils/libutils.a.p/heap.c.o\n",
      "[6/69] Compiling C object lib/utils/libutils.a.p/portlist.c.o\n",
      "[7/69] Compiling C object lib/common/libcommon.a.p/utils.c.o\n",
      "[8/69] Compiling C object lib/cli/libcli.a.p/cli_gapbuf.c.o\n",
      "[9/69] Compiling C object lib/cli/libcli.a.p/cli_file.c.o\n",
      "[10/69] Compiling C object lib/common/libcommon.a.p/pg_pcap.c.o\n",
      "[11/69] Compiling C object lib/common/libcommon.a.p/port_config.c.o\n",
      "[12/69] Compiling C object lib/utils/libutils.a.p/_atoip.c.o\n",
      "[13/69] Compiling C object lib/common/libcommon.a.p/coremap.c.o\n",
      "[14/69] Compiling C object lib/cli/libcli.a.p/cli_env.c.o\n",
      "[15/69] Compiling C object lib/lua/liblua.a.p/lua_config.c.o\n",
      "[16/69] Compiling C object lib/common/libcommon.a.p/cksum.c.o\n",
      "[17/69] Linking static target lib/utils/libutils.a\n",
      "[18/69] Compiling C object lib/common/libcommon.a.p/lscpu.c.o\n",
      "[19/69] Compiling C object lib/fgen/libfgen.a.p/unparse.c.o\n",
      "[20/69] Linking static target lib/lua/liblua.a\n",
      "[21/69] Compiling C object lib/plugin/libplugin.a.p/plugin.c.o\n",
      "[22/69] Linking static target lib/plugin/libplugin.a\n",
      "[23/69] Compiling C object lib/fgen/libfgen.a.p/fgen.c.o\n",
      "[24/69] Compiling C object lib/common/libcommon.a.p/l2p.c.o\n",
      "[25/69] Compiling C object lib/common/libcommon.a.p/pg_strings.c.o\n",
      "[26/69] Linking static target lib/common/libcommon.a\n",
      "[27/69] Compiling C object lib/cli/libcli.a.p/cli_help.c.o\n",
      "[28/69] Compiling C object lib/vec/libvec.a.p/vec.c.o\n",
      "[29/69] Compiling C object lib/cli/libcli.a.p/cli_cmds.c.o\n",
      "[30/69] Linking static target lib/vec/libvec.a\n",
      "[31/69] Compiling C object lib/cli/libcli.a.p/cli_history.c.o\n",
      "[32/69] Compiling C object lib/cli/libcli.a.p/cli.c.o\n",
      "[33/69] Compiling C object lib/cli/libcli.a.p/cli_auto_complete.c.o\n",
      "[34/69] Compiling C object lib/fgen/libfgen.a.p/parse.c.o\n",
      "[35/69] Linking static target lib/fgen/libfgen.a\n",
      "[36/69] Compiling C object lib/cli/libcli.a.p/cli_search.c.o\n",
      "[37/69] Compiling C object lib/cli/libcli.a.p/cli_scrn.c.o\n",
      "[38/69] Compiling C object lib/cli/libcli.a.p/cli_input.c.o\n",
      "[39/69] Compiling C object lib/cli/libcli.a.p/cli_map.c.o\n",
      "[40/69] Compiling C object app/pktgen.p/pktgen-seq.c.o\n",
      "[41/69] Compiling C object app/pktgen.p/pktgen-cfg.c.o\n",
      "[42/69] Compiling C object app/pktgen.p/pktgen-cpu.c.o\n",
      "[43/69] Compiling C object app/pktgen.p/pktgen-pcap.c.o\n",
      "[44/69] Compiling C object app/pktgen.p/pktgen-ipv6.c.o\n",
      "[45/69] Compiling C object app/pktgen.p/pktgen-dump.c.o\n",
      "[46/69] Compiling C object app/pktgen.p/pktgen-main.c.o\n",
      "[47/69] Compiling C object app/pktgen.p/pktgen-capture.c.o\n",
      "[48/69] Compiling C object lib/cli/libcli.a.p/cli_vt100.c.o\n",
      "[49/69] Linking static target lib/cli/libcli.a\n",
      "[50/69] Compiling C object app/pktgen.p/pktgen-ether.c.o\n",
      "[51/69] Compiling C object app/pktgen.p/pktgen-arp.c.o\n",
      "[52/69] Compiling C object app/pktgen.p/pktgen-range.c.o\n",
      "[53/69] Compiling C object app/pktgen.p/pktgen-ipv4.c.o\n",
      "[54/69] Compiling C object app/pktgen.p/pktgen-vlan.c.o\n",
      "[55/69] Compiling C object app/pktgen.p/pktgen-gre.c.o\n",
      "[56/69] Compiling C object app/pktgen.p/pktgen-tcp.c.o\n",
      "[57/69] Compiling C object app/pktgen.p/pktgen-stats.c.o\n",
      "[58/69] Compiling C object app/pktgen.p/pktgen-udp.c.o\n",
      "[59/69] Compiling C object app/pktgen.p/pktgen-port-cfg.c.o\n",
      "[60/69] Compiling C object app/pktgen.p/pktgen-random.c.o\n",
      "[61/69] Compiling C object app/pktgen.p/pktgen-gtpu.c.o\n",
      "[62/69] Compiling C object app/pktgen.p/pktgen-log.c.o\n",
      "[63/69] Compiling C object app/pktgen.p/pktgen-display.c.o\n",
      "[64/69] Compiling C object app/pktgen.p/pktgen-latency.c.o\n",
      "[65/69] Compiling C object app/pktgen.p/pktgen-rate.c.o\n",
      "[66/69] Compiling C object app/pktgen.p/pktgen.c.o\n",
      "[67/69] Compiling C object app/pktgen.p/cli-functions.c.o\n",
      "[68/69] Compiling C object app/pktgen.p/pktgen-cmds.c.o\n",
      "[69/69] Linking target app/pktgen\n",
      "\u001b[31m sudo: unable to resolve host server3: Name or service not known\n",
      " \u001b[0mninja: Entering directory `/home/ubuntu/Pktgen-DPDK/build'\n",
      "ninja: no work to do.\n",
      "Installing app/pktgen to /usr/local/bin\n"
     ]
    }
   ],
   "source": [
    "stdout, stderr = server3.execute(f'sudo apt-get install -y cmake')\n",
    "stdout, stderr = server3.execute(f'sudo apt-get install -y libpcap-dev')\n",
    "stdout, stderr = server3.execute(f'cd Pktgen-DPDK &&  sudo meson build && sudo ninja -C build && cd build/ && sudo meson install')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "126a67f8-7c51-4e16-b46c-1c0509a52b62",
   "metadata": {
    "tags": []
   },
   "source": [
    "# Step 7: Upload and compile"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "id": "6678d7e1-ce27-4a9d-bc1a-736a96de70a6",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<SFTPAttributes: [ size=425 uid=1000 gid=1000 mode=0o100664 atime=1712713084 mtime=1712713344 ]>"
      ]
     },
     "execution_count": 19,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# server1.upload_file('ethtool.sh','ethtool.sh')\n",
    "server3.upload_file('ethtool_txrx.sh','ethtool_txrx.sh')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "b32b218e-f8e3-487f-8f1f-c9138cef18f4",
   "metadata": {
    "jp-MarkdownHeadingCollapsed": true,
    "tags": []
   },
   "source": [
    "## To upload and compile PSA P4 example: test_PSA_1.p4"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "id": "ee9cccc8-368b-4cae-87d1-8c50713ca9c0",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      "sudo: unable to resolve host server2: Name or service not known\n",
      "sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m"
     ]
    }
   ],
   "source": [
    "server2.upload_file('test_PSA_1p0.p4','test.p4')\n",
    "server2.upload_file('test.cli','test.cli')\n",
    "server2.upload_file('ethdev.io','ethdev.io')\n",
    "stdout, stderr = server2.execute(f'sudo p4c-dpdk --arch=psa test.p4 -o test.spec && sudo cp test.spec dpdk/examples/pipeline/examples/ && sudo cp ethdev.io dpdk/examples/pipeline/examples/ ')\n",
    "stdout, stderr = server2.execute(f'sudo cp test.cli dpdk/examples/pipeline/examples/')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "id": "eef54294-e435-42a6-9223-0d365c57a0bd",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      "sudo: unable to resolve host server2: Name or service not known\n",
      "sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m"
     ]
    }
   ],
   "source": [
    "server2.upload_file('test_PSA_1p1.p4','test.p4')\n",
    "server2.upload_file('test.cli','test.cli')\n",
    "server2.upload_file('ethdev.io','ethdev.io')\n",
    "stdout, stderr = server2.execute(f'sudo p4c-dpdk --arch=psa test.p4 -o test.spec && sudo cp test.spec dpdk/examples/pipeline/examples/ && sudo cp ethdev.io dpdk/examples/pipeline/examples/ ')\n",
    "stdout, stderr = server2.execute(f'sudo cp test.cli dpdk/examples/pipeline/examples/')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "id": "63252511-cc36-4a50-a124-7f8c4fd7f71f",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      "sudo: unable to resolve host server2: Name or service not known\n",
      "sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m"
     ]
    }
   ],
   "source": [
    "server2.upload_file('test_PSA_2.p4','test.p4')\n",
    "server2.upload_file('test.cli','test.cli')\n",
    "server2.upload_file('ethdev.io','ethdev.io')\n",
    "stdout, stderr = server2.execute(f'sudo p4c-dpdk --arch=psa test.p4 -o test.spec && sudo cp test.spec dpdk/examples/pipeline/examples/ && sudo cp ethdev.io dpdk/examples/pipeline/examples/ ')\n",
    "stdout, stderr = server2.execute(f'sudo cp test.cli dpdk/examples/pipeline/examples/')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "a7e4e472-4a62-4c46-94fa-3ee8fdaa9abb",
   "metadata": {
    "jp-MarkdownHeadingCollapsed": true,
    "tags": []
   },
   "source": [
    "## To upload and compile PNA P4 example: test_PNA.p4"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "id": "1f6c6bbc-fbeb-43ae-b560-fdddabcaf993",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      "sudo: unable to resolve host server2: Name or service not known\n",
      "sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m"
     ]
    }
   ],
   "source": [
    "server2.upload_file('test_PNA.p4','test.p4')\n",
    "server2.upload_file('test.cli','test.cli')\n",
    "server2.upload_file('ethdev.io','ethdev.io')\n",
    "stdout, stderr = server2.execute(f'sudo p4c-dpdk --arch=pna test.p4 -o test.spec && sudo cp test.spec dpdk/examples/pipeline/examples/ && sudo cp ethdev.io dpdk/examples/pipeline/examples/ ')\n",
    "stdout, stderr = server2.execute(f'sudo cp test.cli dpdk/examples/pipeline/examples/')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "0ad19863-2b20-46c8-91dd-cae83b343327",
   "metadata": {
    "jp-MarkdownHeadingCollapsed": true,
    "tags": []
   },
   "source": [
    "## To upload and compile cms: cms.p4"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 47,
   "id": "db0bf408-ad24-4384-bde0-5baa73f42471",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      "sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m"
     ]
    }
   ],
   "source": [
    "server2.upload_file('cms_optimal.p4','test.p4')\n",
    "server2.upload_file('test.cli','test.cli')\n",
    "server2.upload_file('ethdev.io','ethdev.io')\n",
    "stdout, stderr = server2.execute(f'sudo p4c-dpdk --arch=pna test.p4 -o test.spec && sudo cp test.spec dpdk/examples/pipeline/examples/ && sudo cp ethdev.io dpdk/examples/pipeline/examples/ ')\n",
    "stdout, stderr = server2.execute(f'sudo cp test.cli dpdk/examples/pipeline/examples/')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "7b0a230a-6dfc-4d80-a361-37befd8f5af8",
   "metadata": {
    "jp-MarkdownHeadingCollapsed": true,
    "tags": []
   },
   "source": [
    "## To upload and compile cms different hashes: cms_hx.p4"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "id": "aa6019a2-4eaa-4b80-a5ed-36a910e03d9d",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      "sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m"
     ]
    }
   ],
   "source": [
    "server2.upload_file('cms_h8.p4','test.p4')\n",
    "server2.upload_file('multicore/2cores/test.cli','test.cli')\n",
    "\n",
    "server2.upload_file('multicore/2cores/ethdev.io','ethdev.io')\n",
    "server2.upload_file('multicore/2cores/ethdev2.io','ethdev2.io')\n",
    "\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev2.io dpdk/examples/pipeline/examples/')\n",
    "\n",
    "stdout, stderr = server2.execute(f'sudo p4c-dpdk --arch=pna test.p4 -o test.spec && sudo cp test.spec dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp test.cli dpdk/examples/pipeline/examples/')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 37,
   "id": "5f801358-0376-410e-91c1-a1fd66ac9426",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      "sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m"
     ]
    }
   ],
   "source": [
    "server2.upload_file('cms_h5.p4','test.p4')\n",
    "server2.upload_file('multicore/4cores/test.cli','test.cli')\n",
    "\n",
    "server2.upload_file('multicore/4cores/ethdev.io','ethdev.io')\n",
    "server2.upload_file('multicore/4cores/ethdev2.io','ethdev2.io')\n",
    "server2.upload_file('multicore/4cores/ethdev3.io','ethdev3.io')\n",
    "server2.upload_file('multicore/4cores/ethdev4.io','ethdev4.io')\n",
    "\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev2.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev3.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev4.io dpdk/examples/pipeline/examples/')\n",
    "\n",
    "stdout, stderr = server2.execute(f'sudo p4c-dpdk --arch=pna test.p4 -o test.spec && sudo cp test.spec dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp test.cli dpdk/examples/pipeline/examples/')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "3148afdc-6dbe-4cda-b697-7ad5b2a4ab1b",
   "metadata": {
    "tags": []
   },
   "source": [
    "## To upload and compile 4cores cms: cms.p4"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "id": "ab82e08c-e21a-4d6c-8d71-09bac4c37a00",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      "sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m"
     ]
    }
   ],
   "source": [
    "# server2.upload_file('cms_optimal3.p4','test.p4')\n",
    "server2.upload_file('cms_h4.p4','test.p4')\n",
    "server2.upload_file('multicore/4cores/test.cli','test.cli')\n",
    "\n",
    "server2.upload_file('multicore/4cores/ethdev.io','ethdev.io')\n",
    "server2.upload_file('multicore/4cores/ethdev2.io','ethdev2.io')\n",
    "server2.upload_file('multicore/4cores/ethdev3.io','ethdev3.io')\n",
    "server2.upload_file('multicore/4cores/ethdev4.io','ethdev4.io')\n",
    "\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev2.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev3.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev4.io dpdk/examples/pipeline/examples/')\n",
    "\n",
    "stdout, stderr = server2.execute(f'sudo p4c-dpdk --arch=pna test.p4 -o test.spec && sudo cp test.spec dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp test.cli dpdk/examples/pipeline/examples/')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "78d9953b-6d66-4044-9aac-55ee9d26938d",
   "metadata": {
    "jp-MarkdownHeadingCollapsed": true,
    "tags": []
   },
   "source": [
    "## To upload and compile multicore test: cms_optimal.p4"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "60486c3f-f094-4270-a002-3d36e27ad251",
   "metadata": {},
   "source": [
    "1 core 1 pipeline"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "id": "77e7f951-e93c-4a10-9a26-8ef9616fd389",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      "sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m"
     ]
    }
   ],
   "source": [
    "server2.upload_file('cms_optimal.p4','test.p4')\n",
    "server2.upload_file('multicore/1core/test.cli','test.cli')\n",
    "\n",
    "server2.upload_file('multicore/1core/ethdev.io','ethdev.io')\n",
    "\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev.io dpdk/examples/pipeline/examples/')\n",
    "\n",
    "stdout, stderr = server2.execute(f'sudo p4c-dpdk --arch=pna test.p4 -o test.spec && sudo cp test.spec dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp test.cli dpdk/examples/pipeline/examples/')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "9d81536c-0e7c-42c1-b9a2-0856888ed2bb",
   "metadata": {},
   "source": [
    "2 cores 2 pipelines"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "id": "bc731325-d750-4b04-ad01-d967a7db01b8",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      "sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m"
     ]
    }
   ],
   "source": [
    "server2.upload_file('cms_optimal.p4','test.p4')\n",
    "server2.upload_file('multicore/2cores/test.cli','test.cli')\n",
    "\n",
    "server2.upload_file('multicore/2cores/ethdev.io','ethdev.io')\n",
    "server2.upload_file('multicore/2cores/ethdev2.io','ethdev2.io')\n",
    "\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev2.io dpdk/examples/pipeline/examples/')\n",
    "\n",
    "stdout, stderr = server2.execute(f'sudo p4c-dpdk --arch=pna test.p4 -o test.spec && sudo cp test.spec dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp test.cli dpdk/examples/pipeline/examples/')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "37f209dc-b034-43d4-bfc9-f409bcc85c4e",
   "metadata": {},
   "source": [
    "3 cores 3 pipelines"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "id": "56d32a22-a8f0-4099-9437-8068ba4cc39d",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      "sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m"
     ]
    }
   ],
   "source": [
    "server2.upload_file('cms_optimal.p4','test.p4')\n",
    "server2.upload_file('multicore/3cores/test.cli','test.cli')\n",
    "\n",
    "server2.upload_file('multicore/3cores/ethdev.io','ethdev.io')\n",
    "server2.upload_file('multicore/3cores/ethdev2.io','ethdev2.io')\n",
    "server2.upload_file('multicore/3cores/ethdev3.io','ethdev3.io')\n",
    "\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev2.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev3.io dpdk/examples/pipeline/examples/')\n",
    "\n",
    "stdout, stderr = server2.execute(f'sudo p4c-dpdk --arch=pna test.p4 -o test.spec && sudo cp test.spec dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp test.cli dpdk/examples/pipeline/examples/')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "2070fe88-6a37-4d8c-9383-5cf8570f2364",
   "metadata": {},
   "source": [
    "4 cores 4 pipelines"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 39,
   "id": "3cce16ea-c667-4574-919e-3b780ac19f20",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      "sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m"
     ]
    }
   ],
   "source": [
    "server2.upload_file('cms_optimal.p4','test.p4')\n",
    "server2.upload_file('multicore/4cores/test.cli','test.cli')\n",
    "\n",
    "server2.upload_file('multicore/4cores/ethdev.io','ethdev.io')\n",
    "server2.upload_file('multicore/4cores/ethdev2.io','ethdev2.io')\n",
    "server2.upload_file('multicore/4cores/ethdev3.io','ethdev3.io')\n",
    "server2.upload_file('multicore/4cores/ethdev4.io','ethdev4.io')\n",
    "\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev2.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev3.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev4.io dpdk/examples/pipeline/examples/')\n",
    "\n",
    "stdout, stderr = server2.execute(f'sudo p4c-dpdk --arch=pna test.p4 -o test.spec && sudo cp test.spec dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp test.cli dpdk/examples/pipeline/examples/')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "11739f99-1971-4992-9f58-3484122e7147",
   "metadata": {},
   "source": [
    "5 cores 5 pipelines"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "id": "eba49ab8-bfbc-467d-bd00-f1bbed718067",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      "sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m"
     ]
    }
   ],
   "source": [
    "server2.upload_file('cms_optimal.p4','test.p4')\n",
    "server2.upload_file('multicore/5cores/test.cli','test.cli')\n",
    "\n",
    "server2.upload_file('multicore/5cores/ethdev.io','ethdev.io')\n",
    "server2.upload_file('multicore/5cores/ethdev2.io','ethdev2.io')\n",
    "server2.upload_file('multicore/5cores/ethdev3.io','ethdev3.io')\n",
    "server2.upload_file('multicore/5cores/ethdev4.io','ethdev4.io')\n",
    "server2.upload_file('multicore/5cores/ethdev5.io','ethdev5.io')\n",
    "\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev2.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev3.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev4.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev5.io dpdk/examples/pipeline/examples/')\n",
    "\n",
    "stdout, stderr = server2.execute(f'sudo p4c-dpdk --arch=pna test.p4 -o test.spec && sudo cp test.spec dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp test.cli dpdk/examples/pipeline/examples/')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "6a3fb58e-4f05-4dc5-84d3-659f88123e4c",
   "metadata": {},
   "source": [
    "6 cores 6 pipelines"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "id": "66590838-e2bc-4896-96fb-279f26edf8d3",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      "sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m"
     ]
    }
   ],
   "source": [
    "server2.upload_file('cms_optimal.p4','test.p4')\n",
    "server2.upload_file('multicore/6cores/test.cli','test.cli')\n",
    "\n",
    "server2.upload_file('multicore/6cores/ethdev.io','ethdev.io')\n",
    "server2.upload_file('multicore/6cores/ethdev2.io','ethdev2.io')\n",
    "server2.upload_file('multicore/6cores/ethdev3.io','ethdev3.io')\n",
    "server2.upload_file('multicore/6cores/ethdev4.io','ethdev4.io')\n",
    "server2.upload_file('multicore/6cores/ethdev5.io','ethdev5.io')\n",
    "server2.upload_file('multicore/6cores/ethdev6.io','ethdev6.io')\n",
    "\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev2.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev3.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev4.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev5.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev6.io dpdk/examples/pipeline/examples/')\n",
    "\n",
    "stdout, stderr = server2.execute(f'sudo p4c-dpdk --arch=pna test.p4 -o test.spec && sudo cp test.spec dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp test.cli dpdk/examples/pipeline/examples/')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "c78bf76a-49cf-4285-9b3d-8c82a2a58c77",
   "metadata": {},
   "source": [
    "7 cores 7 pipelines"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "id": "2e94b257-a07f-44b0-b346-b5bdbc29aa90",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      "sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m"
     ]
    }
   ],
   "source": [
    "server2.upload_file('cms_optimal.p4','test.p4')\n",
    "server2.upload_file('multicore/7cores/test.cli','test.cli')\n",
    "\n",
    "server2.upload_file('multicore/7cores/ethdev.io','ethdev.io')\n",
    "server2.upload_file('multicore/7cores/ethdev2.io','ethdev2.io')\n",
    "server2.upload_file('multicore/7cores/ethdev3.io','ethdev3.io')\n",
    "server2.upload_file('multicore/7cores/ethdev4.io','ethdev4.io')\n",
    "server2.upload_file('multicore/7cores/ethdev5.io','ethdev5.io')\n",
    "server2.upload_file('multicore/7cores/ethdev6.io','ethdev6.io')\n",
    "server2.upload_file('multicore/7cores/ethdev7.io','ethdev7.io')\n",
    "\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev2.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev3.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev4.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev5.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev6.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev7.io dpdk/examples/pipeline/examples/')\n",
    "\n",
    "stdout, stderr = server2.execute(f'sudo p4c-dpdk --arch=pna test.p4 -o test.spec && sudo cp test.spec dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp test.cli dpdk/examples/pipeline/examples/')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "066a05f3-4e27-42e4-8734-94538e5e1471",
   "metadata": {},
   "source": [
    "8 cores 8 pipelines"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "id": "be23a512-bc8a-41ba-8a66-6ab6b3bfc979",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      "sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m\u001b[31m sudo: unable to resolve host server2: Name or service not known\n",
      " \u001b[0m"
     ]
    }
   ],
   "source": [
    "server2.upload_file('cms_optimal.p4','test.p4')\n",
    "server2.upload_file('multicore/8cores/test.cli','test.cli')\n",
    "\n",
    "server2.upload_file('multicore/8cores/ethdev.io','ethdev.io')\n",
    "server2.upload_file('multicore/8cores/ethdev2.io','ethdev2.io')\n",
    "server2.upload_file('multicore/8cores/ethdev3.io','ethdev3.io')\n",
    "server2.upload_file('multicore/8cores/ethdev4.io','ethdev4.io')\n",
    "server2.upload_file('multicore/8cores/ethdev5.io','ethdev5.io')\n",
    "server2.upload_file('multicore/8cores/ethdev6.io','ethdev6.io')\n",
    "server2.upload_file('multicore/8cores/ethdev7.io','ethdev7.io')\n",
    "server2.upload_file('multicore/8cores/ethdev8.io','ethdev8.io')\n",
    "\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev2.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev3.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev4.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev5.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev6.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev7.io dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp ethdev8.io dpdk/examples/pipeline/examples/')\n",
    "\n",
    "stdout, stderr = server2.execute(f'sudo p4c-dpdk --arch=pna test.p4 -o test.spec && sudo cp test.spec dpdk/examples/pipeline/examples/')\n",
    "stdout, stderr = server2.execute(f'sudo cp test.cli dpdk/examples/pipeline/examples/')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "2375f3aa-cf44-4c45-ba09-881a87d5c24f",
   "metadata": {
    "tags": []
   },
   "source": [
    "# Step 8: Running the DPDK application on the SmartNIC"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "69d7a6bb-f5df-4ff2-a546-347260582d11",
   "metadata": {
    "tags": []
   },
   "source": [
    "## These commands should be executed in the terminals"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "f94e294a-d52b-4a16-ab96-7f40b36a9f57",
   "metadata": {},
   "source": [
    "Make sure to export RTE_INSTALL_DIR=/home/ubuntu/dpdk (ask)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 50,
   "id": "dc2aeba7-0a18-4c73-b483-d0b4b40b5b71",
   "metadata": {},
   "outputs": [],
   "source": [
    "# stdout, stderr = server1.execute(f'cd dpdk && sudo examples/pipeline/build/pipeline -c 0xF -- -s examples/pipeline/examples/test.cli')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "f9a1e6f1-430f-4542-8e88-bc59aee45166",
   "metadata": {},
   "source": [
    "### Run Pktgen in server 1"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "169a9dca-74ea-4e64-9e9e-cbe31434d565",
   "metadata": {},
   "outputs": [],
   "source": [
    "stdout, stderr = server1.execute(f'sudo sudo pktgen -l 0-3 -n 3 -- -P -m \"1.0\"')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "6e80c9e0-3c6a-4b2a-802b-53cc39163999",
   "metadata": {},
   "outputs": [],
   "source": [
    "# stdout, stderr = server1.execute(f'sudo pktgen -l 0-8 -n 7 -- -p -m \"[1:7].0\"')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "db4db67d-1703-4086-800d-a4de107bca6f",
   "metadata": {},
   "outputs": [],
   "source": [
    "# sudo sysctl -w vm.nr_hugepages=102400\n",
    "# sudo su\n",
    "# echo 32768 > /proc/sys/vm/nr_hugepages\n",
    "# exit\n",
    "# sudo pktgen -c 0x1F -- -P -m \"[1-4].0\"\n",
    "stdout, stderr = server1.execute(f'sudo pktgen -c 0xF -- -P -m \"[1-4].0\"')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "cf1791d4-2890-4293-bac1-538c45344013",
   "metadata": {},
   "outputs": [],
   "source": [
    "stdout, stderr = server1.execute(f'sudo pktgen -l 0-3 -n 3 -- -P -m \"1.0\" -s 1:202401011400.pcap')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "9337beb1-9fc1-4d18-b36e-29aed3e93729",
   "metadata": {},
   "source": [
    "In Pktgen set mac ip and packet size\n",
    "\n",
    "source mac: set 0 src mac {mac address}\n",
    "\n",
    "destination mac: set 0 dst mac {mac address}\n",
    "\n",
    "source ip: set 0 src ip {ip address}\n",
    "\n",
    "destination ip: set 0 dst ip {ip address}\n",
    "\n",
    "packet size: set 0 size {packet size}\n",
    "\n",
    "%Rate out of 100 Gbps: set 0 rate {rate/100}\n",
    "\n",
    "strat 0\n",
    "stop 0"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "4b01c96c-b858-46c8-a411-2d242b72fc5f",
   "metadata": {},
   "source": [
    "### Run pipeline in server 2"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "ab8eb815-4209-472f-b4d4-59591e722b67",
   "metadata": {},
   "outputs": [],
   "source": [
    "stdout, stderr = server2.execute(f'cd dpdk')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "6525b92b-b343-47ec-951d-5d05df736096",
   "metadata": {},
   "outputs": [],
   "source": [
    "stdout, stderr = server2.execute(f'sudo examples/pipeline/build/pipeline -c 0xF -- -s examples/pipeline/examples/test.cli')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "4f9e56a5-2a1a-426b-9a91-e17da30b4da6",
   "metadata": {},
   "outputs": [],
   "source": [
    "stdout, stderr = server2.execute(f'sudo examples/pipeline/build/pipeline -c 0x1F -- -s examples/pipeline/examples/test.cli')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "a08becd3-f21f-40ea-a784-0090224d40dd",
   "metadata": {},
   "source": [
    "t2 >> telnet 0.0.0.0 8086\n",
    "\n",
    "pipeline >> ethdev show\n",
    "ethtool -S eth0 | grep -E 'tx_packets|rx_packets'"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "9c2a72ac-8618-4720-ad1e-a29b5c4bd773",
   "metadata": {
    "jp-MarkdownHeadingCollapsed": true,
    "tags": []
   },
   "source": [
    "### Run in server 3 (option 1)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "60ce5890-1be0-4906-ae6a-c412b2bb2df1",
   "metadata": {},
   "source": [
    "t1 >> sudo sysctl -w net.ipv4.tcp_congestion_control=cubic >> sudo hping3 198.18.1.20 -i u10000\n",
    "\n",
    "t2 >> iperf3 -s\n",
    "\n",
    "t3 >> iperf3 -c 198.18.1.20 -t 60\n",
    "\n",
    "----\n",
    "use tcpdump to see all incomming and outgoing transactions : sudo tcpdump -i enp7s0np0"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "36c26456-b325-432f-9ba1-e14c2bcccd16",
   "metadata": {
    "tags": []
   },
   "source": [
    "# When the session is extended and the work needs to be resumed"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "id": "d613776b-6a09-4094-b7db-87489a0283ff",
   "metadata": {},
   "outputs": [],
   "source": [
    "from fabrictestbed_extensions.fablib.fablib import FablibManager as fablib_manager\n",
    "fablib = fablib_manager()\n",
    "\n",
    "slice = fablib.get_slice(name=\"p4sec_fabric_samesite_pcap1\")\n",
    "\n",
    "server1 = slice.get_node(name=\"server1\")\n",
    "server2 = slice.get_node(name=\"server2\")\n",
    "server3 = slice.get_node(name=\"server3\")\n",
    "\n",
    "# server1.upload_file('test.p4','test.p4')\n",
    "# server1.upload_file('test.cli','test.cli')\n",
    "# server1.upload_file('ethdev.io','ethdev.io')\n",
    "# stdout, stderr = server1.execute(f'sudo p4c-dpdk --arch=psa test.p4 -o test.spec && sudo cp test.spec dpdk/examples/pipeline/examples/ && sudo cp ethdev.io dpdk/examples/pipeline/examples/')\n",
    "# stdout, stderr = server1.execute(f'sudo cp test.cli dpdk/examples/pipeline/examples/')\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "id": "bbeb42d7-ebd5-4a5b-ac61-ebb36038cd8c",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "ssh -i {{ _self_.private_ssh_key_file }} -F /home/fabric/work/fabric_config/ssh_config {{ _self_.username }}@{{ _self_.management_ip }}\n",
      "ssh -i {{ _self_.private_ssh_key_file }} -F /home/fabric/work/fabric_config/ssh_config {{ _self_.username }}@{{ _self_.management_ip }}\n",
      "ssh -i {{ _self_.private_ssh_key_file }} -F /home/fabric/work/fabric_config/ssh_config {{ _self_.username }}@{{ _self_.management_ip }}\n"
     ]
    }
   ],
   "source": [
    "print(server1.get_ssh_command())\n",
    "print(server2.get_ssh_command())\n",
    "print(server3.get_ssh_command())"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "1cb25ab1-195e-4003-a4d2-9fe318078dd9",
   "metadata": {},
   "outputs": [],
   "source": [
    "server1 = slice.get_node(name=\"server1\")\n",
    "\n",
    "# server1.download_file('edit202401271400.pcap', 'edit202401271400.pcap')\n",
    "# server1.download_file('edit202402101400.pcap', 'edit202402101400.pcap')\n",
    "# server1.download_file('edit202403231400.pcap', 'edit202403231400.pcap')\n",
    "# server1.download_file('edit202404071400.pcap', 'edit202404071400.pcap')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "id": "4decd7d9-c79b-46e0-a2c9-beba0febc4b2",
   "metadata": {},
   "outputs": [],
   "source": [
    "server1 = slice.get_node(name=\"server1\")\n",
    "\n",
    "# server1.download_file('jan.log', 'jan.log')\n",
    "server1.download_file('feb.log', 'feb.log')\n",
    "# server1.download_file('mar.log', 'mar.log')\n",
    "# server1.download_file('apr.log', 'apr.log')\n",
    "# server1.download_file('test.log', 'test.log')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "id": "ebd9ec9e-5e95-4cd4-9a9f-e32b1a3a1dfc",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<SFTPAttributes: [ size=0 uid=1000 gid=1000 mode=0o100664 atime=1713059397 mtime=1713059397 ]>"
      ]
     },
     "execution_count": 2,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "server1 = slice.get_node(name=\"server1\")\n",
    "# server1.download_file('equinix-nyc.dirA.20190117-130000.UTC.anon.pcap', 'equinix-nyc.dirA.20190117-130000.UTC.anon.pcap')\n",
    "server1.upload_file('out.pcap','out.pcap')"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3 (ipykernel)",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.10.6"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 5
}