cleaning-and-conversion-of-the-ddos-attaack-log.ipynb

{"cells":[{"source":"<a href=\"https://www.kaggle.com/code/ajiboyetoluwalase/cleaning-and-conversion-of-the-ddos-attaack-log?scriptVersionId=127524066\" target=\"_blank\"><img align=\"left\" alt=\"Kaggle\" title=\"Open in Kaggle\" src=\"https://kaggle.com/static/images/open-in-kaggle.svg\"></a>","metadata":{},"cell_type":"markdown"},{"cell_type":"code","execution_count":1,"id":"274dc02c","metadata":{"_cell_guid":"b1076dfc-b9ad-4769-8c92-a6c4dae69d19","_uuid":"8f2839f25d086af736a60e9eeb907d3b93b6e0e5","execution":{"iopub.execute_input":"2023-04-28T04:41:04.270203Z","iopub.status.busy":"2023-04-28T04:41:04.268819Z","iopub.status.idle":"2023-04-28T04:41:04.294186Z","shell.execute_reply":"2023-04-28T04:41:04.292722Z"},"papermill":{"duration":0.036892,"end_time":"2023-04-28T04:41:04.297655","exception":false,"start_time":"2023-04-28T04:41:04.260763","status":"completed"},"tags":[]},"outputs":[{"name":"stdout","output_type":"stream","text":["/kaggle/input/wordpress-ddos-log-dataset/Wordpress DDOS attack Logs.txt\n","/kaggle/input/wordpress-ddos-log-dataset/wordpress_ddos_log_transform.csv\n"]}],"source":["# This Python 3 environment comes with many helpful analytics libraries installed\n","# It is defined by the kaggle/python Docker image: https://github.com/kaggle/docker-python\n","# For example, here's several helpful packages to load\n","\n","import numpy as np # linear algebra\n","import pandas as pd # data processing, CSV file I/O (e.g. pd.read_csv)\n","\n","# Input data files are available in the read-only \"../input/\" directory\n","# For example, running this (by clicking run or pressing Shift+Enter) will list all files under the input directory\n","\n","import os\n","for dirname, _, filenames in os.walk('/kaggle/input'):\n","    for filename in filenames:\n","        print(os.path.join(dirname, filename))\n","\n","# You can write up to 20GB to the current directory (/kaggle/working/) that gets preserved as output when you create a version using \"Save & Run All\" \n","# You can also write temporary files to /kaggle/temp/, but they won't be saved outside of the current session"]},{"cell_type":"markdown","id":"da6c819c","metadata":{"papermill":{"duration":0.005467,"end_time":"2023-04-28T04:41:04.308458","exception":false,"start_time":"2023-04-28T04:41:04.302991","status":"completed"},"tags":[]},"source":["## Cleaning and Conversion of the Wordpress DDos attack Logs.txt to .csv Format"]},{"cell_type":"code","execution_count":2,"id":"4d758c11","metadata":{"execution":{"iopub.execute_input":"2023-04-28T04:41:04.323516Z","iopub.status.busy":"2023-04-28T04:41:04.32296Z","iopub.status.idle":"2023-04-28T04:41:05.682279Z","shell.execute_reply":"2023-04-28T04:41:05.680913Z"},"papermill":{"duration":1.370599,"end_time":"2023-04-28T04:41:05.68529","exception":false,"start_time":"2023-04-28T04:41:04.314691","status":"completed"},"tags":[]},"outputs":[],"source":["import pandas as pd\n","import numpy as np\n","import seaborn as sns\n","import matplotlib.pyplot as plt\n","%matplotlib inline"]},{"cell_type":"code","execution_count":3,"id":"626fe2ad","metadata":{"execution":{"iopub.execute_input":"2023-04-28T04:41:05.697719Z","iopub.status.busy":"2023-04-28T04:41:05.697281Z","iopub.status.idle":"2023-04-28T04:41:05.74285Z","shell.execute_reply":"2023-04-28T04:41:05.741348Z"},"papermill":{"duration":0.055068,"end_time":"2023-04-28T04:41:05.745598","exception":false,"start_time":"2023-04-28T04:41:05.69053","status":"completed"},"tags":[]},"outputs":[{"name":"stdout","output_type":"stream","text":["<class 'pandas.core.frame.DataFrame'>\n","RangeIndex: 568 entries, 0 to 567\n","Data columns (total 1 columns):\n"," #   Column                                                                                                                        Non-Null Count  Dtype \n","---  ------                                                                                                                        --------------  ----- \n"," 0   188.121.41.140 - - [23/Sep/2013:13:02:47 +0200] \"GET / HTTP/1.1\" 200 8955 \"-\" \"WordPress/3.0.2; http://www.cakefantasia.com\"  568 non-null    object\n","dtypes: object(1)\n","memory usage: 4.6+ KB\n"]}],"source":["data = pd.read_fwf('/kaggle/input/wordpress-ddos-log-dataset/Wordpress DDOS attack Logs.txt')\n","data.info()"]},{"cell_type":"markdown","id":"ab5cfcda","metadata":{"papermill":{"duration":0.004729,"end_time":"2023-04-28T04:41:05.75565","exception":false,"start_time":"2023-04-28T04:41:05.750921","status":"completed"},"tags":[]},"source":["- Analysis of the base log.txt file so see how to go about the cleaning "]},{"cell_type":"markdown","id":"d8b2b878","metadata":{"papermill":{"duration":0.004744,"end_time":"2023-04-28T04:41:05.765494","exception":false,"start_time":"2023-04-28T04:41:05.76075","status":"completed"},"tags":[]},"source":["## Transforming The Data To A DataFrame\n","- so i will turn the log data into a dataframe and remove the useless values\n","- i will also turn it into a csv file for other uses "]},{"cell_type":"code","execution_count":4,"id":"5f783ed3","metadata":{"execution":{"iopub.execute_input":"2023-04-28T04:41:05.777829Z","iopub.status.busy":"2023-04-28T04:41:05.777337Z","iopub.status.idle":"2023-04-28T04:41:05.785538Z","shell.execute_reply":"2023-04-28T04:41:05.784142Z"},"papermill":{"duration":0.017829,"end_time":"2023-04-28T04:41:05.788486","exception":false,"start_time":"2023-04-28T04:41:05.770657","status":"completed"},"tags":[]},"outputs":[],"source":["#open the file \n","f = open('/kaggle/input/wordpress-ddos-log-dataset/Wordpress DDOS attack Logs.txt', \"r\") \n","\n","#initialize an empty list\n","mylist = [] \n","\n","#iterate through each line in the file\n","for line in f: \n","  \n","    #strip the newline character \n","    line = line.strip() \n","  \n","    #append the line to the list \n","    mylist.append(line) \n","  \n","#close the file \n","f.close() "]},{"cell_type":"markdown","id":"1f4fdfeb","metadata":{"papermill":{"duration":0.004842,"end_time":"2023-04-28T04:41:05.798509","exception":false,"start_time":"2023-04-28T04:41:05.793667","status":"completed"},"tags":[]},"source":["- This converts the log.txt file into a list "]},{"cell_type":"code","execution_count":5,"id":"fcefa85d","metadata":{"execution":{"iopub.execute_input":"2023-04-28T04:41:05.810837Z","iopub.status.busy":"2023-04-28T04:41:05.810438Z","iopub.status.idle":"2023-04-28T04:41:05.822239Z","shell.execute_reply":"2023-04-28T04:41:05.821188Z"},"papermill":{"duration":0.021196,"end_time":"2023-04-28T04:41:05.824823","exception":false,"start_time":"2023-04-28T04:41:05.803627","status":"completed"},"tags":[]},"outputs":[],"source":["import re\n","list1 = []\n","list2 = []\n","list3 = []\n","list4 = []\n","list5 = []\n","for line in mylist:\n","    word = str(line)\n","    parts = re.split(r'[\\s\\[\\]\\\"]+', word)\n","    list1.append(parts[0])\n","    list2.append(parts[3])\n","    list3.append(parts[8:10])\n","    list4.append(parts[11])\n","    list5.append(parts[12])"]},{"cell_type":"markdown","id":"a2ced87f","metadata":{"papermill":{"duration":0.004805,"end_time":"2023-04-28T04:41:05.834848","exception":false,"start_time":"2023-04-28T04:41:05.830043","status":"completed"},"tags":[]},"source":["- This line then converts the list into different lists representing the column of our data"]},{"cell_type":"code","execution_count":6,"id":"514d6f6b","metadata":{"execution":{"iopub.execute_input":"2023-04-28T04:41:05.847191Z","iopub.status.busy":"2023-04-28T04:41:05.84659Z","iopub.status.idle":"2023-04-28T04:41:05.877004Z","shell.execute_reply":"2023-04-28T04:41:05.875462Z"},"papermill":{"duration":0.039729,"end_time":"2023-04-28T04:41:05.879855","exception":false,"start_time":"2023-04-28T04:41:05.840126","status":"completed"},"tags":[]},"outputs":[{"data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>IP adress</th>\n","      <th>DateandTime</th>\n","      <th>Port</th>\n","      <th>Wordpress Version</th>\n","      <th>Website</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>188.121.41.140</td>\n","      <td>23/Sep/2013:13:02:47</td>\n","      <td>[200, 8955]</td>\n","      <td>WordPress/3.0.2;</td>\n","      <td>http://www.cakefantasia.com</td>\n","    </tr>\n","    <tr>\n","      <th>1</th>\n","      <td>81.169.144.135</td>\n","      <td>23/Sep/2013:13:02:47</td>\n","      <td>[200, 8955]</td>\n","      <td>WordPress/3.6.1;</td>\n","      <td>http://aifs2.pvdveen.net</td>\n","    </tr>\n","    <tr>\n","      <th>2</th>\n","      <td>91.184.18.50</td>\n","      <td>23/Sep/2013:13:02:47</td>\n","      <td>[200, 8955]</td>\n","      <td>WordPress/3.5.1;</td>\n","      <td>http://sociedia.com</td>\n","    </tr>\n","    <tr>\n","      <th>3</th>\n","      <td>184.154.224.17</td>\n","      <td>23/Sep/2013:13:02:47</td>\n","      <td>[200, 8955]</td>\n","      <td>WordPress/3.6;</td>\n","      <td>http://photekusa.com</td>\n","    </tr>\n","    <tr>\n","      <th>4</th>\n","      <td>209.15.245.58</td>\n","      <td>23/Sep/2013:13:02:47</td>\n","      <td>[200, 8955]</td>\n","      <td>WordPress/3.5.2;</td>\n","      <td>http://enabledkids.ca</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["        IP adress           DateandTime         Port Wordpress Version  \\\n","0  188.121.41.140  23/Sep/2013:13:02:47  [200, 8955]  WordPress/3.0.2;   \n","1  81.169.144.135  23/Sep/2013:13:02:47  [200, 8955]  WordPress/3.6.1;   \n","2    91.184.18.50  23/Sep/2013:13:02:47  [200, 8955]  WordPress/3.5.1;   \n","3  184.154.224.17  23/Sep/2013:13:02:47  [200, 8955]    WordPress/3.6;   \n","4   209.15.245.58  23/Sep/2013:13:02:47  [200, 8955]  WordPress/3.5.2;   \n","\n","                       Website  \n","0  http://www.cakefantasia.com  \n","1     http://aifs2.pvdveen.net  \n","2          http://sociedia.com  \n","3         http://photekusa.com  \n","4        http://enabledkids.ca  "]},"metadata":{},"output_type":"display_data"}],"source":["dict = {'IP adress':list1,\n","        'DateandTime':list2,\n","        'Port':list3,\n","        'Wordpress Version':list4,\n","        'Website': list5}\n","df = pd.DataFrame(dict)\n","display(df.head())"]},{"cell_type":"markdown","id":"0ab049d6","metadata":{"papermill":{"duration":0.005316,"end_time":"2023-04-28T04:41:05.890568","exception":false,"start_time":"2023-04-28T04:41:05.885252","status":"completed"},"tags":[]},"source":["- Here  the data is turned into a pandas dataframe (more like a table)"]},{"cell_type":"code","execution_count":7,"id":"ddc63db9","metadata":{"execution":{"iopub.execute_input":"2023-04-28T04:41:05.903747Z","iopub.status.busy":"2023-04-28T04:41:05.90263Z","iopub.status.idle":"2023-04-28T04:41:05.919439Z","shell.execute_reply":"2023-04-28T04:41:05.918198Z"},"papermill":{"duration":0.025958,"end_time":"2023-04-28T04:41:05.921889","exception":false,"start_time":"2023-04-28T04:41:05.895931","status":"completed"},"tags":[]},"outputs":[{"data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>0</th>\n","      <th>1</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>23/Sep/2013</td>\n","      <td>13:02:47</td>\n","    </tr>\n","    <tr>\n","      <th>1</th>\n","      <td>23/Sep/2013</td>\n","      <td>13:02:47</td>\n","    </tr>\n","    <tr>\n","      <th>2</th>\n","      <td>23/Sep/2013</td>\n","      <td>13:02:47</td>\n","    </tr>\n","    <tr>\n","      <th>3</th>\n","      <td>23/Sep/2013</td>\n","      <td>13:02:47</td>\n","    </tr>\n","    <tr>\n","      <th>4</th>\n","      <td>23/Sep/2013</td>\n","      <td>13:02:47</td>\n","    </tr>\n","    <tr>\n","      <th>...</th>\n","      <td>...</td>\n","      <td>...</td>\n","    </tr>\n","    <tr>\n","      <th>564</th>\n","      <td>23/Sep/2013</td>\n","      <td>13:03:13</td>\n","    </tr>\n","    <tr>\n","      <th>565</th>\n","      <td>23/Sep/2013</td>\n","      <td>13:03:13</td>\n","    </tr>\n","    <tr>\n","      <th>566</th>\n","      <td>23/Sep/2013</td>\n","      <td>13:03:13</td>\n","    </tr>\n","    <tr>\n","      <th>567</th>\n","      <td>23/Sep/2013</td>\n","      <td>13:03:13</td>\n","    </tr>\n","    <tr>\n","      <th>568</th>\n","      <td>23/Sep/2013</td>\n","      <td>13:03:13</td>\n","    </tr>\n","  </tbody>\n","</table>\n","<p>569 rows × 2 columns</p>\n","</div>"],"text/plain":["               0         1\n","0    23/Sep/2013  13:02:47\n","1    23/Sep/2013  13:02:47\n","2    23/Sep/2013  13:02:47\n","3    23/Sep/2013  13:02:47\n","4    23/Sep/2013  13:02:47\n","..           ...       ...\n","564  23/Sep/2013  13:03:13\n","565  23/Sep/2013  13:03:13\n","566  23/Sep/2013  13:03:13\n","567  23/Sep/2013  13:03:13\n","568  23/Sep/2013  13:03:13\n","\n","[569 rows x 2 columns]"]},"execution_count":7,"metadata":{},"output_type":"execute_result"}],"source":["DateTimeSplit = df[\"DateandTime\"].str.split(\":\", n = 1, expand = True)\n","DateTimeSplit"]},{"cell_type":"markdown","id":"7d9071bc","metadata":{"papermill":{"duration":0.005429,"end_time":"2023-04-28T04:41:05.933219","exception":false,"start_time":"2023-04-28T04:41:05.92779","status":"completed"},"tags":[]},"source":["- split the date and time column into date column and time column"]},{"cell_type":"code","execution_count":8,"id":"5bc106d6","metadata":{"execution":{"iopub.execute_input":"2023-04-28T04:41:05.946691Z","iopub.status.busy":"2023-04-28T04:41:05.946238Z","iopub.status.idle":"2023-04-28T04:41:05.969785Z","shell.execute_reply":"2023-04-28T04:41:05.968608Z"},"papermill":{"duration":0.033714,"end_time":"2023-04-28T04:41:05.972401","exception":false,"start_time":"2023-04-28T04:41:05.938687","status":"completed"},"tags":[]},"outputs":[{"data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>IP adress</th>\n","      <th>DateandTime</th>\n","      <th>Port</th>\n","      <th>Wordpress Version</th>\n","      <th>Website</th>\n","      <th>DT</th>\n","      <th>Time</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>188.121.41.140</td>\n","      <td>23/Sep/2013:13:02:47</td>\n","      <td>[200, 8955]</td>\n","      <td>WordPress/3.0.2;</td>\n","      <td>http://www.cakefantasia.com</td>\n","      <td>23/Sep/2013</td>\n","      <td>13:02:47</td>\n","    </tr>\n","    <tr>\n","      <th>1</th>\n","      <td>81.169.144.135</td>\n","      <td>23/Sep/2013:13:02:47</td>\n","      <td>[200, 8955]</td>\n","      <td>WordPress/3.6.1;</td>\n","      <td>http://aifs2.pvdveen.net</td>\n","      <td>23/Sep/2013</td>\n","      <td>13:02:47</td>\n","    </tr>\n","    <tr>\n","      <th>2</th>\n","      <td>91.184.18.50</td>\n","      <td>23/Sep/2013:13:02:47</td>\n","      <td>[200, 8955]</td>\n","      <td>WordPress/3.5.1;</td>\n","      <td>http://sociedia.com</td>\n","      <td>23/Sep/2013</td>\n","      <td>13:02:47</td>\n","    </tr>\n","    <tr>\n","      <th>3</th>\n","      <td>184.154.224.17</td>\n","      <td>23/Sep/2013:13:02:47</td>\n","      <td>[200, 8955]</td>\n","      <td>WordPress/3.6;</td>\n","      <td>http://photekusa.com</td>\n","      <td>23/Sep/2013</td>\n","      <td>13:02:47</td>\n","    </tr>\n","    <tr>\n","      <th>4</th>\n","      <td>209.15.245.58</td>\n","      <td>23/Sep/2013:13:02:47</td>\n","      <td>[200, 8955]</td>\n","      <td>WordPress/3.5.2;</td>\n","      <td>http://enabledkids.ca</td>\n","      <td>23/Sep/2013</td>\n","      <td>13:02:47</td>\n","    </tr>\n","    <tr>\n","      <th>...</th>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","    </tr>\n","    <tr>\n","      <th>564</th>\n","      <td>216.201.128.7</td>\n","      <td>23/Sep/2013:13:03:13</td>\n","      <td>[503, 913]</td>\n","      <td>WordPress/3.5;</td>\n","      <td>http://www.theleadernews.com</td>\n","      <td>23/Sep/2013</td>\n","      <td>13:03:13</td>\n","    </tr>\n","    <tr>\n","      <th>565</th>\n","      <td>130.185.84.2</td>\n","      <td>23/Sep/2013:13:03:13</td>\n","      <td>[503, 913]</td>\n","      <td>WordPress/3.2.1;</td>\n","      <td>http://www.gerirepoupar.com/jovens</td>\n","      <td>23/Sep/2013</td>\n","      <td>13:03:13</td>\n","    </tr>\n","    <tr>\n","      <th>566</th>\n","      <td>142.4.38.98</td>\n","      <td>23/Sep/2013:13:03:13</td>\n","      <td>[503, 913]</td>\n","      <td>WordPress/3.6;</td>\n","      <td>http://caithatescake.com</td>\n","      <td>23/Sep/2013</td>\n","      <td>13:03:13</td>\n","    </tr>\n","    <tr>\n","      <th>567</th>\n","      <td>184.154.225.8</td>\n","      <td>23/Sep/2013:13:03:13</td>\n","      <td>[503, 913]</td>\n","      <td>WordPress/3.3.2;</td>\n","      <td>http://diglitny.org/blog</td>\n","      <td>23/Sep/2013</td>\n","      <td>13:03:13</td>\n","    </tr>\n","    <tr>\n","      <th>568</th>\n","      <td>69.163.225.185</td>\n","      <td>23/Sep/2013:13:03:13</td>\n","      <td>[503, 913]</td>\n","      <td>WordPress/3.6.1;</td>\n","      <td>http://www.thehtc.ca</td>\n","      <td>23/Sep/2013</td>\n","      <td>13:03:13</td>\n","    </tr>\n","  </tbody>\n","</table>\n","<p>569 rows × 7 columns</p>\n","</div>"],"text/plain":["          IP adress           DateandTime         Port Wordpress Version  \\\n","0    188.121.41.140  23/Sep/2013:13:02:47  [200, 8955]  WordPress/3.0.2;   \n","1    81.169.144.135  23/Sep/2013:13:02:47  [200, 8955]  WordPress/3.6.1;   \n","2      91.184.18.50  23/Sep/2013:13:02:47  [200, 8955]  WordPress/3.5.1;   \n","3    184.154.224.17  23/Sep/2013:13:02:47  [200, 8955]    WordPress/3.6;   \n","4     209.15.245.58  23/Sep/2013:13:02:47  [200, 8955]  WordPress/3.5.2;   \n","..              ...                   ...          ...               ...   \n","564   216.201.128.7  23/Sep/2013:13:03:13   [503, 913]    WordPress/3.5;   \n","565    130.185.84.2  23/Sep/2013:13:03:13   [503, 913]  WordPress/3.2.1;   \n","566     142.4.38.98  23/Sep/2013:13:03:13   [503, 913]    WordPress/3.6;   \n","567   184.154.225.8  23/Sep/2013:13:03:13   [503, 913]  WordPress/3.3.2;   \n","568  69.163.225.185  23/Sep/2013:13:03:13   [503, 913]  WordPress/3.6.1;   \n","\n","                                Website           DT      Time  \n","0           http://www.cakefantasia.com  23/Sep/2013  13:02:47  \n","1              http://aifs2.pvdveen.net  23/Sep/2013  13:02:47  \n","2                   http://sociedia.com  23/Sep/2013  13:02:47  \n","3                  http://photekusa.com  23/Sep/2013  13:02:47  \n","4                 http://enabledkids.ca  23/Sep/2013  13:02:47  \n","..                                  ...          ...       ...  \n","564        http://www.theleadernews.com  23/Sep/2013  13:03:13  \n","565  http://www.gerirepoupar.com/jovens  23/Sep/2013  13:03:13  \n","566            http://caithatescake.com  23/Sep/2013  13:03:13  \n","567            http://diglitny.org/blog  23/Sep/2013  13:03:13  \n","568                http://www.thehtc.ca  23/Sep/2013  13:03:13  \n","\n","[569 rows x 7 columns]"]},"metadata":{},"output_type":"display_data"}],"source":["df[\"DT\"]= DateTimeSplit[0]\n","df[\"Time\"]= DateTimeSplit[1]\n","display(df)"]},{"cell_type":"code","execution_count":9,"id":"88fe22a0","metadata":{"execution":{"iopub.execute_input":"2023-04-28T04:41:05.987176Z","iopub.status.busy":"2023-04-28T04:41:05.986707Z","iopub.status.idle":"2023-04-28T04:41:06.010557Z","shell.execute_reply":"2023-04-28T04:41:06.009302Z"},"papermill":{"duration":0.033645,"end_time":"2023-04-28T04:41:06.013022","exception":false,"start_time":"2023-04-28T04:41:05.979377","status":"completed"},"tags":[]},"outputs":[{"data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>IP adress</th>\n","      <th>Port</th>\n","      <th>Wordpress Version</th>\n","      <th>Website</th>\n","      <th>DT</th>\n","      <th>Time</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>188.121.41.140</td>\n","      <td>[200, 8955]</td>\n","      <td>WordPress/3.0.2;</td>\n","      <td>http://www.cakefantasia.com</td>\n","      <td>23/Sep/2013</td>\n","      <td>13:02:47</td>\n","    </tr>\n","    <tr>\n","      <th>1</th>\n","      <td>81.169.144.135</td>\n","      <td>[200, 8955]</td>\n","      <td>WordPress/3.6.1;</td>\n","      <td>http://aifs2.pvdveen.net</td>\n","      <td>23/Sep/2013</td>\n","      <td>13:02:47</td>\n","    </tr>\n","    <tr>\n","      <th>2</th>\n","      <td>91.184.18.50</td>\n","      <td>[200, 8955]</td>\n","      <td>WordPress/3.5.1;</td>\n","      <td>http://sociedia.com</td>\n","      <td>23/Sep/2013</td>\n","      <td>13:02:47</td>\n","    </tr>\n","    <tr>\n","      <th>3</th>\n","      <td>184.154.224.17</td>\n","      <td>[200, 8955]</td>\n","      <td>WordPress/3.6;</td>\n","      <td>http://photekusa.com</td>\n","      <td>23/Sep/2013</td>\n","      <td>13:02:47</td>\n","    </tr>\n","    <tr>\n","      <th>4</th>\n","      <td>209.15.245.58</td>\n","      <td>[200, 8955]</td>\n","      <td>WordPress/3.5.2;</td>\n","      <td>http://enabledkids.ca</td>\n","      <td>23/Sep/2013</td>\n","      <td>13:02:47</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["        IP adress         Port Wordpress Version                      Website  \\\n","0  188.121.41.140  [200, 8955]  WordPress/3.0.2;  http://www.cakefantasia.com   \n","1  81.169.144.135  [200, 8955]  WordPress/3.6.1;     http://aifs2.pvdveen.net   \n","2    91.184.18.50  [200, 8955]  WordPress/3.5.1;          http://sociedia.com   \n","3  184.154.224.17  [200, 8955]    WordPress/3.6;         http://photekusa.com   \n","4   209.15.245.58  [200, 8955]  WordPress/3.5.2;        http://enabledkids.ca   \n","\n","            DT      Time  \n","0  23/Sep/2013  13:02:47  \n","1  23/Sep/2013  13:02:47  \n","2  23/Sep/2013  13:02:47  \n","3  23/Sep/2013  13:02:47  \n","4  23/Sep/2013  13:02:47  "]},"metadata":{},"output_type":"display_data"}],"source":["df = df.drop('DateandTime',axis =1)\n","df['Time'] = pd.to_datetime(df['Time'], dayfirst=True).dt.time\n","display(df.head())"]},{"cell_type":"markdown","id":"96e4768f","metadata":{"papermill":{"duration":0.005667,"end_time":"2023-04-28T04:41:06.02471","exception":false,"start_time":"2023-04-28T04:41:06.019043","status":"completed"},"tags":[]},"source":["- The above code completes cleaning the data\n","- it makes date and time different columns and deletes the original DateandTime column\n","- Now the code as been fully converted to a usable dataframe "]},{"cell_type":"code","execution_count":10,"id":"2de90b64","metadata":{"execution":{"iopub.execute_input":"2023-04-28T04:41:06.038566Z","iopub.status.busy":"2023-04-28T04:41:06.03811Z","iopub.status.idle":"2023-04-28T04:41:06.051956Z","shell.execute_reply":"2023-04-28T04:41:06.050596Z"},"papermill":{"duration":0.024156,"end_time":"2023-04-28T04:41:06.054922","exception":false,"start_time":"2023-04-28T04:41:06.030766","status":"completed"},"tags":[]},"outputs":[],"source":["df.to_csv('wordpress_ddos_log_transform.csv')"]},{"cell_type":"markdown","id":"cab16f97","metadata":{"papermill":{"duration":0.005951,"end_time":"2023-04-28T04:41:06.067644","exception":false,"start_time":"2023-04-28T04:41:06.061693","status":"completed"},"tags":[]},"source":["- The Above code turns the dataframe into a csv file\n","- This was How i changed the log txt to log csv\n","- if you have a more efficient way please contact me "]},{"cell_type":"code","execution_count":null,"id":"01384f3e","metadata":{"papermill":{"duration":0.00562,"end_time":"2023-04-28T04:41:06.079302","exception":false,"start_time":"2023-04-28T04:41:06.073682","status":"completed"},"tags":[]},"outputs":[],"source":[]}],"metadata":{"kernelspec":{"display_name":"Python 3","language":"python","name":"python3"},"language_info":{"codemirror_mode":{"name":"ipython","version":3},"file_extension":".py","mimetype":"text/x-python","name":"python","nbconvert_exporter":"python","pygments_lexer":"ipython3","version":"3.7.12"},"papermill":{"default_parameters":{},"duration":14.329327,"end_time":"2023-04-28T04:41:06.909526","environment_variables":{},"exception":null,"input_path":"__notebook__.ipynb","output_path":"__notebook__.ipynb","parameters":{},"start_time":"2023-04-28T04:40:52.580199","version":"2.4.0"}},"nbformat":4,"nbformat_minor":5}