Exercise 5-data-types-and-missing-values.ipynb

{"metadata":{"kernelspec":{"display_name":"Python 3","language":"python","name":"python3"},"language_info":{"name":"python","version":"3.7.9","mimetype":"text/x-python","codemirror_mode":{"name":"ipython","version":3},"pygments_lexer":"ipython3","nbconvert_exporter":"python","file_extension":".py"}},"nbformat_minor":4,"nbformat":4,"cells":[{"cell_type":"markdown","source":"**This notebook is an exercise in the [Pandas](https://www.kaggle.com/learn/pandas) course.  You can reference the tutorial at [this link](https://www.kaggle.com/residentmario/data-types-and-missing-values).**\n\n---\n","metadata":{}},{"cell_type":"markdown","source":"# Introduction\n\nRun the following cell to load your data and some utility functions.","metadata":{}},{"cell_type":"code","source":"import pandas as pd\n\nreviews = pd.read_csv(\"../input/wine-reviews/winemag-data-130k-v2.csv\", index_col=0)\n\nfrom learntools.core import binder; binder.bind(globals())\nfrom learntools.pandas.data_types_and_missing_data import *\nprint(\"Setup complete.\")","metadata":{"execution":{"iopub.status.busy":"2021-06-18T14:03:39.176067Z","iopub.execute_input":"2021-06-18T14:03:39.176488Z","iopub.status.idle":"2021-06-18T14:03:42.200772Z","shell.execute_reply.started":"2021-06-18T14:03:39.176375Z","shell.execute_reply":"2021-06-18T14:03:42.199773Z"},"trusted":true},"execution_count":1,"outputs":[{"name":"stdout","text":"Setup complete.\n","output_type":"stream"}]},{"cell_type":"markdown","source":"# Exercises","metadata":{}},{"cell_type":"markdown","source":"## 1. \nWhat is the data type of the `points` column in the dataset?","metadata":{}},{"cell_type":"code","source":"# Your code here\ndtype = reviews.points.dtype\n\n# Check your answer\nq1.check()","metadata":{"execution":{"iopub.status.busy":"2021-06-18T14:04:27.455800Z","iopub.execute_input":"2021-06-18T14:04:27.456470Z","iopub.status.idle":"2021-06-18T14:04:27.465419Z","shell.execute_reply.started":"2021-06-18T14:04:27.456416Z","shell.execute_reply":"2021-06-18T14:04:27.464494Z"},"trusted":true},"execution_count":4,"outputs":[{"output_type":"display_data","data":{"text/plain":"<IPython.core.display.Javascript object>","application/javascript":"parent.postMessage({\"jupyterEvent\": \"custom.exercise_interaction\", \"data\": {\"outcomeType\": 1, \"valueTowardsCompletion\": 0.25, \"interactionType\": 1, \"questionType\": 1, \"questionId\": \"1_PointsDtype\", \"learnToolsVersion\": \"0.3.4\", \"failureMessage\": \"\", \"exceptionClass\": \"\", \"trace\": \"\"}}, \"*\")"},"metadata":{}},{"output_type":"display_data","data":{"text/plain":"Correct","text/markdown":"<span style=\"color:#33cc33\">Correct</span>"},"metadata":{}}]},{"cell_type":"code","source":"#q1.hint()\n#q1.solution()","metadata":{},"execution_count":null,"outputs":[]},{"cell_type":"markdown","source":"## 2. \nCreate a Series from entries in the `points` column, but convert the entries to strings. Hint: strings are `str` in native Python.","metadata":{}},{"cell_type":"code","source":"point_strings = reviews.points.astype(str)\n\n# Check your answer\nq2.check()","metadata":{"execution":{"iopub.status.busy":"2021-06-18T14:04:52.965943Z","iopub.execute_input":"2021-06-18T14:04:52.966487Z","iopub.status.idle":"2021-06-18T14:04:53.134123Z","shell.execute_reply.started":"2021-06-18T14:04:52.966417Z","shell.execute_reply":"2021-06-18T14:04:53.133014Z"},"trusted":true},"execution_count":5,"outputs":[{"output_type":"display_data","data":{"text/plain":"<IPython.core.display.Javascript object>","application/javascript":"parent.postMessage({\"jupyterEvent\": \"custom.exercise_interaction\", \"data\": {\"outcomeType\": 1, \"valueTowardsCompletion\": 0.25, \"interactionType\": 1, \"questionType\": 1, \"questionId\": \"2_StrPoints\", \"learnToolsVersion\": \"0.3.4\", \"failureMessage\": \"\", \"exceptionClass\": \"\", \"trace\": \"\"}}, \"*\")"},"metadata":{}},{"output_type":"display_data","data":{"text/plain":"Correct","text/markdown":"<span style=\"color:#33cc33\">Correct</span>"},"metadata":{}}]},{"cell_type":"code","source":"#q2.hint()\n#q2.solution()","metadata":{},"execution_count":null,"outputs":[]},{"cell_type":"markdown","source":"## 3.\nSometimes the price column is null. How many reviews in the dataset are missing a price?","metadata":{}},{"cell_type":"code","source":"n_missing_prices = reviews.price.isnull().sum()\n\n# Check your answer\nq3.check()","metadata":{"execution":{"iopub.status.busy":"2021-06-18T14:05:15.971866Z","iopub.execute_input":"2021-06-18T14:05:15.972224Z","iopub.status.idle":"2021-06-18T14:05:15.982277Z","shell.execute_reply.started":"2021-06-18T14:05:15.972190Z","shell.execute_reply":"2021-06-18T14:05:15.981128Z"},"trusted":true},"execution_count":6,"outputs":[{"output_type":"display_data","data":{"text/plain":"<IPython.core.display.Javascript object>","application/javascript":"parent.postMessage({\"jupyterEvent\": \"custom.exercise_interaction\", \"data\": {\"outcomeType\": 1, \"valueTowardsCompletion\": 0.25, \"interactionType\": 1, \"questionType\": 1, \"questionId\": \"3_CountMissingPrices\", \"learnToolsVersion\": \"0.3.4\", \"failureMessage\": \"\", \"exceptionClass\": \"\", \"trace\": \"\"}}, \"*\")"},"metadata":{}},{"output_type":"display_data","data":{"text/plain":"Correct","text/markdown":"<span style=\"color:#33cc33\">Correct</span>"},"metadata":{}}]},{"cell_type":"code","source":"#q3.hint()\n#q3.solution()","metadata":{},"execution_count":null,"outputs":[]},{"cell_type":"markdown","source":"## 4.\nWhat are the most common wine-producing regions? Create a Series counting the number of times each value occurs in the `region_1` field. This field is often missing data, so replace missing values with `Unknown`. Sort in descending order.  Your output should look something like this:\n\n```\nUnknown                    21247\nNapa Valley                 4480\n                           ...  \nBardolino Superiore            1\nPrimitivo del Tarantino        1\nName: region_1, Length: 1230, dtype: int64\n```","metadata":{}},{"cell_type":"code","source":"reviews_per_region = reviews.region_1.fillna('Unknown').value_counts().sort_values(ascending=False)\n\n# Check your answer\nq4.check()","metadata":{"execution":{"iopub.status.busy":"2021-06-18T14:05:50.481885Z","iopub.execute_input":"2021-06-18T14:05:50.482251Z","iopub.status.idle":"2021-06-18T14:05:50.574423Z","shell.execute_reply.started":"2021-06-18T14:05:50.482218Z","shell.execute_reply":"2021-06-18T14:05:50.573524Z"},"trusted":true},"execution_count":7,"outputs":[{"output_type":"display_data","data":{"text/plain":"<IPython.core.display.Javascript object>","application/javascript":"parent.postMessage({\"jupyterEvent\": \"custom.exercise_interaction\", \"data\": {\"outcomeType\": 1, \"valueTowardsCompletion\": 0.25, \"interactionType\": 1, \"questionType\": 2, \"questionId\": \"4_ReviewsPerRegion\", \"learnToolsVersion\": \"0.3.4\", \"failureMessage\": \"\", \"exceptionClass\": \"\", \"trace\": \"\"}}, \"*\")"},"metadata":{}},{"output_type":"display_data","data":{"text/plain":"Correct","text/markdown":"<span style=\"color:#33cc33\">Correct</span>"},"metadata":{}}]},{"cell_type":"code","source":"#q4.hint()\n#q4.solution()","metadata":{},"execution_count":null,"outputs":[]},{"cell_type":"markdown","source":"# Keep going\n\nMove on to **[renaming and combining](https://www.kaggle.com/residentmario/renaming-and-combining)**.","metadata":{}},{"cell_type":"markdown","source":"---\n\n\n\n\n*Have questions or comments? Visit the [Learn Discussion forum](https://www.kaggle.com/learn-forum/161299) to chat with other Learners.*","metadata":{}}]}