The programme extracts the data (Name, Organisation, Project) from a webpage (whose URL is given by the user) and writes it into a csv file
Enter the following command in terminal
python scraping_GSoc <url>
substitute <url> with the url of the webpage which is to be scraped
- The programme has been made to scrape a page that has this layout: https://summerofcode.withgoogle.com/archive/2019/projects/
- The data will be written in a csv file named 'GSoc.csv' in the same directory where the programme is located and run
- The data will be written into the csv file in the following format
Name1 Organisation1 Project1
Name2 Organisation2 Project2
- This is a program that takes a CSV file and a JSON file as input.
- The CSV file need to have the same format, as the one created above.
- This program first finds names that do not look like official names and print them. A name is non-official, if it qualifies at least one of the following properties: 1) The name contains any of the special symbols or numbers. 2) The name consists of only one word. 3) The name contains only lowercase letters.
- The remaining names (that are official names) should be matched against the JSON file that is provided by the user
- The programme prints (to stdout) the details of all the names that are present both in the JSON file and in the CSV file, in the following format:
Name(common to both JSON and CSV), Roll No(from JSON), Branch(from JSON), Organisation(from CSV), Project(from CSV)
Enter the following command in your terminal
python student_names.py <CSV File Name> <JSON File Name>
In place of <CSV File Name> write the name of the csv file (Eg. GSoc.csv)
In place of <JSON File Name> write the name of the JSON file (Eg. students.json)
An example JSON file (students.json) can be found in this repo
This project was done as a part of the Round 1 of selection process for Secretary, PClub, IIT Kanpur