Skip to content

Game metadata scraping tool using the Launchbox database

Notifications You must be signed in to change notification settings

Fr75s/bigscraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 

Repository files navigation

bigscraper

Bigscraper is a metadata scraper for launchbox. It directly scrapes launchbox's website, as in, it finds the games needed and gets metadata through reading the Launchbox website content.

To use bigscraper, check out the tutorial

How it works

Bigscraper directly downloads the contents of Launchbox's game database website. It reads these contents, and attempts to find matches for the games that are being scraped for. If it finds them, then it gets the content of the games' details and images pages through reading their respective sites.

The above reveals why this is bigscraper. As bigscraper needs to download many pages for launchbox, as well as downloading all the images, bigscraper requires a good internet connection and plenty of storage. Many games on the launchbox database have many different images, which quickly fill up storage. Bigscraper is not designed for lightweight systems. Do not use bigscraper if you have a poor internet connection or low storage.

Installation

Installing bigscraper is somewhat easy.

First, make sure you have python installed on your system, as well as the pip package manager.

Next, run the following commands. These download the repo, then install bigscraper using pip.

git clone https://github.com/Fr75s/bigscraper.git
cd bigscraper
pip install .

(pip install bigscraper coming soon)

About

Game metadata scraping tool using the Launchbox database

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Languages