Skip to content

Custom SQLite Scraper for use with KaiOS SQLite extractions

License

Notifications You must be signed in to change notification settings

joedinsmoor/KaiOS.Scraper

Repository files navigation

SQLite Scraper

Custom SQLite Scraper for use with KaiOS SQLite extractions

  • Only for use on extractions of SQLite DBs pulled from KaiOS based cell phones
  • Pulls hex data from object_data table of imported db
  • Removes extraneous data from row, and prints in human readable format
  • Exports scraped phone numbers to 'phone_numbers.csv'
  • Logs output to 'run.log'
  • Exports phone numbers to csv file (thanks to @phoenixrising1800)
  • Unscrambles scrambled db filenames for user friendliness
  • Full directory parsing of all SQLite dbs

OS Support

  • Windows
  • MacOS (Apple Silicon and Intel)
    • Apple Silicon struggles with PIL, will be fixed soon
  • Linux

Installation

  • run python3 pip install -r requirements.txt
  • all dependencies are now installed, run with python3 sqlite_scraper.py

Coming Soon

  • Setup and installation configurations
  • Geolocation tagging with relevant connections to event logs using Google Earth
  • Timestamp recording with events tied to timestamps
  • Command Line options that allow automated, repeatable runs
    • Verbose mode, help menu, select between single file and whole dir, what to scan for etc.
  • Link logs to overarching autogenerated HTML report
    • Adding command line option to include investigator information within report
  • Deeper test coverage with Rust, testing environment options, and setting dependecies for specific operating systems and platforms

Future Features

  • Ability to handle images, and recover them
  • Ability to eventually handle all SQLite DBs, not just extracted from KaiOS

Feel free to dm me on twitter Twitter URL with any questions or feature requests!