v1.6.15 | Crawlit Engine - Dofus & Dofus-Touch encyclopedia data parser | API builder

Changelog

Added

• Parsing limitations bypassed because of new parsing method
• You can now parse with command line and pass arguments/options to the command (categories, maxItem...)
• Structure of Crawlit has completely changed to a more modular one.
• Crawlit provide you MongoDb file ready to be imported in your DB.
• Full parse with 1 command : you can now parse the entire encyclopedia with 1 command
• Full english version of the encyclopedia can be parsed (for Dofus & Dofus-Touch)

Changed

• Categories scrappers are now based on "Models" (for structure definition).
• Structure of categories json changed to be more flexible.
• Crawlit is now based on "request-promise-native" instead of "request-promise" because of ES6 support.
• Error management changed : we have now a module "ErrorHandler" to centralize error msg and code.

Deleted

• No more possibility to package the app with "pkg" module.