Skip to content

Automated login bot, data scrap and 'xls' document generator. Made with node.js and puppeter, bootstrap UI

Notifications You must be signed in to change notification settings

harivonyR/puppeteer-webscrap-app

Repository files navigation

puppeteer-webscrap-app

Webscrap app with node.js and puppeteer deployed on heroku.

Site link

https://www.french-property.com/properties-for-sale?start_page=1

puppeteer link

https://developers.google.com/web/tools/puppeteer

Puppeteer builder pack for heroku

Your puppeteer app won't run if your isn't build with puppeteer-heroku-buildpack,
Go to heroku > setting > builder-pack > add this link bellow
https://github.com/jontewks/puppeteer-heroku-buildpack.git

About release

V1

Server runnin with heroku local
Puppeteer open new browser and new page on every srap call

v2

Separated file for utile methode : login ()

v3

Server running on heroku with puppeteer-heroku-buildpack

v3-shared and v4

Handeling multiple scrap request

v5

Handeling multiple request scrap
App, puppeteer don't create new browser or page on every scrap
Handle expired session

About

Automated login bot, data scrap and 'xls' document generator. Made with node.js and puppeter, bootstrap UI

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published