Skip to content
This repository has been archived by the owner on Dec 30, 2021. It is now read-only.

Latest commit

 

History

History
37 lines (28 loc) · 1.86 KB

README.md

File metadata and controls

37 lines (28 loc) · 1.86 KB
Raw

⚠️ This plugin is deprecated and no longer maintained. Please consider using website-scraper-puppeteer instead.

Version Downloads Build Status

website-scraper-phantom

Plugin for website-scraper which returns html for dynamic websites using PhantomJS.

This module is an Open Source Software maintained by one developer in free time. If you want to thank the author of this module you can use GitHub Sponsors or Patreon.

Requirements

  • nodejs version >= 8
  • website-scraper version >= 4

if you need plugin for website-scraper version < 4, you can find it here (version 0.1.0)

Installation

npm install website-scraper website-scraper-phantom

Usage

const scrape = require('website-scraper');
const PhantomPlugin = require('website-scraper-phantom');

scrape({
    urls: ['https://www.instagram.com/gopro/'],
    directory: '/path/to/save',
    plugins: [ new PhantomPlugin() ]
});

How it works

It starts PhantomJS which just opens page and waits when page is loaded. It is far from ideal because probably you need to wait until some resource is loaded or click some button or log in. Currently this module doesn't support such functionality.