Spider

Prerequisites

Spider depends on the Nokogiri HTML parsing library, and the HTTPClient library, which may be installed as follows:

gem install httpclient

gem install nokogiri

You may need to follow http://nokogiri.org/tutorials/installing_nokogiri.html

Usage

ruby spider http://example.com > example.html