Skip to content

phpanhey/dataport_rust_crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

dataport job crawler ⱒ

a crawler to parse a url f.g. 'https://karriere.dataport.de/stellenangebote.html' for a specific search pattern. crawler follows hrefs and notifies if search_pattern is found: depth 1 .

usage

./dataport_rust_crawler {search_pattern} url_1 url_2

./dataport_rust_crawler "<strong>Bremen</strong>" "https://karriere.dataport.de/stellenangebote.html" "https://karriere.dataport.de/stellenangebote.html?start=100"

About

a generic crawler to extract hrefs

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages