Deep web scanning done right
To scan a list of onion sites and output it to a file:
./redonion -list=./sample/short_list.txt > output.json
Fetchers fetch data from a list of onion sites.
- fetcher.go: (
/fetchers/fetch.go) will get all the HTML data from a certain onion site.
Processors make transformations on the input data. The input data may come from fetchers or from other processors.
-
text: (
/processors/text.go) pass-through processor which will pass the output content from input channel to output channel. -
image: (
/processors/image.go) fetches all website images and inspects various types of metadata
Contributions for new fetchers, processors and outputs welcome.
gpestana © MIT