Search pirate/sites-using-cloudflare for a domain name using Elasticsearch, exposed as a queryable API.
Public instance: https://cloudbleed-api.whats-th.is (running under CloudFlare :^) - this is also ratelimited)
- Launch Elasticsearch and make the
domains
index (see below) - Import your data (see below)
- Build
cloudbleed-search-api.go
- Run (use environment variables
PORT
andELASTIC_ENDPOINT
to change default config variables) - Enjoy
{
"mappings": {
"cloudbleed_domain":{
"properties":{
"domain":{
"type": "text",
"analyzer": "keyword",
"fielddata": true,
"index": true,
"index_options": "docs",
"store": true
}
}
}
}
}
- Download the latest text file of CloudFlare domains as
/import.txt
- Run
tail -c +2 /import.txt > /temp.txt && mv /temp.txt /import.txt
(remove leading empty line) - Run
logstash -f logstash-import
(after changing Elasticsearch host) - Wait a while (until Elastic CPU drops to idle again)
A copy of the MIT license can be found in LICENSE
.