FallGuyBot
A polite research crawler mapping public personal blogs and the links between them.
Identity
FallGuyBot/0.2 (+https://fallguy.zizhaolaisuimuqu.top/bot)
What it does
FallGuyBot reads a small number of public pages to identify personal blogs and public blogroll or friend-link relationships.
Crawl policy
- Respects
robots.txtand crawl delays. - Makes at most one request at a time per host.
- Waits at least two seconds between requests to the same host.
- Does not log in, submit forms, or access private content.
Contact and opt out
To ask a question, stop crawling, or request removal of collected data, email zizhaolaisuimuqu.git@gmail.com with the relevant site or host. No reason is required.