JetBot is JetEye's Web crawler. Our robot identifies, retrieves and stores Web documents to build a searchable index for the JetEye search engine. What follows below are answers to frequently asked questions about how we collect pages, why certain entries show up in Web server logs and options available to you as the Webmaster or site owner to increase or decrease crawling on your site.
(continua.. http://www.jeteye.com/jetbot.html)

credo occorra registrarsi per usare il motore