/ FREE TOOL

Free site crawler

Nosy Bat crawls up to 100 pages of a site the way a search engine does (robots.txt obeyed, two requests a second) and scores what it finds against the full rule library. No account needed.

A quick check that you are not a robot.

Own a site and want the free crawler to stay away? Write to [email protected] and we will stop crawling it.

100 pages, raw HTML, one crawl per site per day and 3 crawls per visitor per day. Results are kept 7 days.

Crawl your whole site: up to 25,000 URLs, every export, on a schedule

See plans and pricing → All free tools

What does the free crawl check?

The same rule library as the paid crawler: status codes, titles and descriptions, headings, canonicals, redirects, broken links, indexability, structured data and more, on up to 100 pages of raw HTML.

Does it respect my robots.txt?

Yes. Nosy Bat identifies itself as Echorank360Bot, obeys robots.txt and fetches at most two pages a second.

How long are results kept?

7 days. Anyone with the result link can see it until then; the full list needs an email.

← All free tools