SEO Web Spider
Technical SEO Software
-
FULL DOM CRAWLER
Crawl rendered pages, follow internal links and capture the complete DOM.
-
CRAWL UP TO 1,000,000 URLs
Crawl anything from small websites to 1,000,000-page sites — even with the free version.
-
FULL INDEXABILITY ANALYSIS
Detect robots.txt blocks, meta robots directives, canonicals, redirects and HTTP status issues.
-
TECHNICAL SEO EXTRACTION
Extract titles, meta data, headings, links and other key on-page SEO signals.
01 / Integrated browser
Browse and analyse every page.
Open pages inside SEO Web Spider and review their SEO data alongside the rendered website. You can see the page and its technical details together, without switching between separate tools.
- Review titles, meta descriptions and headings in context.
- Inspect links, images and on-page SEO signals.
- Move from page to page while keeping the analysis visible.
02 / Crawl results
Turn a complete crawl into clear answers.
Review the URLs found across your website in a structured results table. Filter the crawl, compare key signals and focus on the pages that need attention.
- Check response codes, indexability and page titles.
- Filter and sort results to isolate technical issues.
- Export crawl data for reporting and further analysis.
03 / Watch the crawl
Watch your website unfold.
Follow the crawl while it is running and see each rendered page appear as SEO Web Spider discovers it. Progress stays visible, giving you an immediate picture of how the crawler is moving through the site.
- See pages render as they are discovered.
- Monitor crawl progress and activity in real time.
- Spot unexpected pages and crawl patterns early.
04 / Free vs Pro
Compare Free and Pro.
Professional crawling in both versions
Both versions are unlimited, professional-grade SEO crawlers with the same powerful analysis. Pro adds faster crawling and the professional reporting tools agencies and SEO teams need to create, save, reopen and share custom crawl reports.
| Features |
Free
$0
Free for life
|
Popular
Pro
$79
One-time payment
|
|---|---|---|
| Configurable crawl URL limit Pages and assets | Up to 1 million | Up to 1 million |
| Full DOM crawling & JavaScript rendering | Included | Included |
| Page & asset crawling | Included | Included |
| Local desktop crawling | Included | Included |
| Integrated browser & individual page analysis | Included | Included |
| Page titles, meta descriptions & headings | Included | Included |
| HTML tag counts (H1, H2, H3, P, A, etc.) | Included | Included |
| Page outlining | Included | Included |
| Missing & empty image alt text | Included | Included |
| Word counts & phrase analysis | Included | Included |
| Indexability, robots directives & canonicals | Included | Included |
| HTTP status codes & errors | Included | Included |
| Inlinks, outlinks & crawl depth | Included | Included |
| External-link discovery & header checks | Included | Included |
| Response headers & HTTP redirect details | Included | Included |
| Filter, sort & customise results columns | Included | Included |
| Watch the crawl in real time | Included | Included |
| Crawlers running at once | 1 | Up to12 |
| Open saved crawl reports | Not included | Included |
| Save crawl reports | Not included | Included |
| Export Internal Links results as CSV | Not included | Included |
| Import a list of URLs | Not included | Included |
- The URL limit includes pages and assets. One million is the maximum configurable limit; actual crawl capacity depends on your computer and the website.
- Pro offers 1, 6 or 12 concurrent crawlers, shared between pages and assets. External-link header checks are optional and run after the crawl stops or finishes.