Screaming Frog SEO Spider

The Screaming Frog SEO Spider is a desktop website crawler for Windows, macOS, and Ubuntu that performs comprehensive technical SEO audits. It crawls websites to find broken links, analyze page titles and meta data, discover duplicate content, generate XML sitemaps, and integrate with third-party APIs including Google Analytics, Google Search Console, PageSpeed Insights, Ahrefs, Majestic, Moz, and AI services (OpenAI, Gemini, Ollama, Anthropic). The Spider acts as an API consumer, pulling external metrics and data into crawl reports.

API entry from apis.yml

apis.yml Raw ↑
aid: screaming-frog:seo-spider
name: Screaming Frog SEO Spider
description: The Screaming Frog SEO Spider is a desktop website crawler for Windows, macOS, and Ubuntu
  that performs comprehensive technical SEO audits. It crawls websites to find broken links, analyze page
  titles and meta data, discover duplicate content, generate XML sitemaps, and integrate with third-party
  APIs including Google Analytics, Google Search Console, PageSpeed Insights, Ahrefs, Majestic, Moz, and
  AI services (OpenAI, Gemini, Ollama, Anthropic). The Spider acts as an API consumer, pulling external
  metrics and data into crawl reports.
humanURL: https://www.screamingfrog.co.uk/seo-spider/
tags:
- SEO
- Crawler
- Technical Audit
- Analytics Integration
properties:
- type: Documentation
  url: https://www.screamingfrog.co.uk/seo-spider/user-guide/
- type: Pricing
  url: https://www.screamingfrog.co.uk/seo-spider/pricing/
- type: ReleaseHistory
  url: https://www.screamingfrog.co.uk/seo-spider/release-history/
- type: JSONSchema
  url: https://raw.githubusercontent.com/api-evangelist/screaming-frog/refs/heads/main/json-schema/screaming-frog-crawl-result-schema.json
- type: JSONStructure
  url: https://raw.githubusercontent.com/api-evangelist/screaming-frog/refs/heads/main/json-structure/screaming-frog-crawl-result-structure.json
- type: JSONLDContext
  url: https://raw.githubusercontent.com/api-evangelist/screaming-frog/refs/heads/main/json-ld/screaming-frog-context.jsonld
- type: Vocabulary
  url: https://raw.githubusercontent.com/api-evangelist/screaming-frog/refs/heads/main/vocabulary/screaming-frog-vocabulary.yml
- type: Example
  url: https://raw.githubusercontent.com/api-evangelist/screaming-frog/refs/heads/main/examples/screaming-frog-crawl-result-example.json