name: Screaming Frog SEO Spider Vocabulary
description: Taxonomy and vocabulary for the Screaming Frog SEO Spider crawl tool and its API integrations
version: 1.0.0
created: '2026-05-02'
modified: '2026-05-02'
terms:
- term: crawl
  label: Crawl
  definition: The automated process of systematically browsing a website, following links and recording SEO-relevant data for each URL
  related:
  - spider
  - url
  - crawl-depth
- term: spider
  label: SEO Spider
  definition: The core Screaming Frog tool that performs website crawling, mimicking how search engine bots discover and index web pages
  related:
  - crawl
  - user-agent
- term: crawl-depth
  label: Crawl Depth
  definition: The number of clicks from the start URL required to reach a given page. Deeper pages are generally harder for search engines to discover
  type: measurement
- term: indexability
  label: Indexability
  definition: Whether a page can be indexed by search engines. Non-indexable reasons include noindex meta tags, X-Robots-Tag headers, canonical tags pointing elsewhere, or robots.txt blocks
  values:
  - Indexable
  - Non-Indexable
- term: canonical
  label: Canonical URL
  definition: The preferred URL for a page specified via rel=canonical link element, used to prevent duplicate content issues
  related:
  - indexability
- term: inlinks
  label: Internal Links
  definition: Links from other pages within the same website pointing to a given URL. More inlinks generally indicates higher page importance
  type: measurement
- term: outlinks
  label: Outlinks
  definition: Links from a page pointing to other URLs, both internal and external
  type: measurement
- term: response-time
  label: Response Time
  definition: The time in seconds for the server to return the page content. Slower response times negatively impact Core Web Vitals
  type: measurement
- term: status-code
  label: HTTP Status Code
  definition: Three-digit HTTP response code indicating the request outcome. Common SEO-relevant codes include 200 (OK), 301 (Permanent Redirect), 302 (Temporary Redirect), 404 (Not Found), 500 (Server Error)
  type: enumeration
- term: core-web-vitals
  label: Core Web Vitals
  definition: Google's user experience metrics measuring Largest Contentful Paint (LCP), Cumulative Layout Shift (CLS), and Interaction to Next Paint (INP), available via PageSpeed Insights API integration
  related:
  - pagespeed-insights
- term: pagespeed-insights
  label: PageSpeed Insights
  definition: Google's API providing performance metrics and Lighthouse scores, integrated into Screaming Frog crawls via the API Access feature
  related:
  - core-web-vitals
- term: api-access
  label: API Access
  definition: Screaming Frog's feature for connecting third-party APIs including Google Analytics, Google Search Console, PageSpeed Insights, Ahrefs, Majestic, Moz, and AI services
  related:
  - google-analytics
  - search-console
- term: google-analytics
  label: Google Analytics Integration
  definition: GA4 integration providing session, user, and conversion metrics alongside crawl data in Screaming Frog reports
- term: search-console
  label: Google Search Console Integration
  definition: GSC integration providing impressions, clicks, CTR, average position, and URL Inspection data for crawled URLs
- term: hreflang
  label: Hreflang
  definition: HTML attribute specifying page language and regional targeting for international SEO, validated during Screaming Frog crawls
- term: sitemap
  label: XML Sitemap
  definition: Machine-readable XML file listing URLs for search engine discovery, generated by Screaming Frog as a crawl output
categories:
- name: Core Crawling
  description: Fundamental crawl concepts and URL-level data
  terms: [crawl, spider, crawl-depth, status-code, response-time, inlinks, outlinks]
- name: Indexation
  description: Search engine indexability and canonicalization concepts
  terms: [indexability, canonical, hreflang]
- name: Performance
  description: Page performance measurement and metrics
  terms: [core-web-vitals, pagespeed-insights, response-time]
- name: API Integrations
  description: Third-party API integrations available in Screaming Frog
  terms: [api-access, google-analytics, search-console]
- name: Output
  description: Data outputs and exports generated by Screaming Frog
  terms: [sitemap]