Skip to content

Black Friday: 50% off your first year on any yearly plan until 30 Nov, with code BLACKFRIDAY See the offer prices

SEOSage

Features / Custom extraction

Custom extraction: pull any data from every page

Add a rule, crawl, and see what every page matched. Collect prices, author names, a tracking ID or any text, link or tag. Use a page element, a pattern, a search of the page source, or your own JavaScript.

Start your 14-day free trial

Jump to: The screen · What it checks · Examples · How it works · Questions

See custom extraction in 20 seconds

Add a rule with a CSS selector, a pattern, a piece of page source or your own JavaScript, crawl, and see what every page matched. Then search the results or export them.

Read the video transcript

Pull any data from every page. Add a rule. Use a CSS selector, a pattern, a piece of page source, or your own JavaScript. Crawl, and see what every page matched. Then export it. Start your fourteen-day free trial at seosage.co.

Independent review

See Extraction in a real test

Matthew Zare used Extraction to give Claude the text of every page of his test site, and Claude found the content problems a crawler cannot measure. The video starts at that part (5:20).

Independent review. Matthew received a free SEOSage licence for this video; we did not see it before it went live or give him a script.

See what every page matched

Open Extraction in the site menu, under Tools, and add up to 10 rules for each site. The rules run on the next crawl.

Tools · Extraction
Custom extractionResults from the latest crawl.
RulePageValue
Price/products/desk/$249
Author/blog/seo-audit/Dana Lee
Tag ID/pricing/GTM-ABC123

Rules: Price (page element .price) · Author (page element meta[name=author], attribute content) · Tag ID (pattern GTM-[A-Z0-9]+)

any page. any tag. all yours.

How a rule works

  • Page element: A CSS selector picks an element. Add an attribute such as href or content if you want that instead of the text
  • Pattern: A regular expression matches a pattern in the page, such as a tracking ID or a price format
  • Page source contains or does not contain: Look for a piece of text in the page source, for example your analytics code, and list the pages that have it or lack it. They show under Issues as Custom search
  • JavaScript on the page: Run your own script on every page in the built-in browser and keep what it returns, for example the number of sub-headings. Crawls are slower with these rules because every page is opened in the browser
  • One value per page: Each value is listed once for each page it appears on
  • Search and Export CSV: See what each page matched, then take it into a spreadsheet

What it does not do

Custom extraction reads the pages SEOSage crawls and nothing else. SEOSage checks a pattern, selector or script when you add the rule and tells you if it is not valid. If a script has a mistake, the error is shown next to the page.

XPath is not supported. Page elements (CSS selectors), patterns and your own JavaScript are.

Example rules

Rules you could add:

  • Price. Page element .price, text of the element.
  • Author. Page element meta[name=author], attribute content.
  • Tag ID. Pattern GTM-[A-Z0-9]+ to find pages that load Google Tag Manager.
  • Missing analytics tag. Page source does not contain gtag( to list the pages without your tracking code.
  • Sub-headings. JavaScript document.querySelectorAll("h2").length to count the sub-headings on each page.

How it works in three steps

  1. Add your rules.Name each rule and choose its type: page element, pattern, page source contains or does not contain, or JavaScript.
  2. Crawl the website.The rules are used on the next crawl, including crawls of sites on your own computer.
  3. Search and export.Check the matches on the page, or export them to CSV.

Related: SEO crawler · local site audit · crawl settings · ecommerce SEO audit.

What is custom data extraction in SEO?

Custom data extraction is the process of automatically pulling specific pieces of information from every page of a website during a crawl. Standard SEO crawlers collect a fixed set of data — titles, descriptions, headings, status codes, canonical tags. Custom extraction lets you define your own rules to collect additional data that is specific to your site: prices on an e-commerce product page, author names on a blog, tracking code IDs, custom meta tags, or any text or attribute that appears in the page source.

For SEO auditing, custom extraction is useful when you need to verify that every page has a specific element — for example, that every product page has a price, that every blog post has a schema author field, or that your analytics tag is present on all pages. Instead of checking pages one by one, a single crawl with a custom extraction rule produces a spreadsheet of every page and what it matched, in minutes.

Common uses for custom extraction

  • Verify that every product page has a price visible in the HTML
  • Check that your Google Tag Manager or analytics code is present on all pages
  • Collect author names from meta tags to audit a multi-author site
  • Find pages that contain a specific phrase (or are missing one) using a text search of the page source
  • Count sub-headings per page to identify pages with thin structure

Types of extraction rules

  • CSS selector: picks a specific element on the page, optionally by attribute (href, content, data-*)
  • Regex pattern: matches a text pattern anywhere in the page source, such as a tracking ID format
  • Page source contains / does not contain: lists pages that include or are missing a specific string
  • JavaScript: runs your own script in a headless browser and returns a value — useful for data that only appears after scripts run

Questions about this check

What is custom extraction in SEO?

It lets a crawler collect extra data from every page, such as prices, authors, tags or IDs, using rules you write. SEOSage supports page elements (CSS selectors), patterns (regular expressions), searches of the page source and your own JavaScript.

How many rules can I add?

Up to 10 rules for each site.

Does it support XPath?

No. Use a CSS selector for page elements, a regular expression for patterns, or a JavaScript rule if you need more.

How do I get an attribute such as a link address?

Use a CSS selector and add the attribute name, for example href, or content for a meta tag.

Can I export the results?

Yes. Search the results on the page and use Export CSV.

Can I find pages that are missing my analytics tag?

Yes. Add a Page source does not contain rule with a piece of your tag, such as gtag(. The pages that lack it are listed under Issues as Custom search. A Page source contains rule lists the pages that have the text, for example a leftover test word.

Can I run my own JavaScript on every page?

Yes. Add a JavaScript on the page rule, for example a script that counts the sub-headings. SEOSage opens each page in its built-in browser, runs your script and shows what it returns. Crawls are slower with these rules because every page is opened in the browser.

Will a wrong rule break my crawl?

No. SEOSage checks a pattern, selector or script when you add the rule and tells you if it is not valid. If a script has a mistake, the error is shown next to the page.

Try it on your own site

Start your 14-day free trial for Mac or Windows. No card needed, no page limits. Then from $9 a month.

Start your 14-day free trial