← Back to Changelog

Automated Page Crawler for Semantic Redirects

Turn your Shopify pages into search destinations — automatically.

Layers now crawls your store's published pages daily, identifies content-rich pages like FAQs, return policies, and size guides, and generates semantic redirect terms for each one. When a customer searches for something like "how do I return an item," they can be directed straight to your Returns page.

The crawler runs automatically in the background:

  • AI-powered triage — Only pages likely to answer customer questions are processed, skipping generic or thin content
  • Smart term generation — Each page produces up to 6 natural-language search terms based on its content
  • Deduplication built in — Pages already processed are cached for 30 days, and terms that overlap with existing redirects are automatically skipped
  • Source tracking — Crawler-generated redirects are labeled with a "Crawler" badge in the dashboard so you can distinguish them from manually created ones

All redirects are fully editable in the dashboard. You can review, modify, or remove any crawler-generated redirect at any time.

FeatureAI SearchSemantic RedirectsPage Crawler