AI AGENT ADDONS

Site Crawlability

kostja94/marketing-skills
Marketing & SEO
805installs

Search engines use crawlers to find and index content on your website. If crawlers cannot reach your pages, they will not appear in search results. This guide helps you fix common problems that block crawlers.

Orphan pages are pages no other page links to. Crawlers cannot find them. You need to add internal links. Crawl budget is the limited number of pages a search engine will check. Large sites waste this budget on duplicate pages or redirect loops. Fixing these issues helps more of your content get indexed.

Site structure matters too. Important pages should be a few clicks from the homepage. Avoid infinite scroll because crawlers cannot scroll. Use pagination instead. These steps make your site easier for search engines to understand.

Add Site Crawlability skill to your workflow

Global

mkdir -p ~/.claude/skills/site-crawlability

Project

mkdir -p .claude/skills/site-crawlability

Source Repository

Stars
676
Forks
100
Watchers
676
License
MIT
Last Push
1 month ago
Created
4 months ago