Search engines use crawlers to find and index content on your website. If crawlers cannot reach your pages, they will not appear in search results. This guide helps you fix common problems that block crawlers.
Orphan pages are pages no other page links to. Crawlers cannot find them. You need to add internal links. Crawl budget is the limited number of pages a search engine will check. Large sites waste this budget on duplicate pages or redirect loops. Fixing these issues helps more of your content get indexed.
Site structure matters too. Important pages should be a few clicks from the homepage. Avoid infinite scroll because crawlers cannot scroll. Use pagination instead. These steps make your site easier for search engines to understand.
Global
mkdir -p ~/.claude/skills/site-crawlabilityProject
mkdir -p .claude/skills/site-crawlabilitySource Repository
Twitter Automationhalt-catch-fire/skills
Automate posting, liking, retweeting, and following on Twitter from your command line
Twitter Automationqu-skills/skills
Control your Twitter account with simple commands. Post, like, follow, and more
Twitter Automationskills-shell/skills
Automate your Twitter account with simple commands for posting and engagement
Seo Auditcoreyhaines31/marketingskills
Find and fix SEO issues to boost your Google rankings and traffic
Copywritingcoreyhaines31/marketingskills
Write clear and compelling marketing copy that drives action and converts visitors
Viral Short Formvyralcontent/content-skills
Brainstorm high-retention hooks and scripts for TikTok, Reels, and Shorts
Marketing Psychologycoreyhaines31/marketingskills
Apply proven psychological principles and mental models to ethical marketing campaigns
Content Strategycoreyhaines31/marketingskills
Plan content that drives traffic, builds authority, and generates leads