Web scraping is useful for getting data from websites. But many sites use anti-bot protections that block simple requests. Scrapling is a Python library designed to handle this problem. It can bypass systems like Cloudflare Turnstile and extract the content you need.
The library includes adaptive parsing, which means it learns when a website changes and finds your data again automatically. It also has a spider framework for large scale crawling with pause, resume, and proxy rotation. You can use stealth headless browsers and JavaScript rendering to get modern web pages.
Scrapling works with simple commands or Python code. It is built for both beginners and experts. If you need to scrape or crawl any website, this tool makes it easier and more reliable.
Global
mkdir -p ~/.claude/skills/scrapling-officialProject
mkdir -p .claude/skills/scrapling-officialSource Repository
Agent Browservercel-labs/agent-browser
Fast browser automation tool for AI agents to control any website
Develop Userscriptsxixu-me/skills
Build and debug browser userscripts for Tampermonkey and ScriptCat
Just Scrapescrapegraphai/just-scrape
Search, scrape, crawl, and monitor web pages with an easy command line tool
Browser Actbrowser-act/skills
AI agents use browser-act to automate web tasks like fetch forms screenshots and complex workflows
Firecrawlfirecrawl/cli
Search, scrape, and crawl websites with one simple command line tool
Playwright Climicrosoft/playwright-cli
Automate browser tasks and test web pages with simple terminal commands
Browser Usebrowser-use/browser-use
Automate web testing, form filling, and screenshots with simple CLI commands
Browser Act Skill Forgebrowser-act/skills
Explore any website once and create reusable skill packages forever