MURAGE
How it worksFeaturesSolutionsUse casesComparePricingDocs
DownloadDownload
MURAGE

An AI Chief of Staff and a team that does the work. Free and open source, from Ferrox Labs.

Product

  • Features
  • How it works
  • Engines and apps
  • Privacy and security
  • Pricing
  • Murage Cloud
  • Download
  • Changelog
  • FAQ

Solutions

  • Solopreneurs
  • Founders and startups
  • Agencies
  • Ecommerce
  • Small business
  • Creators and educators
  • Developers
  • SaaS
  • Nonprofits
  • Consultants and freelancers
  • Customer success teams
  • Legal and professional services
  • Small teams
  • Sales teams
  • Operations managers
  • Industries
  • Use cases
  • Build your team

Compare

  • vs Claude Code
  • vs Codex (ChatGPT Work)
  • vs Claude (Cowork)
  • vs Paperclip
  • vs OpenClaw
  • vs Hermes Agent
  • vs Manus
  • vs Genspark
  • vs n8n
  • vs Zapier
  • vs Grok Bot
  • vs Viktor
  • vs Lindy
  • vs Tasklet

Resources

  • Docs
  • Team library
  • Skill library
  • AI Chief of Staff
  • How we test
  • Limits
  • Switching to Murage
  • Open source
  • Blog
  • Release notes

Company

  • About
  • Partners
  • Enterprise
  • Contact
  • Privacy
  • Terms
  • Cookies
© 2026 Ferrox Labs. Murage is open source under AGPL-3.0.
Software engineering skills

Web Scraping Engineer

Web scraping engineering expert covering Puppeteer and Playwright browser automation, headless scraping patterns, data extraction techniques, rate limiting and throttling, robots.txt compliance, anti-bot detection awareness, legal considerations, structured data extraction, and scraping architecture at scale.

Download Murage

Free and open source. macOS, Windows and Ubuntu.

Try it

Add the skill to a bot, then ask your Chief of Staff:

“Use the Web Scraping Engineer skill on this: [describe the job, or paste your notes].”

What it covers

  • Ethical and Legal Framework
  • Scraping Approaches
  • Data Extraction Patterns
  • Rate Limiting and Throttling
  • Scraping at Scale
  • Robots.txt Compliance
  • Common Anti-Patterns
  • Quick Reference Card

Skill Guard: clean

Scanned and clear. A bot can use it as soon as you add it.

Subject
Software engineering
Level
advanced
License
Apache-2.0
automationshell-scriptingweb-development

How to use it.

  1. 1

    Download Murage

    Free for Mac, Windows and Ubuntu.

  2. 2

    Add the skill

    Open Settings → Skills and switch on Web Scraping Engineer for any bot. Or ask your Chief of Staff to pick skills for a job.

  3. 3

    Give it a job

    The bot reads the skill when the job calls for it, and works the way it lays out.

Put this skill to work.

  • Release notesShip the feature and the announcement together.
  • Skill GuardEvery skill is scanned before a bot can use it.

Questions.

What is the Web Scraping Engineer skill?+

Web scraping engineering expert covering Puppeteer and Playwright browser automation, headless scraping patterns, data extraction techniques, rate limiting and throttling, robots.txt compliance, anti-bot detection awareness, legal considerations, structured data extraction, and scraping architecture at scale.

How much does it cost?+

Nothing. It ships with Murage, which is free and open source. Your bots run on the AI plan you already have.

Can I change it?+

Yes. Open it in Settings → Skills to read, edit or duplicate it. Skill Guard scans it again after every edit.

More software engineering skills.

  • Bot BuilderBot development expertise covering Slack, Discord, and Telegram bot architecture, command handling patterns and event-driven design.
  • Browser AutomatorBrowser automation expertise covering Playwright and Puppeteer patterns, element selection strategies, wait mechanisms and network interception.
  • Code GenerationScaffolding, templates, and code generation strategies with project bootstrapping, boilerplate automation, template engines and AST-based generation.
  • Code MigratorCode migration specialist covering planning frameworks, strangler fig pattern, compatibility layers, feature flags, database migrations and API versioning.
  • Code Review PatternsGuides expert-level code review patterns implementation: clean-code and best-practices decision frameworks and production-ready patterns.
  • Cron SchedulerCron job scheduling expertise covering crontab syntax, systemd timers, overlap prevention with flock, logging best practices and error notification.

All software engineering skills

Give your first job to Murage.

Download the free app, connect the AI you already pay for, and tell your Chief of Staff what needs doing. Plan on about ten minutes from install to a working team.

Free · Download Murage

No account needed · Runs on the AI plan you already pay for