Try it
Add the skill to a bot, then ask your Chief of Staff:
“Use the Web Scraper skill on this: [describe the job, or paste your notes].”
Web scraping is the programmatic extraction of data from websites. It sits at the intersection of engineering, ethics, and law. A responsible scraper respects rate limits, follows robots.txt, identifies itself honestly, and minimizes impact on the target server.
What it covers
- HTTP Client Selection
- HTML Parsing
- Browser Automation for Dynamic Sites
- Rate Limiting
- Robots.txt Compliance
- Session and Cookie Handling
- Anti-Detection Techniques
- Pagination Handling