Web Scraping & Data Extraction Skills for Claude Code, Codex & AI Agents

These skills help an agent retrieve pages and turn web material into structured notes or records. They cover Apify, Reddit, Google Maps, job boards, Defuddle, and browser-based extraction.

11 skills

Start here

Agent Reach

Panniantong

Give coding agents a routed toolkit for web search, page reading, social content and video transcripts.

  • web-research
  • web-scraping
  • social-media
111.2KStars10KForks
Repository last pushed
ego-browser performance comparison.
Free
Testing & security

ego Browser Automation

Use ego-browser task spaces and page APIs for browsing, forms, screenshots, extraction and web-app verification.

22.6KStars1.3KForks
Repository last pushed
BOSS Zhipin Job Research — cover
Free
Research & data

BOSS Zhipin Job Research

Collect job listings and descriptions from BOSS Zhipin through Chrome CDP and organize the results as JSON, CSV, or a job research report.

1.7KStars228Forks
Repository last pushed
Git worktrees for separate branches and parallel tasks.
Free
Other utilities

Reddit Browser Retrieval

Retrieve Reddit posts and discussions using a browser-backed JSON access workflow.

10.3KStars825Forks
Repository last pushed

Explore Web Scraping & Data Extraction skills

7 skills
Research & data

Google Maps Scraper

Run the local Google Maps scraper to collect business listings, reviews, and available contact details.

7.9KStars1.2KForks
Repository last pushed
Google Maps Scraper Kit — Google Maps Scraper Kit: free local Google Maps scraper for lead generation, driven by Claude Code
Free
SEO & marketing

Google Maps Scraper Kit

Turn a business category and location into a structured CSV of local businesses using a locally hosted Google Maps scraping engine.

2.4KStars473Forks
Repository last pushed
Career Ops workflow principles
Free
Research & data

CareerOps: Apify Job Sources

Use an Apify actor as a configured job-source provider in the CareerOps pipeline.

82.1KStars15.1KForks
Repository last pushed

Extract article and documentation content as clean Markdown with the Defuddle CLI.

  • web-scraping
  • markdown
5.5KStars613Forks
Repository last pushed

Defuddle

kepano

Extract clean Markdown from HTML pages with Defuddle CLI.

  • web-research
  • data-extraction
51.8KStars3.7KForks
Repository last pushed

Summarize

sipeed

Summarize or extract text/transcripts from URLs, podcasts, and local files (great fallback for “transcribe this YouTube/video”).

  • research
  • data-extraction
30.1KStars4.4KForks
Repository last pushed

Related topics

How to choose Web Scraping & Data Extraction skills

Use a browser retrieval skill when pages need interaction, a source-specific scraper for maps or jobs, and a parser such as Defuddle when the page is mainly text.

  • Extract structured data from a set of web pages
  • Collect local businesses from Google Maps
  • Turn job-board pages into a searchable list