Web Scraping & Data Extraction Skills for Claude Code, Codex & AI Agents

These skills help an agent retrieve pages and turn web material into structured notes or records. They cover Apify, Reddit, Google Maps, job boards, Defuddle, and browser-based extraction.

11 skills

Explore Web Scraping & Data Extraction skills

8 skills
BOSS Zhipin Job Research — cover
Free
Research & data

BOSS Zhipin Job Research

Collect job listings and descriptions from BOSS Zhipin through Chrome CDP and organize the results as JSON, CSV, or a job research report.

1.7KStars228Forks
Repository last pushed
Git worktrees for separate branches and parallel tasks.
Free
Other utilities

Reddit Browser Retrieval

Retrieve Reddit posts and discussions using a browser-backed JSON access workflow.

10.3KStars825Forks
Repository last pushed
Research & data

Google Maps Scraper

Run the local Google Maps scraper to collect business listings, reviews, and available contact details.

7.9KStars1.2KForks
Repository last pushed
Google Maps Scraper Kit — Google Maps Scraper Kit: free local Google Maps scraper for lead generation, driven by Claude Code
Free
SEO & marketing

Google Maps Scraper Kit

Turn a business category and location into a structured CSV of local businesses using a locally hosted Google Maps scraping engine.

2.4KStars473Forks
Repository last pushed
Career Ops workflow principles
Free
Research & data

CareerOps: Apify Job Sources

Use an Apify actor as a configured job-source provider in the CareerOps pipeline.

82.1KStars15.1KForks
Repository last pushed

Defuddle

kepano

Extract clean Markdown from HTML pages with Defuddle CLI.

  • web-research
  • data-extraction
51.8KStars3.7KForks
Repository last pushed

Summarize

sipeed

Summarize or extract text/transcripts from URLs, podcasts, and local files (great fallback for “transcribe this YouTube/video”).

  • research
  • data-extraction
30.1KStars4.4KForks
Repository last pushed

Related topics

How to choose Web Scraping & Data Extraction skills

Use a browser retrieval skill when pages need interaction, a source-specific scraper for maps or jobs, and a parser such as Defuddle when the page is mainly text.

  • Extract structured data from a set of web pages
  • Collect local businesses from Google Maps
  • Turn job-board pages into a searchable list