AI-assisted data extraction
Articles from the Zyte blog about AI-assisted data extraction.
Claude Fable 5 is the new best model for writing scrapers
We ran nine models, including the new GPT-5.6, through our Zyte Scraping Code Benchmark. Claude Fable 5 puts Sol and others in the shade - but it’s pricey, and the best extraction code still depends on the best infrastructure.
The harness matters more than the model - Podcast EP07
"The model is the engine — but the harness is everything else." In Episode 7, we dig into why the infrastructure layer around your AI model matters more than the model itself, rank the best models available right now, and ask whether the open-weighted revolution is about to make frontier subscriptions obsolete.
What's becoming of web scraping developers in the age of AI agents?
AI agents can generate code, suggest selectors, and draft crawl logic. What they can't do is design the system that decides when to stop, what to trust, and how to recover when the web pushes back. That job still belongs to a human.
What multi-agent orchestration looks like in a large-scale web scraping project
Multi-agent orchestration is having its moment. The diagrams are everywhere now. Boxes for planners, boxes for hands, boxes for daemons, arrows to a shared brain, a human floating at the top. They keep getting prettier. The part where the web pushes back is still the part nobody draws.
I built scraping agents for 30 days - here’s what I learned
For the last 30 days, I did one thing almost exclusively: I built scraping systems with AI agents, from the ground up, across real targets, with real deadlines. Not prototypes designed to impress in a demo, not isolated experiments running against a toy website, but production-grade pipelines that needed to ship and keep running.
From screenshot to shopping list in 90 seconds
I built a mood board pipeline that starts with a screenshot. Claude Skills and Zyte API for search, product extraction, and image embedding at any scale.
The Scrapy whisperer: Adrian Chaves on Web Scraping Copilot
An interview with Scrapy maintainer Adrian Chaves on Zyte’s Web Scraping Copilot, AI-generated parsing code, and building reliable scraping workflows.
Code is cheap, show me the talk: How copilots are re-engineering developers
Discover how AI copilots like Zyte’s Web Scraping Copilot are transforming developer workflows—making code a commodity and shifting value to problem-solving and prompting skills.
Claude skills, MCP or Web Scraping Copilot: Which should you choose?
Compare Claude skills, MCP servers, and Web Scraping Copilot to understand when to use each for AI-powered web scraping, data extraction, and production pipelines with Zyte API.
Supercharging web scraping with Claude skills
Learn how Claude skills can automate HTML fetching, AI parsing, selector generation, and structured data extraction to build faster, smarter web scraping workflows.
A data scientist's guide to stress-free product scraping
As a data scientist, your job is to find patterns, build models, and generate insights. To do that, you first need to reliably acquire web data. Competitor pricing, product specifications, consumer reviews - you name it, data scientists need it.
Claude Sonnet 4.6 is the new best model for writing scrapers
Claude Sonnet 4.6 is now the top model in Zyte’s Web Scraping Copilot benchmark, narrowly beating Gemini 3 Pro on extraction quality, with a small increase in code complexity.
More articles on AI-assisted data extraction
- AI and the web: What 2025 changed and what comes next
- Gemini 3.0 Pro is the new best model for writing scrapers
- Why AI agents struggle with web scraping (and how to help them)
- Five key takeaways from Extract Summit 2025
- Introducing Web Scraping Copilot - A rocket boost for data extractors
- Extract clean content automatically with Zyte API’s new pageContent data type
- Why your agent deserves a wallet
- Agentic web scraping: Hype, reality and what happens next
- AI Web Scraping as the Future of Scalable Data Collection
- Four sweet spots for AI in web scraping
- Data on command: The natural-language web scraping revolution
- From products to SERPs: AI scraping now does it all
- The Right AI For the Right Problem: How Zyte Solved Web Data's Trilemma of Cost, Quality, and Flexibility
- Beyond Hello World: The Operational Gaps in LLM-Powered Scraping Tools
- Faster and cheaper: How AI is breaking barriers in web data sourcing
- No wait, no upfront costs: How Zyte transformed its data delivery business with AI
- How to meet your data extraction deadlines with AI power
- Zyte: Transforming AI web scraping for Digital Shelf companies
- AI Scraping now available in Zyte API
- Zyte A.I. Automatic Extraction API | e-commerce & articles