Field notes from the world of data extraction.
Articles, interviews and analysis on how data is gathered, used and fought over — written by the people closest to it.
The Modern Scrapy Developer's Guide (Part 1): Building Your First Spider
In this definitive guide, we will walk you through, step-by-step, how to build a real, multi-page crawling spider. You will go from an empty folder to a clean JSON file of structured data in about 15 minutes
Zyte’s 2025 review: Year of locks and unlocks
2025 reshaped web scraping. From AI-assisted extraction and escalating bot defenses to clearer legal frameworks and cheaper APIs, Zyte reviews the forces redefining access to web data—and what comes next.
AI’s legal frontier: What Europe’s privacy regulators say about scraping personal data
Explore how EU privacy regulators view AI web scraping, lawful bases like legitimate interest, risks of collecting personal data, and compliance best practices.
Zyte leads the pack in Proxyway’s 2025 Web Scraping API Report
Proxyway’s 2025 Web Scraping API Report ranks Zyte #1 for unblocking success, speed, cost efficiency, and AI-powered data extraction. See the full breakdown.
The Modern Web Scraping Method You NEED to Know
Learn how to scrape data in json format from a websites API
Beyond the block: The front line of data access
A deep dive into the evolving battle for web data access—featuring insights from Castle, Scrapoxy, and Zyte at Extract Summit 2025. Learn how AI, anti-bots, economics, and authentication standards like Web Bot Auth are transforming scraping, security, and the future of the open internet.
How to build a daily industry news digest
Learn how data analyst Anshika Khandelwal automated a daily AI funding news digest using n8n and Zyte API. Discover how to pull articles, classify funding stories, and deliver a curated newsletter that saves 10+ hours per week.
Scraping a synthetic web: Dead Internet Theory meets web data extraction
AI-generated content now dominates the web. Explore the rise of synthetic internet traffic, how bots shape online discourse, and how data experts can fight back.
Gemini 3.0 Pro is the new best model for writing scrapers
Gemini 3.0 Pro outperforms GPT-5, Claude, and other leading LLMs in Zyte’s Web Scraping Copilot benchmarks, delivering the highest code accuracy and lowest complexity. See full results, pros, cons, and recommendations for production workflows.
Why AI agents struggle with web scraping (and how to help them)
Explore the key challenges AI agents face in web scraping and how Zyte’s Web Scraping Copilot boosts automation, accuracy, and developer productivity.
Key takeaways from the Getty v. Stability AI UK ruling
Explore what the UK Getty v. Stability AI ruling means for web scraping and AI developers, from jurisdiction and copyright risk to trademarks and EU compliance.
How an analytics platform solved a ‘hard-to-scrape’ site using Zyte API
See how Zyte API automatically unblocked a major e-commerce site, cutting costs and boosting success rates from 60% to 98%.