PINGDOM_CHECK

Field notes from the world of data extraction.

Articles, interviews and analysis on how data is gathered, used and fought over — written by the people closest to it.

Zyte Blog — field notes from the world of data extraction

The New Guide to Web Scraping at Scale_One_Page

20 min read
Api first scraping extraction for the modern web

API-first scraping: Extraction for the modern web

This is the "API-first" method, a workflow that turns brittle, complex parsing jobs into clean, reliable, high-velocity JSON pipelines.

John Rooney10 min read
Sun, sea and code: What we built at Zyte’s API hackathon
Web data collection

Sun, sea and code: What we built at Zyte’s API hackathon

Discover the 7 creative projects built at Zyte’s API Hackathon in Turkey, from security scanning tools to price comparison engines and smart caching systems.

Robert Andrews5 min read
Zyte Blog — field notes from the world of data extraction
Use case

How to evaluate a web scraping company

Learn how to evaluate a web scraping company based on reliability, operating model, compliance, and organizational maturity. A practical guide to choosing a long-term web data partner.

Arnold Alexander10 min read
Claude Sonnet 4.6 is the new best model for writing scrapers
AI-assisted data extraction

Claude Sonnet 4.6 is the new best model for writing scrapers

Claude Sonnet 4.6 is now the top model in Zyte’s Web Scraping Copilot benchmark, narrowly beating Gemini 3 Pro on extraction quality, with a small increase in code complexity.

Konstantin Lopukhin10 min read
Zyte Blog — field notes from the world of data extraction
Use case

Best Web Scraping Companies (Software + Services)

Looking for the best web scraping company? Compare top providers by success rates, data quality, compliance standards, and enterprise support.

Arnold Alexander10 min read
Electric cars and the journey to the future of web data
Web scraping APIs

Electric cars and the journey to the future of web data

Discover how web scraping APIs are replacing proxy-based setups, just as electric vehicles are transforming the auto industry. Learn why APIs deliver lower total cost, better scalability, and long-term value for web data teams.

Iain Lennon10 min read
Building solidarity and strategy at Zyte’s global meet-up
Leadership

Building solidarity and strategy at Zyte’s global meet-up

What happens when a remote-first company meets in person? Zyte's COO Suzanne Hassett shares insights from the 2026 Antalya meet-up, where strategy, solidarity, and customer voices shaped the year ahead.

Suzanne Hassett5 min read
Hybrid scraping: The architecture for the modern web
Anti-ban

Hybrid scraping: The architecture for the modern web

Learn how hybrid scraping combines headless browsers and lightweight HTTP clients to bypass JavaScript challenges efficiently. Reduce RAM usage, improve speed, and scale your web scraping pipelines with session reuse and TLS fingerprinting.

John Rooney10 min read
AI and the web: What 2025 changed and what comes next
Web data application

Your business doesn’t care about scraping - it cares about data

Web scraping isn’t the competitive advantage it used to be. Learn why shifting to a scraping API helps engineers reclaim time, reduce maintenance, and focus on delivering reliable data.

John Rooney10 min read
Zyte API Sessions - flexible cookie management maintaining control

Zyte API Sessions - flexible cookie management maintaining control

John Rooney8 min read
Scraping Swiss Army Knife: My personal fix for web setup fatigue using Docker, Scrapy and Zyte
Web scraping APIs

Scraping Swiss Army Knife: My personal fix for web setup fatigue using Docker, Scrapy and Zyte

Tired of repeating web scraping setup? Learn how a multi-arch Docker container with Scrapy, Zyte, Requests, and Pandas speeds up exploration and debugging.

Ayan Pahwa10 min read