Field notes from the world of data extraction.
Articles, interviews and analysis on how data is gathered, used and fought over — written by the people closest to it.
Claude Sonnet 4.6 is the new best model for writing scrapers
Claude Sonnet 4.6 is now the top model in Zyte’s Web Scraping Copilot benchmark, narrowly beating Gemini 3 Pro on extraction quality, with a small increase in code complexity.
Electric cars and the journey to the future of web data
Discover how web scraping APIs are replacing proxy-based setups, just as electric vehicles are transforming the auto industry. Learn why APIs deliver lower total cost, better scalability, and long-term value for web data teams.
Building solidarity and strategy at Zyte’s global meet-up
What happens when a remote-first company meets in person? Zyte's COO Suzanne Hassett shares insights from the 2026 Antalya meet-up, where strategy, solidarity, and customer voices shaped the year ahead.
Hybrid scraping: The architecture for the modern web
Learn how hybrid scraping combines headless browsers and lightweight HTTP clients to bypass JavaScript challenges efficiently. Reduce RAM usage, improve speed, and scale your web scraping pipelines with session reuse and TLS fingerprinting.
Your business doesn’t care about scraping - it cares about data
Web scraping isn’t the competitive advantage it used to be. Learn why shifting to a scraping API helps engineers reclaim time, reduce maintenance, and focus on delivering reliable data.
Scraping Swiss Army Knife: My personal fix for web setup fatigue using Docker, Scrapy and Zyte
Tired of repeating web scraping setup? Learn how a multi-arch Docker container with Scrapy, Zyte, Requests, and Pandas speeds up exploration and debugging.
How I trade gold using e-ink, live data and an old Raspberry Pi
Track real-world gold and silver retail prices automatically using Zyte API, Python, and a Raspberry Pi with an e-ink display. Learn how to scrape rendered HTML, parse prices, and build an always-on trading dashboard.
Web data for business insights in 2026: Elevate your BI function with quality data
Discover how BI teams in 2026 use AI-powered web data to cut data wrangling, improve quality, and stay compliant. Insights from Zyte’s Web Scraping Industry Report.
Web data for scraping developers in 2026: AI fuels the agentic future
AI is reshaping web scraping in 2026. Learn how agentic systems, scraping APIs, and automated access management help developers build faster, more resilient data pipelines.
Web data for engineering leaders in 2026: Scale scraping without scaling headcount
Explore how agentic AI is transforming web scraping in 2026, and why engineering leaders should rethink DIY infrastructure.
The future I dreamed of is dawning
Zyte's CEO Shane Evans shares a 15-year vision for effortless, AI-driven web data extraction and introduces the 2026 Web Scraping Industry Report with 26 actionable insights.
Scrapy in 2026: New release brings modern async crawling standards
Scrapy 2.14.0 modernizes the framework with native async/await, smarter scheduling, and cleaner spider configuration. Here’s what the new release means for production crawlers in 2026.
_HFpro5d6k3.png&w=256&q=75)
_E4PyVpfAxa.png&w=256&q=75)
-(1).png&w=1920&q=75)
-(1)_VZGHqxCgXV.png&w=1920&q=75)
