Field notes from the world of data extraction.
Articles, interviews and analysis on how data is gathered, used and fought over — written by the people closest to it.

Scraping Swiss Army Knife: My personal fix for web setup fatigue using Docker, Scrapy and Zyte
Tired of repeating web scraping setup? Learn how a multi-arch Docker container with Scrapy, Zyte, Requests, and Pandas speeds up exploration and debugging.

How I trade gold using e-ink, live data and an old Raspberry Pi
Track real-world gold and silver retail prices automatically using Zyte API, Python, and a Raspberry Pi with an e-ink display. Learn how to scrape rendered HTML, parse prices, and build an always-on trading dashboard.

The best web scraping tools in 2026
Compare the best headless browsers for web scraping in 2026. Learn when to use Playwright, Puppeteer, Selenium, or Zyte API’s managed CDP browser for scalable, anti-ban scraping.

Web scraping for pricing intelligence: how to track competitor prices at scale
Compare the best headless browsers for web scraping in 2026. Learn when to use Playwright, Puppeteer, Selenium, or Zyte API’s managed CDP browser for scalable, anti-ban scraping.

Web data for business insights in 2026: Elevate your BI function with quality data
Discover how BI teams in 2026 use AI-powered web data to cut data wrangling, improve quality, and stay compliant. Insights from Zyte’s Web Scraping Industry Report.

Best headless browsers for web scraping in 2026
Compare the best headless browsers for web scraping in 2026. Learn when to use Playwright, Puppeteer, Selenium, or Zyte API’s managed CDP browser for scalable, anti-ban scraping.

How to transfer browser cookies to an http session when web scraping

Web data for scraping developers in 2026: AI fuels the agentic future
AI is reshaping web scraping in 2026. Learn how agentic systems, scraping APIs, and automated access management help developers build faster, more resilient data pipelines.

Web data for engineering leaders in 2026: Scale scraping without scaling headcount
Explore how agentic AI is transforming web scraping in 2026, and why engineering leaders should rethink DIY infrastructure.

How to create a Docker container with Scrapy and PostgreSQL

The future I dreamed of is dawning
Zyte's CEO Shane Evans shares a 15-year vision for effortless, AI-driven web data extraction and introduces the 2026 Web Scraping Industry Report with 26 actionable insights.

2026 Web Scraping Industry Report.
View the free 2026 Web Scraping Industry Report and learn how modern teams use AI and automation to collect reliable, compliant web data.




_HFpro5d6k3.png&w=256&q=75)
_E4PyVpfAxa.png&w=256&q=75)


-(1).png&w=1920&q=75)
-(1)_VZGHqxCgXV.png&w=1920&q=75)