Field notes from the world of data extraction.
Articles, interviews and analysis on how data is gathered, used and fought over — written by the people closest to it.

How to build 30 spiders to scrape product data in under 30 minutes

How to use ChatGPT for your custom scraping task

Mastering data harmony: Techniques for matching and deduplication of scraped data

Learn web scraping at scale: Ban avoidance, browser automation, and AI-powered extraction

Exploring the Frontier of AI Scraping - A fireside chat with Zyte's Tech Leaders
Learn about exploring the frontier of AI scraping.

Web Scraping vs Data Mining | What's the Difference?
Understand the similarities between data mining and web scraping. While they are different processes, both data mining and web scraping aim to achieve similar goals.

The Scraper’s System Part 2: Explorer’s Compass to analyze websites
Learn about the scrapers system: Explorer’s Compass to analyze websites.

The challenges e-commerce retailers face managing their web scraping proxies
E-commerce companies are increasingly using web data scraping for their competitor research, pricing, and new product research.

Zyte API is the Successor to Smart Proxy Manager
Smart Proxy Manager (SPM) is being retired for new customers. Zyte’s flagship Web Scraping API, Zyte API, is its worthy successor.

Introducing Zyte API Proxy Mode
Zyte API is the next iteration of Zyte’s best-in class proxy and website unblocking technology.

Court Rules Meta's Terms Do Not Prohibit Scraping of Public Data
What does the court ruling that concludes Bright Data did not violate Meta’s terms of service or breach any contract with Meta by scraping public Facebook and Instagram data mean for web scraping.

Social media and news data extraction: Here's how to do it right
Social media and news data extraction webinar: Learn how to do it right.