Field notes from the world of data extraction.
Articles, interviews and analysis on how data is gathered, used and fought over — written by the people closest to it.
Browser bother: Three painkillers for headless scraping headaches
This article shares three strategies to operationalize large-scale browser automation yourself,and what alternatives exist.
The Right AI For the Right Problem: How Zyte Solved Web Data's Trilemma of Cost, Quality, and Flexibility
This article reveals the approach that makes once-unviable web data projects possible.
Why Might a Business Use Web Scraping to Collect Data?
Businesses use data to better understand consumer behavior, track market trends, study competitive landscapes, and enhance internal processes. Choosing the correct web scraping vendor is critical for companies who want to capitalize on web scraping's potential.
Responsibly Using Big Data to Train LLMs: A Practical Demonstration
Join Joachim Asare, AI/ML Engineer & Master’s in Design Engineering @Harvard University, as he explores responsible methods for extracting and leveraging big data to train LLMs. This session covers key ethical considerations, including privacy, transparency, and fairness throughout the AI development lifecycle.
Scraping Smarter, Not Harder: Unlocking Public Data with Scrapy
Explore how to overcome the challenges of collecting publicly available data from websites protected by advanced security systems like Cloudflare Turnstile.
Why AI is changing the game for data buyers in 2025
Discover how AI, data marketplaces, and economies of scale are making web data more accessible than ever.
Buy or Build? The Four Roads to Acquiring Web Data
Weighing your options from full control to full service.
Golang Web Scraping in 2025: Tools, Techniques and Best Practices
Go (Golang)—a language built for speed, efficiency, and concurrency. Whether you’re scraping large datasets, handling high-throughput requests, or managing complex site interactions, Golang will deliver.
Advanced Use Cases for Session Management in Web Scraping
In this article, we’ll explore the sophisticated techniques that help manage modern bot defenses, why they matter, and how Zyte API gives you an edge in maintaining seamless, efficient, and cost-effective data extraction.
Web Scraping in 2025: Four Essentials For Developers and Data Buyers to Stay Ahead
Gain exclusive insights from The 2025 Web Scraping Industry Report and understand how AI is shaping web scraping and data practices in 2025.
Play Before You Scrape: Explore Zyte API Settings with Playground
Discover the best way to configure your scrapers using Zyte API Playground
From Basic to Advanced Ways of Managing Bans in Web Scraping
Discover a comprehensive guide on managing bans in web scraping, from basic strategies to advanced techniques, ensuring efficient and ethical data extraction.