Explore resources by topic or category

What a failed experiment taught me about curated data, prompting, and when scraping actually matters.

Three ways to bring Zyte-powered web data into your AI workflow — from production spiders to conversational extraction.

Learn how Claude skills can automate HTML fetching, AI parsing, selector generation, and structured data extraction to build faster, smarter web scraping workflows.

Demo project scrape2postgresql shows how to scrape structured data with Scrapy, store it in PostgreSQL, and run both the spider and database in separate containers using Docker Compose.

Scrapy 2.14.0 is released with a major under-the-hood modernization. Say goodbye to Twisted Deferreds.

Smarter tools and AI-driven automation are rewriting the rules of web scraping. As costs fall and setup barriers vanish, smaller teams can now compete at scale, reshaping how the web’s data economy works.

What does the future hold for the tool some describe as “the gift that revolutionised web scraping”?

With the emergence of managed data extraction vendors, businesses no longer need to gather web data themselves.

The Strategic Case for Buying Web Data: Quality, Focus, and Scale

The generative AI gold rush is upon us, with astounding new products and capabilities emerging that are fuelled by web data.

See what 10 years of Scrapy 1.0 has produced — in milestones and metrics - as it became the most-used open source web scraping framework in the world.

Learn how successful open-source projects balance community value with sustainable growth. Industry leaders share insights on monetization, maintenance, and building thriving communities.