Explore resources by topic or category

New Changes to Our Scrapy Cloud Platform - Stay up-to-date with the latest changes to Scrapy Cloud. Enhance your web scraping workflow with new features.

Introducing ScrapyRT: An API for Scrapy Spiders - Make the most of your Scrapy spiders with ScrapyRT. Explore its functionalities as an API for seamless integration.

Introducing Data Reviews - Empower your decision-making with data reviews. Gain insights into data quality and credibility for your web scraping projects.

Introducing Dash - Discover Dash, a new tool designed to simplify web scraping. Learn how to leverage its capabilities for better data extraction.

Introducing Zyte Smart Proxy Manager - Enhance your web scraping with Smart Proxy Manager. Explore its powerful features and benefits as a smart proxy manager.

We often have to write spiders that need to fill login forms to sites. Our customers provide us with the site, username and password, and we do the rest.

Scrapy 0.15 Dropping Support for Python 2.5 - Important update for Scrapy users! Discover the changes in the latest release and the end of Python 2.5 support.