Explore resources by topic or category

How to crawl the web with Scrapy without harming websites. Here are a few tips for netizens who want to build polite and considerate web crawlers.

Welcome to This Month in Open Source at Zyte! In this regular column, we share all the latest updates on our open source projects including Scrapy,

We eat our own spider food since Scrapy is our go-to workhorse on a daily basis. However, there are certain situations where Scrapy can be overkill and that’s

Scrapy Tips from the Pros - July 2016 - Gather more expert tips from seasoned Scrapy users and refine your web scraping techniques.

Improving Access to Peruvian Congress Bills with Scrapy - Learn how Scrapy is improving access to Peruvian Congress bills for greater transparency.

Note: Portia is no longer available for new users. It has been disabled for all the new organizations from August 20, 2018, onward.

This Month in Open Source at Zyte: June 2016 - Stay updated with the latest open-source initiatives at Zyte. Join our growing community of contributors.

Welcome to the April Edition of Scrapy Tips from the Pros. Each month we’ll release a few tricks and hacks that we’ve developed to help make your Scrapy

Scrapy Tips from the Pros: March 2016 Edition - Upgrade your web scraping game with the latest expert tips from our Scrapy pros.

Welcome to This Month in Open Source at Zyte! In this monthly column, we share all the latest updates on our open source projects including Scrapy,

Join Zyte for Google Summer of Code 2016 - Get involved in Google Summer of Code with Zyte. Contribute to exciting open-source projects.

Scrapy Tips from the Pros: February 2016 Edition - Stay ahead in web scraping with our latest tips from the pros. Enhance your scraping skills.