Explore resources by topic or category

Scrapy Tips from the Pros: February 2016 Edition - Stay ahead in web scraping with our latest tips from the pros. Enhance your scraping skills.

Note: Portia is no longer available for new users. It has been disabled for all the new organisations from August 20, 2018 onward.

We recently released Dateparser 0.3.1 with support for Belarusian and Indonesian, as well as the Jalali calendar used in Iran and Afghanistan. With this in

Scrapy on the Road to Python 3 Support - Stay updated on Scrapy's transition to Python 3 support. Prepare your spiders for the future.

The Road to Loading JavaScript in Portia - Learn about the journey of adding JavaScript support to Portia. Extract data from dynamic websites more efficiently.

Google Summer of Code 2015 - Get involved in the Google Summer of Code with Zyte. Explore exciting projects and opportunities for students.

Learn how you can make use of Aduana and Frontera to implement popular page ranking algorithms in your Scrapy projects.

Frontera, formerly Crawl Frontier, is an open-source framework to manage our crawling logic and sharing it between spiders in our Scrapy projects.

Note: Portia is no longer available for new users. It has been disabled for all the new organizations from August 20, 2018, onward.

Skinfer: A Tool for Inferring JSON Schemas - Discover Skinfer, a powerful tool for inferring JSON schemas. Simplify data extraction from unstructured sources.

As you can see, Portia allows you to visually configure what’s crawled and extracted in a very natural way. It provides immediate feedback, making the process

Open Source at Zyte, Now Zyte - Embrace the open-source movement at Zyte. Learn how we contribute to the community and promote transparency.