Articles, interviews and analysis on how data is gathered, used and fought over — written by the people closest to it.

Improving Access to Peruvian Congress Bills with Scrapy - Learn how Scrapy is improving access to Peruvian Congress bills for greater transparency.

Note: Portia is no longer available for new users. It has been disabled for all the new organizations from August 20, 2018, onward.

Introducing Portia2Code: Seamlessly integrate Portia projects into Scrapy spiders with our latest guide, unlocking new possibilities for efficient web scraping.

If you are feeling daunted by the prospect of scraping infinite scrolling websites, here are a few tricks to help speed up your web scraping activities.

This Month in Open Source at Zyte: June 2016 - Stay updated with the latest open-source initiatives at Zyte. Join our growing community of contributors.

Introducing the Datasets Catalog - Explore our vast datasets catalog. Find the perfect data for your research and analysis needs.

Zyte Smart Proxy Manager is a smart downloader that allows you to crawl and scrape websites responsibly. It rotates IP addresses and keeps

Data Extraction with Scrapy and Python - Learn the art of data extraction with Scrapy and Python. Harness the full potential of web scraping.

Welcome to Scrapy Tips from the Pros! Every month we release a few tricks and hacks to help speed up your web scraping and data extraction activities. As the

We recently announced our integration with MonkeyLearn, bringing machine learning to Scrapy Cloud. MonkeyLearn offers numerous text analysis services via its

Scrapy Cloud has been with Zyte since the beginning, but we decided some spring cleaning was in order. To that end, we’re proud to announce Scrapy

A Not-So-Short Story on Getting Decent Internet Access - Read our adventure in securing reliable internet access for efficient web scraping operations.
G2.com