Explore resources by topic or category

Learn about the scrapers system: Explorer’s Compass to analyze websites.

cURL simplifies data collection from websites via its command-line interface, making it essential for APIs, file transfers, and web scraping.

Our scrapy cloud secrets help you deal with real cases that put your data extraction pipeline at risk. You have to be fully prepared for every scenario.

I recently had the pleasure of participating in the third episode of Graphversation, a monthly live stream series that brings together graph experts and Neo4j enthusiasts for engaging and enlightening discussions about the captivating world of graphs.

Learn how to extract data from a HTML table with step-by-step instructions. Get all the tips on extracting data from an HTML table in Python and Scrapy.

Learn how to use Zyte and YepCode together to quickly create automations and test new ideas.

Web crawlers are becoming increasingly popular in the era of big data, especially now with the advent of Large Language Models (LLMs) such as ChatGPT and LLaMA. The sheer amount of data that is publicly available from the web has a wide variety of applications including market research, sentiment analysis, and predictive modeling.

Learn how to develop an automated data QA process. Improve your web data quality applying a process that communicates with all your internal system procedures.

Data parsing aims at reducing noise and structuring data. It is a very effective process when looking to work with structured and accurate data.

Find out how can you actually extract data from websites? And what’s this thing called ‘web scraping’?

Web data touches every aspect of our lives. Extracting meaningful data from the web – reliably and at scale – can play a vital role to help companies succeed.