PINGDOM_CHECK

#ExtractSummit2026 The world's largest web scraping conference returns. Austin Oct 7–8 · Dublin Nov 10–11.

Register now
Data Services
Pricing
LoginTry Zyte APIContact Sales

  • Unblocking and Extraction

    Zyte API

    The ultimate API for web scraping. Avoid website bans and access a headless browser or AI Parsing

    Ban Handling

    Headless Browser

    AI Extraction

    SERP

    Enterprise

    DocumentationSupport

    Hosting and Deployment

    Scrapy Cloud

    Run, monitor, and control your Scrapy spiders however you want to.

    Coding Agent Add-Ons

    Agentic Web Data

    Plugins that give coding agents the context to build production Scrapy projects. Starts with Claude Code.

  • Data Services
  • Pricing

  • Browse

    • BlogArticles, podcasts, videos
    • Case studiesCustomer outcomes
    • White papersIn-depth reports
    • DocumentationGuides & API reference
    • EventsConferences, webinars, recordings

    Subscribe

    • NewsletterSwiftly delivered
    • Join our community2,000+ web scraping engineers

  • Product and E-commerce

    From e-commerce and online marketplaces

    Data for AI

    Collect and structure web data to feed AI

    Job Posting

    From job boards and recruitment websites

    Real Estate

    From Listings portals and specialist websites

    News and Article

    From online publishers and news websites

    Search

    Search engine results page data (SERP)

    Social Media

    From social media platforms online

  • Meet Zyte

    Our story, people and values

    Contact us

    Get in touch

    Support

    Knowledge base and raise support tickets

    Terms and Policies

    Accept our terms and policies

    Open Source

    Our open source projects and contributions

    Web Data Compliance

    Guidelines and resources for compliant web data collection

    Join the team building the future of web data
    We're Hiring
    Trust Center
    Security, compliance & certifications
LoginTry Zyte APIContact Sales
All articles
AI71, 71 articles
Data quality15, 15 articles
Developer interest59, 59 articles
Integration2, 2 articles
Open-source50, 50 articles
Proxies35, 35 articles
Scraping practice35, 35 articles
Scraping strategy47, 47 articles
Search results4, 4 articles
Web data74, 74 articles
Web scraping APIs49, 49 articles
Scrapy47, 47 articles
Scrapy Cloud26, 26 articles
Web Scraping Copilot11, 11 articles
Zyte API67, 67 articles
AI & Machine Learning3, 3 articles
Automotive3, 3 articles
E-commerce & retail33, 33 articles
Entertainment & Streaming2, 2 articles
Financial Services8, 8 articles
Government2, 2 articles
Market Research & Intelligence7, 7 articles
Media & publishing11, 11 articles
Real Estate2, 2 articles
Recruitment & HR3, 3 articles
Transportation & Logistics2, 2 articles
Travel & hospitality3, 3 articles
iPaaS2, 2 articles
Large language model29, 29 articles
MCP3, 3 articles
Python110, 110 articles
Scraping at Scale7, 7 articles
Scraping Fundamentals11, 11 articles
Web Scraping Industry Report20, 20 articles

Appearance

Discord Community
BlogNewsletterZyte Developers Community Newsletter Issue #10
ArticleNewsletter

Zyte Developers Community Newsletter Issue #10

Discover in our newsletter: scrape news headlines in under 10 lines, automate the Wiki-Link Game with Python, and more!

H

Himanshi Bhatt · Demand Generation Manager

1 min read · August 19, 2021

Zyte Developers Community Newsletter Issue #10

Zyte Developers Community newsletter issue #10

Hi there,

If you are not signed up already for the Zyte Developers Community newsletter, you can sign up here.

In this issue:

  • Scrape news headlines in <10 lines of code
  • Automate the Wiki-Link Game with Python
  • Web scraping with Cheerio
  • How Scrapy makes web crawling easy
  • Web Data Extraction Summit 2021

Scrape news headlines in <10 lines of code

Code_Jedi shares a way to scrape news headlines from BBC news in under 10 lines of code using BeautifulSoup. Check it out!

Automate the Wiki-Link Game with Python

Have you played the Wiki-link game before? You may have noticed that continuously following the first link of any Wikipedia article will eventually lead to “Philosophy". Does this actually happen because you’re clicking the first link or is this based on Wikipedia’s structure? Read all about it in this article by Timo Kats. He extracts the information using the Wikipedia API.

Web scraping with Cheerio

Julian Rosenthal is very impressed with Cheerio, a popular node package for scraping and parsing web content. In this article, he explores cheerio by creating a scraper to get a list of all US presidents from Wikipedia.

How Scrapy makes web crawling easy

For everyone who’s just starting or wanting to start with Scrapy, this article will make you fall in love with the framework. It is a quick read covering the fundamentals of Scrapy and how to set it up to extract data easily and without getting blocked.

Web Data Extraction Summit 2021

Extract Summit 2021 is a great platform to learn from the experts in the web data extraction industry and meet hundreds of like-minded developers.

Grab your free ticket now!

Try Zyte API

Build your first scraper in minutes

Free trial, no credit card. From a single request to production in an afternoon.

Get started
Newsletter
H

Himanshi Bhatt

Demand Generation Manager

Himanshi's posts center on business use cases for web data — dynamic pricing, competitive intelligence, customer-review analysis, and travel-industry applications — alongside several years of the "Zyte Developers Community Newsletter" and recaps of the annual Web Data Extraction…

  • LinkedIn
More from this author

In this article

  • In this issue:
  • Scrape news headlines in <10 lines of code
  • Automate the Wiki-Link Game with Python
  • Web scraping with Cheerio
  • How Scrapy makes web crawling easy
  • Web Data Extraction Summit 2021

Follow

Get the latest

Zyte and the data web in your inbox — or wherever you already are.

Subscribe

Or follow elsewhere

Continue reading

New in Zyte: Web Scraping Copilot, LLM-friendly text, MCP scraping
Newsletter

New in Zyte: Web Scraping Copilot, LLM-friendly text, MCP scraping

Discover Zyte’s latest: Web Scraping Copilot, LLM-ready page content, new Zyte API features, enterprise tools, webinars, and Extract Summit talks on-demand.

Daniel Cave·5 mins·November 10, 2025
Zyte Blog — field notes from the world of data extraction
Newsletter

How Zyte API takes care of the fundamental needs of your web scraping project!

Neha Setia Nagpal·3 mins·September 13, 2023
Zyte Blog — field notes from the world of data extraction
Newsletter

Zyte Developers Community Newsletter Issue #9

In this issue: Using NLP libraries to discover what the internet says about anything Scraping Singapore libraries Scrape the latest stock prices with node.js and puppeteer How to scrape a website for your ML project Scraping images using Selenium

Himanshi Bhatt·< 1 Mins·July 29, 2021

The Community · Newsletter

The best of Zyte and the data web, in your inbox.

One curated edition — new articles, product updates, and the stories shaping the data web. No noise.

Services

Zyte Data

Coding tools & hacks straight to your inbox. Bi-weekly dosage of all things code.

Explore Zyte Data

Web Scraping API

Zyte API

Coding tools & hacks straight to your inbox. Bi-weekly dosage of all things code.

Sign Up

Developers

Zyte Developers

Coding tools & hacks straight to your inbox. Bi-weekly dosage of all things code.

Join Us
    • Zyte API
    • Ban Handling
    • AI Extraction
    • SERP
    • Enterprise
    • Scrapy Cloud
    • Agentic Web Data
    • Pricing
    • Product & E-commerce
    • Data for AI
    • Job Posting
    • Real Estate
    • News & Articles
    • Search
    • Social Media
    • Blog
    • Learn
    • Case Studies
    • Webinars
    • White Papers
    • Join our community
    • Documentation
    • Meet Zyte
    • Contact us
    • Jobs
    • Support
    • Terms and Policies
    • Trust Center
    • Do not sell
    • Cookie settings
    • Web Data Compliance
    • Open Source
    • What is Web Scraping
    • Web Scraping in Python: Ultimate Guide
    • Stop getting blocked, start scraping
    • EWDCI logoMost loved workplace certificateZyte rewardISO 27001 iconG2 rewardG2 rewardG2 reward
    XFacebookInstagramYouTubeLinkedInDiscord
    © Zyte Group Limited 2026