PINGDOM_CHECK

Zyte Developers Community Newsletter Issue 8: Embracing Innovation

Zyte Developers Community Newsletter Issue 8 - Explore the eighth edition of our newsletter, highlighting the latest news and innovations within the Zyte developers' community.

Himanshi Bhatt

2 min read ·

Zyte Developers Community Newsletter Issue 8: Embracing Innovation

Zyte Developers Community newsletter issue #8

Hi there,

If you are not signed up already for the Zyte Developers Community newsletter, you can sign up here.

In this issue:

  • Crawl product details using Scrapy-Splash
  • How to schedule python Scrapy spiders on Heroku using custom clock process for free
  • How to make sense out of webpage data tables using pandas
  • Scraping Amazon website for book information

Crawl product details using Scrapy-Splash

In this tutorial, Bilge Demirkaya scrapes the JavaScript rendered product details on Decathalon.com using the Scrapy-Splash plugin.

How to schedule python Scrapy spiders on Heroku using custom clock process for free

Have you been waiting for a price drop on an item in your wishlist and want to be the first person to be notified of its price drop? Yashashree Suresh explains how to deploy your Scrapy spiders and periodically schedule them using a custom clock process on Heroku for free.

How to make sense out of webpage data tables using pandas

In this blog, Raghavendra Basvan shows us how to extract a table from any webpage by applying various methods from pandas and how to analyze the data using matplotlib and seaborn modules.

Scraping Amazon website for book information

If you’re a book lover, you'll find this fun project very interesting. Alexandre wanted to keep a track of his reads and analyze the findings, so he decided to undertake a web scraping project to keep a tab on his purchases, the book categories, and pages he’s read using Python.

Webinar: Measuring product data extraction quality

Konstantin Lopukhin, an expert in improving the data quality of automatic data extraction, takes you on his journey of measuring Zyte’s product data extraction quality and shares the results from the competitive comparison. Packed with insights, this live webinar will tell you more about the learning and methodology he followed. Join him on 22nd July.

Try Zyte API

Build your first scraper in minutes

Free trial, no credit card. From a single request to production in an afternoon.

Get started

Continue reading

The harness matters more than the model - Podcast EP07
AI-assisted data extraction

The harness matters more than the model - Podcast EP07

"The model is the engine — but the harness is everything else." In Episode 7, we dig into why the infrastructure layer around your AI model matters more than the model itself, rank the best models available right now, and ask whether the open-weighted revolution is about to make frontier subscriptions obsolete.

John Rooney11 min read
How to build your first Scrapy extension
Developer interest

How to build your first Scrapy extension

My Scrapy project now plays a triumphant fanfare when a crawl finishes clean and a sad trombone when it doesn't, which is also how I finally learned what Scrapy's extension points are actually for.

Ayan Pahwa11 min read
Now what exactly is loop engineering? And where do Anthropic's Fable 5 model and web scraping fit in?
Developer interest

Now what exactly is loop engineering? And where do Anthropic's Fable 5 model and web scraping fit in?

A viral clip from Claude Code's creator put a name to something a lot of us have been circling: loop engineering. Here's why web scraping may be its best-fit domain — and what that means in practice.

Ayan Pahwa12 min read
Automate deployment of your web scraper on VPS with Ubuntu 24.04 cloud-init
Developer interest

Automate deployment of your web scraper on VPS with Ubuntu 24.04 cloud-init

Your VPS is ready, but now you need to work through the same sequence you have run a dozen times before: apt update, apt install python3-pip, pip install scrapy, playwright install chromium, the Chromium dependency list that never installs cleanly on the first try, Redis, possibly Postgres, whatever else this particular project needs.

Ayan Pahwa9 min read
NotAnInterview: “I Have Superpowers Now"
Developer interest

NotAnInterview: “I Have Superpowers Now"

The problem was a project with 12,000 websites to crawl, and there’s no world where you write custom spiders for 12,000 websites, not with a human team and certainly not sustainably. So Javier built a workflow: a set of AI prompts that could analyze a website, figure out its structure, and generate a crawl configuration that a generic spider could then use.

Neha Setia Nagpal9 min read
Flatcar Linux for web scrapers: deploy immutable containers with just one config file
Developer interest

Flatcar Linux for web scrapers: deploy immutable containers with just one config file

The next time you spin up a VPS to give it a persistent home, you spend the better part of an afternoon rebuilding from memory. Here's a tool to help using Flatcar Linux

Ayan Pahwa11 min read

The Community · Newsletter

The best of Zyte and the data web, in your inbox.

One curated edition — new articles, product updates, and the stories shaping the data web. No noise.