PINGDOM_CHECK
ArticleProduct announcementDeveloper interest

Launching The Zyte Developers Community

Zyte Developers Community was created so developers have a place to learn, discuss web scraping challenges and find answers to their questions.

Attila Toth

1 min read ·

Launching The Zyte Developers Community

Launching the Zyte Developers Community

Zyte is launching a bi-weekly community newsletter specifically made for web scraping developers. No-fluff. Only coding stuff. Sign up here.

What is it?

Zyte Developer Community is starting off as a newsletter but we’re planning to grow into something much bigger so developers have a place to learn, discuss web scraping challenges and find answers to their questions in a safe environment. 

As a first step, we are kicking off a bi-weekly coding newsletter for developers who want to level up their knowledge and get the latest trends in the web scraping world.

Who is it for?

Developers (or managers) who are actively engaged in web data extraction projects. You might use Scrapy, Puppeteer, Html-requests, Beautiful Soup, Jsoup, Selenium, Playwright, any web scraping API, or any other tool that helps you get data from the web. This community is for you!

Why should you join?

It’s important for us, developers, to be updated on the newest trends, techniques, and tools to solve our daily challenges. Joining the community you will get the latest info on:

  • Techniques how to scrape websites
  • New open source libraries in the web scraping world
  • New web scraping APIs
  • Discover how fellow developers execute web data projects

Later on, when we will have a big enough community, we would also like to organize exclusive events and facilitate discussions:

  • Webinars
  • Slack/discord channel
  • Live Q&A sessions with domain experts
  • And more…

How can you join the community?

Our community is dedicated to developers working in web data extraction and we try to limit membership to those who we believe will benefit most. We review applications every 2-5 days, at which point you'll be notified whether or not you have been successful.

If you are interested, join us here!

Try Zyte API

Build your first scraper in minutes

Free trial, no credit card. From a single request to production in an afternoon.

Get started

Continue reading

The harness matters more than the model - Podcast EP07
AI-assisted data extraction

The harness matters more than the model - Podcast EP07

"The model is the engine — but the harness is everything else." In Episode 7, we dig into why the infrastructure layer around your AI model matters more than the model itself, rank the best models available right now, and ask whether the open-weighted revolution is about to make frontier subscriptions obsolete.

John Rooney11 min read
How to build your first Scrapy extension
Developer interest

How to build your first Scrapy extension

My Scrapy project now plays a triumphant fanfare when a crawl finishes clean and a sad trombone when it doesn't, which is also how I finally learned what Scrapy's extension points are actually for.

Ayan Pahwa11 min read
Now what exactly is loop engineering? And where do Anthropic's Fable 5 model and web scraping fit in?
Developer interest

Now what exactly is loop engineering? And where do Anthropic's Fable 5 model and web scraping fit in?

A viral clip from Claude Code's creator put a name to something a lot of us have been circling: loop engineering. Here's why web scraping may be its best-fit domain — and what that means in practice.

Ayan Pahwa12 min read
Automate deployment of your web scraper on VPS with Ubuntu 24.04 cloud-init
Developer interest

Automate deployment of your web scraper on VPS with Ubuntu 24.04 cloud-init

Your VPS is ready, but now you need to work through the same sequence you have run a dozen times before: apt update, apt install python3-pip, pip install scrapy, playwright install chromium, the Chromium dependency list that never installs cleanly on the first try, Redis, possibly Postgres, whatever else this particular project needs.

Ayan Pahwa9 min read
NotAnInterview: “I Have Superpowers Now"
Developer interest

NotAnInterview: “I Have Superpowers Now"

The problem was a project with 12,000 websites to crawl, and there’s no world where you write custom spiders for 12,000 websites, not with a human team and certainly not sustainably. So Javier built a workflow: a set of AI prompts that could analyze a website, figure out its structure, and generate a crawl configuration that a generic spider could then use.

Neha Setia Nagpal9 min read
Flatcar Linux for web scrapers: deploy immutable containers with just one config file
Developer interest

Flatcar Linux for web scrapers: deploy immutable containers with just one config file

The next time you spin up a VPS to give it a persistent home, you spend the better part of an afternoon rebuilding from memory. Here's a tool to help using Flatcar Linux

Ayan Pahwa11 min read

The Community · Newsletter

The best of Zyte and the data web, in your inbox.

One curated edition — new articles, product updates, and the stories shaping the data web. No noise.