PINGDOM_CHECK

#ExtractSummit2026 The world's largest web scraping conference returns. Austin Oct 7–8 · Dublin Nov 10–11.

Register now
Data Services
Pricing
Login
Try Zyte APIContact Sales
  • Unblocking and Extraction

    Zyte API

    The ultimate API for web scraping. Avoid website bans and access a headless browser or AI Parsing

    Ban Handling

    Headless Browser

    AI Extraction

    SERP

    Enterprise

    DocumentationSupport

    Hosting and Deployment

    Scrapy Cloud

    Run, monitor, and control your Scrapy spiders however you want to.

    Coding Agent Add-Ons

    Agentic Web Data

    Plugins that give coding agents the context to build production Scrapy projects. Starts with Claude Code.

  • Data Services
  • Pricing
  • Browse

    • BlogArticles, podcasts, videos
    • Case studiesCustomer outcomes
    • White papersIn-depth reports
    • EventsConferences, webinars, recordings

    Subscribe

    • NewsletterSwiftly delivered
    • Discord communityExtract Data community
  • Product and E-commerce

    From e-commerce and online marketplaces

    Data for AI

    Collect and structure web data to feed AI

    Job Posting

    From job boards and recruitment websites

    Real Estate

    From Listings portals and specialist websites

    News and Article

    From online publishers and news websites

    Search

    Search engine results page data (SERP)

    Social Media

    From social media platforms online

  • Meet Zyte

    Our story, people and values

    Contact us

    Get in touch

    Support

    Knowledge base and raise support tickets

    Terms and Policies

    Accept our terms and policies

    Open Source

    Our open source projects and contributions

    Web Data Compliance

    Guidelines and resources for compliant web data collection

    Join the team building the future of web data
    We're Hiring
    Trust Center
    Security, compliance & certifications
Login
Try Zyte APIContact Sales

Zyte Developers

Coding tools & hacks straight to your inbox

Become part of the community and receive a bi-weekly dosage of all things code.

Join us
    • Zyte Data
    • News & Articles
    • Search
    • Social Media
    • Product
    • Data for AI
    • Job Posting
    • Real Estate
    • Zyte API - Ban Handling
    • Zyte API - Headless Browser
    • Zyte API - AI Extraction
    • Web Scraping Copilot
    • Zyte API Enterprise
    • Scrapy Cloud
    • Solution Overview
    • Blog
    • Webinars
    • Case Studies
    • White Papers
    • Documentation
    • Web Scraping Maturity Self-Assesment
    • Web Data compliance
    • Meet Zyte
    • Jobs
    • Terms and Policies
    • Trust Center
    • Support
    • Contact us
    • Pricing
    • Do not sell
    • Cookie settings
    • Sign up
    • Talk to us
    • Cost estimator

Explore resources by topic or category

Browse by Category
Browse by topic

Blog

Harness Engineering, part 2: harnessing a data extraction agent

Ayan Pahwa
8 min read
July 1, 2026
Point it at a website, tell it which fields you want, get back clean structured records. That's the agent we're designing in this post — and the interesting part isn't the model, it's the harness decisions that make it actually reliable at scale.
Large Language Models (LLMs)
Read more

Blog

Harness Engineering, part 1: what is an agent harness and why it matters

Ayan Pahwa
8 min read
June 29, 2026
Same model, same weights, zero retraining — LangChain changed nothing but the scaffolding around a coding model and jumped it from 30th place to the top five on a benchmark. That scaffolding has a name: the harness. And it's the part you actually control.
Large Language Models (LLMs)
Read more

Blog

The harness matters more than the model - Podcast EP07

John Rooney
11 min read
June 27, 2026
"The model is the engine — but the harness is everything else." In Episode 7, we dig into why the infrastructure layer around your AI model matters more than the model itself, rank the best models available right now, and ask whether the open-weighted revolution is about to make frontier subscriptions obsolete.
AI-assisted data extractionLarge Language Models (LLMs)Developer interestData quality
Read more

Blog

The best agent skill is the one that says the least

Neha Setia Nagpal
14 min read
June 23, 2026
More instruction, worse output. Zyte's head of R&D on why telling your agent exactly what to do can blind it to the obvious answer.
AILarge Language Models (LLMs)
Read more

Blog

Why I'm adding GLM-5.2 to my agentic coding arsenal

Ayan Pahwa
12 min read
June 19, 2026
Is GLM-5.2 really closing the gap to Anthropic - and at just a fraction of the cost - or is it just more AI hype? I think so, and let me show you why.
Large Language Models (LLMs)
Read more

Blog

My personal agent setup: the architecture that runs my household and my DevRel work

Neha Setia Nagpal
11 min read
June 16, 2026
"Four people, four diets, two work schedules, and a baby who answers to nobody. That's what finally made me build a personal agent." A walkthrough of the actual architecture I run to hold my household and my DevRel work together — profiles, skills, memory, and the web-data layer that makes it all reach the live web.
AILarge Language Models (LLMs)
Read more

Blog

What's becoming of web scraping developers in the age of AI agents?

Neha Setia Nagpal
14 min read
June 9, 2026
AI agents can generate code, suggest selectors, and draft crawl logic. What they can't do is design the system that decides when to stop, what to trust, and how to recover when the web pushes back. That job still belongs to a human.
AI-assisted data extractionAILarge Language Models (LLMs)
Read more

Blog

What multi-agent orchestration looks like in a large-scale web scraping project

Neha Setia Nagpal
18 min read
May 31, 2026
Multi-agent orchestration is having its moment. The diagrams are everywhere now. Boxes for planners, boxes for hands, boxes for daemons, arrows to a shared brain, a human floating at the top. They keep getting prettier. The part where the web pushes back is still the part nobody draws.
AI-assisted data extraction
Read more

Blog

Web scraping on 22 KB of RAM: Fitting the world on an ESP8266 microcontroller

Ayan Pahwa
8 min read
May 25, 2026
Data-gathering doesn’t have to be memory-intensive. You can fit the world’s weather on a 9cm-square board, when you move the work to a web scraping API.
Tool-assisted coding
Read more

Blog

I built scraping agents for 30 days - here’s what I learned

John Rooney
11 min read
May 25, 2026
For the last 30 days, I did one thing almost exclusively: I built scraping systems with AI agents, from the ground up, across real targets, with real deadlines. Not prototypes designed to impress in a demo, not isolated experiments running against a toy website, but production-grade pipelines that needed to ship and keep running.
AI-assisted data extraction
Read more

Blog

I'm not the same developer I was before LLMs

Neha Setia Nagpal
15 min read
May 25, 2026
I've been running a series of conversations with developers at Zyte to understand what's actually changed in the way they work since LLMs showed up. Not the headlines. The day-to-day. What they delegate, what they don't, what they notice, what surprises them.
This one was different on two counts.
Tool-assisted codingWeb scraping APIs
Read more

Blog

Why 10 million tokens won’t save your AI agent (and what will)

Joaquin Bonifacino
10 min read
May 8, 2026
New models can process larger inputs, and confuse themselves in the process. Context management techniques can solve the problem.
AI
Read more
12345

G2.com

Capterra.com

Proxyway.com

EWDCI logoMost loved workplace certificateZyte rewardISO 27001 iconG2 rewardG2 rewardG2 reward

© Zyte Group Limited 2026