Explore resources by topic or category

In this article, I’llexplain the problem of anti-bot technology for web scraping developers through the lens of the anti-bot distribution curve (a view of the top 250,000 websites and the relative complexity of their anti-bot tech) and the landscape of anti-bot tech across the web.

Zyte API is the next iteration of Zyte’s best-in class proxy and website unblocking technology. We built it as an HTTP API. This was a conscious design decision: an API to support all your web scraping needs would not work well with the limitations of a proxy API.

Web scraping developers often find themselves in a struggle to manage bans and blocks. Every time they resolve a ban, it's only a matter of time before their scrapers encounter the same issue again.

Web scraping challenges, ranging from IP bans and data accuracy to legal compliance issues, can trip up businesses trying to use web data to fuel machine learning and to make better decisions.

In this blog post, you are going to learn the main difference between data center proxies and residential proxies.

Using Selenium and/or Zyte Smart Proxy Manager? You just stumbled upon the right blog.

We have launched a new Zyte SmartProxy Playwright and we’re sure you’re going to love it!

We are super excited to share some good news for all the Puppeteer users who are looking for an easy-to-integrate anti-ban solution for extracting data from javascript-heavy websites.

If you are new to proxies, we recommend skimming through this blog to understand what a proxy is and why you need proxies for web scraping.

Before we begin, take a look at this short video - it's the scene from Harry Potter where he gets The Invisibility Cloak. It’ll help us better understand the concepts behind proxies.