PINGDOM_CHECK

Explore resources by topic or category

Blog

Use Powerful Ban Management With Zyte API’s Scripting API

Mushtaq Ali and Luiz Silva
4 mins
April 25, 2024
You encounter so many different anti-bot systems as a developer working on custom projects for Zyte Data clients. This cat and mouse game requires your time, persistence and deep knowledge of web scraping.

Blog

The trade-offs in crawling infrastructure in the modern anti-bot landscape

Daniel Cave
8 mins
April 10, 2024
In this article, I’llexplain the problem of anti-bot technology for web scraping developers through the lens of the anti-bot distribution curve (a view of the top 250,000 websites and the relative complexity of their anti-bot tech) and the landscape of anti-bot tech across the web.

Blog

Introducing Zyte API Proxy Mode

Adrian Chaves
3 mins
February 6, 2024
Zyte API is the next iteration of Zyte’s best-in class proxy and website unblocking technology. We built it as an HTTP API. This was a conscious design decision: an API to support all your web scraping needs would not work well with the limitations of a proxy API.

Blog

Simplify Your Web Scraping Project with Zyte API

Daniel Cave
5 mins
November 15, 2023
Web scraping developers often find themselves in a struggle to manage bans and blocks. Every time they resolve a ban, it's only a matter of time before their scrapers encounter the same issue again.

Blog

Web Scraping Challenges & Their Cost-Efficient Solutions

Eugenia Evseeva
4 min
November 8, 2023
Web scraping challenges, ranging from IP bans and data accuracy to legal compliance issues, can trip up businesses trying to use web data to fuel machine learning and to make better decisions.

Blog

Data Center Proxies Vs. Residential Proxies

Attila Toth
3 Mins
July 20, 2022
In this blog post, you are going to learn the main difference between data center proxies and residential proxies.

Blog

Ways for Web Scraping Without Getting Blocked

Attila Toth
6 Mins
February 27, 2020
Web scraping is when you extract data from the web and put it in a structured format.