PINGDOM_CHECK

Explore resources by topic or category

Blog

Judge dismisses X’s lawsuit against Bright Data (for now)

Sanaea Daruwalla
6 mins
July 3, 2024
Bright Data has been having great success in getting the lawsuits brought against it by social media giants dismissed.

Blog

Driving Business Success: How AI Data Mining Unlocks Value

Alistair Gillespie
8 Mins
June 18, 2024
The use of data mining and Artificial intelligence (AI) in business is rapidly evolving and capable of helping organizations create new and innovative business models.

Blog

Pioneering web scraping technologies and building a developer community- Part 1

Voy Zeglin
10 mins
June 17, 2024
Welcome to our latest initiative, where we delve into the minds of industry innovators and leaders. Today, we are thrilled to introduce you to Voy Zeglin, the dynamic CEO of Data Miners.

Blog

When LLM Web Scraping isn't Enough to Scale Web Scraping

Anita Clarke
6 mins
June 12, 2024
If you’re not using AI, you’re being left behind. Ever since ChatGPT burst onto the scene, this is the message developers are constantly hearing.

Blog

The trade-offs in crawling infrastructure in the modern anti-bot landscape

Daniel Cave
8 mins
April 10, 2024
In this article, I’llexplain the problem of anti-bot technology for web scraping developers through the lens of the anti-bot distribution curve (a view of the top 250,000 websites and the relative complexity of their anti-bot tech) and the landscape of anti-bot tech across the web.

Blog

Compliant Web Scraping with AI

Callum Henry
6 mins
March 15, 2024
Zyte’s flagship product, Zyte API, now includes built-in features that automate crawling using spider templates, and our patented AI-powered automated extraction, which gives you quality structured data quickly without writing custom parsing code.

Blog

Celebrating Ethics in Web Scraping With the EWDCI Certification

Sanaea Daruwalla
4 mins
November 21, 2023
The reputation of web scraping hasn’t always been the best. Unsavory actors have cast a shadow over the reputable parts of the web scraping industry at large, and it has to stop.

Blog

Web Scraping Challenges & Their Cost-Efficient Solutions

Eugenia Evseeva
4 min
November 8, 2023
Web scraping challenges, ranging from IP bans and data accuracy to legal compliance issues, can trip up businesses trying to use web data to fuel machine learning and to make better decisions.