Ian Kerins | Zyte

Subscribe to our Blog

The latest from Ian Kerins

The challenges e-commerce retailers face managing their web scraping proxies

Visual web scraping tools no longer fit your purpose?

From the creators of Scrapy: Automatic data extraction API

Zyte A.I. Automatic Extraction API | e-commerce & articles

Spidermon: Zyte's secret to data quality

Proxy management: In-house or off-the-shelf proxy solutions?

The rise of web data in hedge fund decision making

Witness the power of web scraped product data for investors

Looking Back at 2018: A Year of Growth and Challenges

Shubber Gettogether 2018: Gathering Innovators and Thinkers

Data Quality Assurance For Enterprise Web Scraping

Price intelligence: Scraping 100 billion products pages

A Sneak Peek Inside What Hedge Funds Think of Alternative Financial Data

Want To Predict Fitbit’s Quarterly Revenue? Eagle Alpha Did It Using Web Scraped Product Data

GDPR Compliance Tools for Web Scraping Crawlers

Scraping The Steam Game Store With Scrapy

In this article we discuss some main challenges that e-commerce retailers face on a daily basis due to the amount of web data needed and how to solve them.

Visual web scraping tools are great. They allow people with little to no technical know-how to extract data from websites with only a couple of hours of upskilling, making them great for simple lead generation, market intelligence, and competitor monitoring projects.

To accurately extract data from a web page, developers usually need to develop custom code for each website.

Today, we’re delighted to announce the launch of the beta program for Zyte's new AI-powered Automatic Extraction API for automated product and article extraction.

If you know anything about Zyte , you know that we are obsessed with data quality and data reliability.

Poor proxy management creates reliability issues and constant firefighting for web scraping teams.

Over the past few years, there has been an explosion in the use of alternative data sources in investment decision making in hedge funds, investment banks, and private equity firms.

What a year 2018 has been for Zyte !!
It’s hard to know where to start…
This year has seen tremendous growth at Zyte , setting us up to have a great 2019.

2018 has been a great year at Zyte , so there was no better way to cap it off than with a company retreat in Lisbon, Portugal.

When it comes to web scraping, one key element is often overlooked until it becomes a big problem.

Web scraping can look deceptively easy these days. There are numerous open-source libraries/frameworks, visual scraping tools, and data extraction tools that make it very easy to scrape data from a website.

Unbeknownst to many, there is a data revolution happening in finance.
In their never ending search for alpha hedge funds and investment banks are increasingly turning to new alternative sources of data to give them an informational edge over the market.

Throughout the history of the financial markets information has been power.

Over the last couple weeks, GDPR has brought data protection center stage. What was once a fringe concern for most businesses overnight became a burning problem that needed to be solved immediately.

This is a guest post from the folks over at Intoli, one of the awesome companies providing Scrapy commercial support and longtime Scrapy fans.