PINGDOM_CHECK
ArticleOpen-source

Autoscraping Casts A Wider Net

AutoScraping: Casts a Wider Net - Learn how to maximize your web scraping efforts with AutoScraping. Find out how it can broaden your data collection horizon.

Shane Evans · Founder, CEO at Zyte

1 min read ·

Autoscraping Casts A Wider Net

Autoscraping casts a wider net

We have recently started letting more users into the private beta for our Automatic Extraction. We're receiving a lot of applications following the shutdown of Needlebase and we're increasing our capacity to accommodate these users.

Natalia made a screencast to help our new users get started:

It's also a great introduction to what this service can do.

We released slybot as an open source integration of the scrapely extraction library and the scrapy framework. This is the core technology behind the autoscraping service and we will make it easy to export autoscraping spiders from Zyte  and run them completely with slybot - allowing our users to have the flexibility and freedom provided by open source.

Try Zyte API

Build your first scraper in minutes

Free trial, no credit card. From a single request to production in an afternoon.

Get started
Open-source

Shane Evans

Founder, CEO at Zyte

Shane's articles trace Zyte's history and open-source projects, including the Scrapinghub-to-Zyte rebrand, Portia's visual scraping tool, and Dash. He also wrote on data-storage architecture decisions (why MongoDB was a poor fit for scraped data), remote-work transition lessons f…

More from this author

Continue reading

skills-are-software
Open-source

Treat your AI skills like software, starting with evals

Most AI skills are never tested — and it shows. Here's how Zyte evaluates scraping skills like real software, catching failures demos miss.

Neha Setia Nagpal14 min read
Dateparser: A Little But Powerful Date Parsing Library
Open-source

Dateparser: a date parsing library for Python

Dateparser turns "3 days ago", "15 Mar 2022" and non-English month names into a Python datetime. What it handles, how to set it, and where it needs help.

Marc Hernandez Cabot11 min read
AI won’t fix your data quality (until you answer these three questions)
Scraping practice

AI won’t fix your data quality (until you answer these three questions)

In our interview, a QA expert warns - before you delegate web scraping quality assurance to AI, make sure you can describe what ‘good’ looks like for yourself.

Neha Setia Nagpal10 min read
The future of Scrapy: Smarter, faster and ready for AI-powered scraping
Open-source

The future of Scrapy: Smarter, faster and ready for AI-powered scraping

What does the future hold for the tool some describe as “the gift that revolutionised web scraping”?

Robert Andrews6 min read
Ten years since Scrapy 1.0: The stats and stories behind your favorite framework
Open-source

Ten years since Scrapy 1.0: The stats and stories behind your favorite framework

See what 10 years of Scrapy 1.0 has built — in milestones and metrics.

Cleber Alexandre5 min read
The rise of Scrapy: How an open-source scraping framework conquered the web
Developer interest

The rise of Scrapy: How an open-source scraping framework conquered the web

The story of Scrapy reflects the broader evolution of the web itself and the ongoing quest to harness its ever-expanding ocean of information.

Theresia Tanzil10 min read

The Community · Newsletter

The best of Zyte and the data web, in your inbox.

One curated edition — new articles, product updates, and the stories shaping the data web. No noise.