PINGDOM_CHECK

EuroPython 2015: Uniting Pythonistas in Europe

Europython 2015 - Calling all Python enthusiasts! Join us at Europython 2015 for insightful talks and networking opportunities.

Pablo Hoffman

3 min read ·

EuroPython 2015: Uniting Pythonistas in Europe

EuroPython 2015

EuroPython 2015 is happening this week and we’re having the largest company meetup so far as a part of it, with more than 30 members from our fully remote-working team attending. The event which is held in Bilbao started on Monday and is providing great quality talks, sessions, and plenty of tasty Spanish dishes.

scrapinghub-europython-booth

As sponsors, we’ve been privileged with a nice booth where we are connecting with Pythonistas, discussing scraping practices, and giving away lots of swag such as hats, t-shirts, stickers, bottle-openers, and clocks.

europython-scrapinghub-swags

If you’re attending to EuroPython, make sure to drop by and get one of these. Our booth is in the main area (exhibition hall and lounge area) of the Euskalduna Conference Center. 🙂

On the conference’s first day Zytans participated in two talks: one about Frontera, hosted by Alexander Sibiryakov, and one about testing, hosted by Eugene Amirov - both available below.

By Tuesday we hosted two more talks: one about best practices on web scraping, by Shane Evans, and one about Scrapy, by Juan Riaza - also available below. In addition to that, we’ve had a poster session about Frontera and a recruiting session sharing job opportunities and the perks of working for Zyte .

On the third day, Lluis Esquerda hosted a talk about City Bikes, a personal project developed by him on bike-sharing networks (check the video below). As the night came we went to Hotel Ercilla, where EuroPython organizers were hosting the conference's social event (a.k.a. "Pyntxos Night"). There, we were able to enjoy the nice food, other attendees' companionship, and also to have some tricky moves on the dance floor. 🙂

After resting from the party, Thursday came, and with it Juan Riaza's Scrapy Helpdesk. We invited attendees to join us and learn about Scrapy, also getting a couple of swags in our booth.

This Friday Juan Riaza hosted a 3 hours training on Scrapy, sharing tips and building spiders in real-time with the attendees. We also went to the Guggenheim Museum where we met the "Mom Spider" or, as some people say, one of Zyte's ancestors.

With the weekend came the EuroPython sprints, where we teamed up to port Scrapy to Python 3. During the sprint, we managed to unblock our main problem with the port, the handling of URLs and headers and then migrated Request and Response classes so finally it is possible to divide the work and port each component independently. We also managed to split the Scrapy Selectors into a separate library (called Parsel) which reached a stable point and Scrapy now depends on it (we're working on its documentation to make an official release). We continued the Python 3 porting in the following weeks back home and got important contributions from the community that helped increase our test coverage under python3 from 19% to 54% (see current progress in this badge).

Here is the full recorded version of the talks given by Zytans:

Alexander's talk "Frontera: open-source large-scale web crawling framework"

Eugene's talk "Sustainable way of testing your code"

Shane's talk "Advanced Web Scraping"

Juan's talk on "Dive into Scrapy"

Lluis' talk "CityBikes: bike-sharing networks around the world"

It was an amazing experience, our special thanks to the EuroPython organization and for all team members that made it happen!

Try Zyte API

Build your first scraper in minutes

Free trial, no credit card. From a single request to production in an afternoon.

Get started

Continue reading

The harness matters more than the model - Podcast EP07
AI-assisted data extraction

The harness matters more than the model - Podcast EP07

"The model is the engine — but the harness is everything else." In Episode 7, we dig into why the infrastructure layer around your AI model matters more than the model itself, rank the best models available right now, and ask whether the open-weighted revolution is about to make frontier subscriptions obsolete.

John Rooney11 min read
How to build your first Scrapy extension
Developer interest

How to build your first Scrapy extension

My Scrapy project now plays a triumphant fanfare when a crawl finishes clean and a sad trombone when it doesn't, which is also how I finally learned what Scrapy's extension points are actually for.

Ayan Pahwa11 min read
Now what exactly is loop engineering? And where do Anthropic's Fable 5 model and web scraping fit in?
Developer interest

Now what exactly is loop engineering? And where do Anthropic's Fable 5 model and web scraping fit in?

A viral clip from Claude Code's creator put a name to something a lot of us have been circling: loop engineering. Here's why web scraping may be its best-fit domain — and what that means in practice.

Ayan Pahwa12 min read
Automate deployment of your web scraper on VPS with Ubuntu 24.04 cloud-init
Developer interest

Automate deployment of your web scraper on VPS with Ubuntu 24.04 cloud-init

Your VPS is ready, but now you need to work through the same sequence you have run a dozen times before: apt update, apt install python3-pip, pip install scrapy, playwright install chromium, the Chromium dependency list that never installs cleanly on the first try, Redis, possibly Postgres, whatever else this particular project needs.

Ayan Pahwa9 min read
NotAnInterview: “I Have Superpowers Now"
Developer interest

NotAnInterview: “I Have Superpowers Now"

The problem was a project with 12,000 websites to crawl, and there’s no world where you write custom spiders for 12,000 websites, not with a human team and certainly not sustainably. So Javier built a workflow: a set of AI prompts that could analyze a website, figure out its structure, and generate a crawl configuration that a generic spider could then use.

Neha Setia Nagpal9 min read
Flatcar Linux for web scrapers: deploy immutable containers with just one config file
Developer interest

Flatcar Linux for web scrapers: deploy immutable containers with just one config file

The next time you spin up a VPS to give it a persistent home, you spend the better part of an afternoon rebuilding from memory. Here's a tool to help using Flatcar Linux

Ayan Pahwa11 min read

The Community · Newsletter

The best of Zyte and the data web, in your inbox.

One curated edition — new articles, product updates, and the stories shaping the data web. No noise.