Scraping Specialist

Résumé du poste
CDI
Paris
Salaire : Non spécifié
Télétravail total
Expérience : > 3 ans
Éducation : Sans diplôme
Compétences & expertises
Technical aptitude
Creative thinking
Team building
Gitlab
Kubernetes
+5

Wiremind
Wiremind

Cette offre vous tente ?

jobs.faq.title

Le poste

Descriptif du poste

As a Scraping Specialist, you will join the scraping team and take part in the development of new scrapers for our solution named Cayzn Tracking. This application offers our customers continuous monitoring of their competitor by scraping millions of price points every night on protected websites.
Responsible for maintaining and enhancing our in-house scraping framework, you take the lead on the scraping of well protected and challenging websites to ensure scraping at scale.

In practice – even though there is no typical day – you can expect to:

  • Improve our internal webscraping architecture with top features like advanced retry, stickies sessions or on-demand scraping.

  • Develop new web scrapers (spiders),  to gather and collect data from specific sources (websites, APIs) , and convey this data through multiple steps and pipelines: cleaning the data, parsing and then saving it to our datastore

  • Use and strengthen our anti-ban modules (eg. headless browser)

  • Maintain and monitor in production scrapers to ensure the continuous delivery of reliable data to our customers at scale with minimal downtime on website changes

Technical stack:

  • Backend: Python 3.11+ with SQLAlchemy

  • Scraping: Scrapy framework, headless browser solutions, Scrapoxy

  • Data-store: Postgresql, Elasticsearch, Redis

  • Gitlab / Kubernetes  for CI/CD

What’s in for you:

  • Tech-focused: With 70% of our workforce being engineers, we are a tech company at core

  • Beautiful headquarters: While remote work is an option, our 700 square-meter office in central Paris is designed to offer the best amenities and setup (pool table, gaming consoles, wide desk, 2 monitors per spot etc.)

  • Event: Share and connect with your teammates through events such as our monthly after-work gatherings, regular tech & product meetups, Christmas dinner, yearly off-site retreats, team building activities, and many others

  • Complete package: We offer attractive pay packages (depending on your profile), closely linked to your performance and the company’s growth

  • Full remote friendly: Full remote employee receive a monthly allowance to cover their work expenses


Profil recherché

  • You are interested in web scraping, data gathering and anti-bot security.

  • You are curious, you like challenges and want to think out-of-the-box to find  solutions

  • You are above average in terms of rigor and autonomy, you are proactive and curious.

  • You have a good general culture in computer science and you are looking for a quick progression perspective in an environment with best development practices.

Envie d’en savoir plus ?

D’autres offres vous correspondent !

Ces entreprises recrutent aussi au poste de “Software & Web Development”.

Voir toutes les offres