At Wiremind, our goal since we started in 2014 is to create optimization systems for the transport, logistics, sports and hospitality industries, without compromising on user experience. We build solutions that blend great design with cutting-edge technology to process vast quantities of data.

This leads us to work on many different kinds of projects: forecasting the demand for railway passengers between two major cities, handling millions of data points that we collect everyday through web-crawling, calculating the optimal way to fill an aircraft pallet with boxes of multiples dimensions and show the result in 3D, handle bookings in real time for major european football clubs.

Our applications are used daily by hundreds of users among the largest players of each industry (railway companies, airlines, etc.) in many countries and several continents.

We are now a team of 120+, growing about +100% every 18 months.

Our business model is built on “software-as-a-service” solutions licensed through long-term contracts, allowing our strong growth to be based on strong profitability – without requiring any fundraising.

Your missions 🚀

At Wiremind, the scraping team is responsible for scraping the web to uncover our customer’s competitors prices. By simulating travel queries on travel reservation websites through complex scraping mecanism mimicking human behaviors, the scraping team gathers billions of data point every day. The team is divided in:

• a product squad handling the interface with customers, sales meeting, and overview the sprints
• an anti-ban squad responsible to develop a scraping framework capable of handling our scraping workload without being flagged and banned as scrapers
• a scraping team using the scraping framework to develop and maintained a set of scrapers to implement the product roadmap

The scraping teams also exposes a few APIs that are consumed by other Wiremind teams (cayzn) and by a frontend dataviz application (Cayzn tracking) whose development is halfway between scraping team and Cayzn software team.

The product is gaining strong traction, with annual growth of 20–30%. It plays a pivotal role in our strategy, serving as a key entry point to attract and onboard new customers into our full ecosystem (competition tracking - revenue management - inventory management).

WHAT YOU WILL DO

With the support of the product team, the lead scraping engineer is responsible for:

• Implement new scrapers and/or modify existing broken ones
• Prioritize and defend a technical roadmap to balance technical debt, product roadmap and implementation and scaling customer scraping plans
• Take part in maintenance tasks, application monitoring and infrastructure management. Our solution uses dozens of services which are carefully monitored.
• Exchange with the anti-ban squad to follow their developments and construct their roadmap.
• Mentor and manage the team by reviewing their merge request, distribution the daily tasks, set up a monitoring team for daily operational support, conduct the bi-yearly interviews
• Report to and construct the tech roadmap with the founder and CTO of Wiremind

Technical stack:

• Backend: Python 3.11+ with SQLAlchemy
• Scraping: Scrapy framework, headless browser solutions, rotating proxy solution
• Data-store: Postgresql, Elasticsearch, Redis
• Gitlab / Kubernetes for CI/CD
• Prometheus/Grafana and Kibana for operations

Your profile 🔍

• You possess an Engineering degree with a minimum of 5 years of experience in Python or a similar backend language within a large-scale codebase
• You have worked on web scraping, data gathering and anti-bot security
• You're passionate about addressing business challenges through innovative technological solutions
• You are committed to maintaining high-quality standards in all aspects of your work
• You have experience collaborating on large codebases with multiple contributors
• You're comfortable refactoring and improving existing code
• You excel at debugging across multiple layers of architecture
• You enjoy mentoring junior colleagues, guiding them in their professional growth

Our benefits 🤌

By joining us, you will integrate:

• A self-financed startup with a strong technical identity! 🧬
• Beautiful 700 m² offices in the heart of Paris (Bd Poissonnière) ✨
• Attractive remuneration indexed on performance 💪
• A caring and stimulating team that encourages skills development through initiative and autonomy
• A learning environment with opportunities for evolution 🧑‍💻

You will also benefit from:

• Training on demand💡
• A hybrid policy: 2 days of remote work per week and the possibility to work occasionally from abroad 💻
• A great company culture (monthly afterworks, regular meetings on technology and products, annual off-site seminars, team-building…)
• An annual budget for your IT equipment
• A partnership with the People & Baby network of inter-company nurseries to help with childcare for children aged 0 to 3 🐣

Our Recruitment Process 🤞

1. A screening interview with Anne-Laure, our Senior Talent Manager
2. An interview with the Hiring Manager
3. A technical test or case study to be prepared
4. A last interview at our offices to discuss your technical test or case study and meet with members of the team
5. A culture fit with our CEO

Wiremind is committed to equality of opportunity, diversity, and fairness. We encourage all candidates with the necessary experience to apply for our job offers.