Since 2014, Wiremind has positioned itself as a technical company transforming the world of transport and events with a 360° approach combining UX, software, and AI.
Our expertise lies primarily in optimizing and marketing our clients' capacity. We work on various projects such as ticket forecasting and pricing, 3D optimization of air freight or scraping competitor prices. Our applications are the preferred tool of companies such as SNCF, United Airlines, Qatar Airways or even PSG to visualize, analyze and optimize their capacity.
Dynamic and ambitious, we strive to maintain our technical DNA which is the engine of our success. The company, profitable and self-financed since its creation 10 years ago, is mainly composed of engineers and experts and currently supports the growth of our business model based on "software-as-a-service" solutions.
Your missions 🚀
As a Lead Scraping Engineer, you will join the scraping team and take part in the development of new scrapers for our solution named Cayzn Tracking. This application offers our customers continuous monitoring of their competitor by scraping millions of price points every night on protected websites.
Responsible for maintaining and enhancing our in-house scraping framework, you take the lead on the scraping of well protected and challenging websites to ensure scraping at scale.
In practice – even though there is no typical day – you can expect to:
-
Improve our internal webscraping architecture with top features like advanced retry, stickies sessions or on-demand scraping
-
Develop new web scrapers (spiders), to gather and collect data from specific sources (websites, APIs) , and convey this data through multiple steps and pipelines: cleaning the data, parsing and then saving it to our datastore
- Use and strengthen our anti-ban modules (eg. headless browser)
-
Maintain and monitor in production scrapers to ensure the continuous delivery of reliable data to our customers at scale with minimal downtime on website changes
- Be a technical lead within the team
-
Share your knowledge with other people and learn from others
-
Help improve Wiremind’s technical stack by: tackling technical problems, strengthening our operational monitoring, using new framework / technos where needed, introducing new development practises, etc
Technical stack:
-
Backend: Python 3.11+ with SQLAlchemy
-
Scraping: Scrapy framework, headless browser solutions, rotating proxy solution
-
Data-store: Postgresql, Elasticsearch, Redis
-
Gitlab / Kubernetes for CI/CD
-
Prometheus/Grafana and Kibana for operations
Your profile 🔍
- You possess an Engineering degree with a minimum of 5 years of experience in Python or a similar backend language within a large-scale codebase
- You have worked on web scraping, data gathering and anti-bot security
- You're passionate about addressing business challenges through innovative technological solutions
- You are committed to maintaining high-quality standards in all aspects of your work
- You have experience collaborating on large codebases with multiple contributors
- You're comfortable refactoring and improving existing code
- You excel at debugging across multiple layers of architecture
- You enjoy mentoring junior colleagues, guiding them in their professional growth
Our benefits 🤌
By joining us, you will integrate:
- A self-financed startup with a strong technical identity! 🧬
- Beautiful 700 m² offices in the heart of Paris (Bd Poissonnière) ✨
- Attractive remuneration indexed on performance 💪
- A caring and stimulating team that encourages skills development through initiative and autonomy
- A learning environment with opportunities for evolution 🧑💻
You will also benefit from:
- Training on demand💡
- A hybrid policy: 2 days of remote work per week and the possibility to work occasionally from abroad 💻
- A great company culture (monthly afterworks, regular meetings on technology and products, annual off-site seminars, team-building…)
- An annual budget for your IT equipment
- A partnership with the People & Baby network of inter-company nurseries to help with childcare for children aged 0 to 3 🐣
Our Recruitment Process 🤞
- A screening interview with Anne-Laure, our Senior Talent Manager
- An interview with the Hiring Manager
- A technical test or case study to be prepared
- A last interview at our offices to discuss your technical test or case study and meet with members of the team
- A culture fit with our CEO
Wiremind is committed to equality of opportunity, diversity, and fairness. We encourage all candidates with the necessary experience to apply for our job offers.
