We are looking for a Data Engineer for our Product department. We are a close-knit team of dedicated Engineers, Product Managers, and Designers who place collaboration and teamwork above all else. Individually, we enjoy great freedom in our work, while sharing the same objectives with the entire team and always benefiting from their support.

We are now looking for a qualified and motivated Data Engineer to join our dynamic team. As a Data Engineer, you will play an essential role in the design, development and optimization of our Big Data infrastructure. You will work collaboratively with our data scientists, analysts, and software engineers to ensure efficient collection, storage, and processing of massive data sets, with a focus on cost optimization.

Your role:

• Leverage your in-depth knowledge of the Databricks and Delta Lake environment to design, develop, and maintain resilient pipelines for ingesting, processing, and transforming large datasets from various sources, ensuring data quality and consistency.

• Maintain and optimize data processing flows, storage systems, and Cloud resources to maintain excellent cost control without compromising performance and reliability.

• Participate in the architecture and management of real-time data streams using Apache Flink and Apache Kafka to process and analyze data, feed decision-making systems, and BI platforms.

• Create and maintain robust ETL processes that standardize data integration and transformation tasks.

• Implement data validation and cleansing processes to adhere to the strictest data quality standards.

• Monitor and adjust the performance of data pipelines and storage infrastructure to meet and exceed performance standards.

• Implement and maintain strict data security measures to protect sensitive information and ensure compliance with data privacy regulations.

• Maintain comprehensive and up-to-date documentation for data pipelines, systems, and processes, and actively share knowledge within the team.

• Collaborate seamlessly with cross-functional teams to understand data requirements and provide technical support for data-driven initiatives.

Your qualifications:

• Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related field with 5 years of experience.

• Solid understanding of Big Data & real-time data technologies such as Databricks, Data Lake designs, Apache Spark, Apache Kafka, Apache Flink, and distributed computing.

• Proficiency in programming languages such as Python, Java, or Scala. Proven experience as a data engineer in a Big Data environment managing and processing large datasets and tasks.

• Strong familiarity with cloud platforms such as AWS, GCP, or Azure.

• Excellent problem-solving skills and strong ability to work in a fast-paced collaborative environment.

• Excellent communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.

• Thorough understanding of data security (GDPR) and best practices in privacy.

• Experience implementing cost optimization strategies in a cloud-based Big Data environment is highly desirable.

• Fluency in English and French.