Data Engineer [Freelance] M/F/Mx

Résumé du poste
Freelance
Paris
Salaire : Non spécifié
Télétravail total
Compétences & expertises
Contenu généré
Terraform
Dbt
Python
Sap
Postgresql
+4
Postuler

Trustpair
Trustpair

Cette offre vous tente ?

Postuler
jobs.faq.title

Le poste

Descriptif du poste

Trustpair is reinventing B2B payment security. We are building the leading anti-fraud solution for large corporations to help them avoid $20 billion in fraud every year. With Trustpair, finance teams work with accurate data to avoid the risk of fraud and proceed to payments with peace of mind.

  

Trustpair at a glance: 

  • 200+ companies preventing B2B payment fraud with Trustpair (Airliquide, Generali, Kering)
  • A financial technology acclaimed by major banking actors (Société Générale, Natixis, CACIB)
  • Enterprise-ready platform connected to market-leading financial softwares (SAP, Kyriba and more)
  • €25M raised in Series B to become #1 SaaS platform for third-party risk management
  • A team of 100+ people, based in Europe and NYC




About the role:

As the referent Data Engineer at Trustpair, reporting to Cyrille, our VP Operations and working closely with our SRE, VP Engineering and CTO, you will be responsible for leading a significant improvement project (reliability, automation, infra, security). Working on on our existing AWS Data lake, you'll help our stack scale and answer our current and future Data Analytics needs, as well as evolving product-related Data needs.

This is a freelance contract, working five days per week. The improvement project will last at least 2 months, and may be extended. Upon completion there is the possibility to adopt a 2 days per week contract to maintain the stack.

This position is open to full remote, but candidates must be based in France.


What you'll do:

Stack improvement & simplification project
  • Our current stack on AWS is: S3 (Lake), DMS (data change capture), Airflow (Orchestrator), DBT, Athena (query engine), Glue, EMR
  • Initial audit:
    • Assess our technical stack with the current use cases in mind and challenge our patterns
    • Document the processes, the guidelines and when to use Airflow / DMS / DBT


Reliability 

  • Address the monitoring and observability of the stack: monitoring / alerting
  • Deploy some data drift control mechanisms and realignment processes
  • Challenge the staging environment to make it more meaningful before going to prod

Automation / Ingestion

  • For now we have one Data Ingestion pattern by assessing the postgresql wal file and reconstructing images
  • Deploy a new Ingestion pattern that could easily integrate within the data lake


Infra / Tech

  • Migrate Airflow to Kubernetes with our SRE
  • Adapt Airflow configuration to support Google Authenticator
  • Challenge our EMR setup


Security

  • Challenge Data security (RBAC) within the data lake


Other

  • Stack day to day maintenance
  • Ingestion of new sources when required, to support our analytics projects


     

    What’s in it for you 👀

    • A collaborative environment with a flat structure, where everyone’s voice is heard
    • Work with innovative and modern technology related to your role which evolves to provide value
    • Trustpair is in scaling phase with career opportunities in France and internationally
    • Flexible remote policy
    • A talented team with senior colleagues you can learn and work with
    • Inclusive environment with cultural diversity and parity


      Why join Trustpair? A list of our perks here!

      TrustpairMezo-1263.jpg

       

      Must Haves:

      • 3-5 years of experience as a Data Engineer
      • Ability to maintain and improve a whole Data Lake and/or Data Warehouse
      • Good knowledge on data lake architectures and ingestion patterns 
      • Understanding on building a production system with performance and reliability drivers
      • Professional experience with Python
      • Good knowledge of Cloud environments (ideally AWS)
      • Experience in Spark, Airflow or equivalents
      • Good understanding of SQL
      • Fluent in English
      • Strong problem solving skills 
      • Ability to work autonomously 


        Nice to Have:

          • Experience in an AWS environment with some of the following technology: EMR, Glue, S3, Athena
          • Experience working with Terraform and Github CI
          • Experience working with Apache Hudi or equivalent
          • Software Engineering background
          • Basic knowledge of dbt


          Recruitment Process

          4 Step Recruitment Process (1).png
          • First call with Aicha, Talent Acquisition (30 min)
          • Experience interview with Cyrille, VP Operations (30 min)
          • Technical test (at home) & interview with our SRE and VP Engineering (1h)
          • Coffee fit with two members of Trustpair & one of our Co-founders (1h)

           

          Equal Opportunity Statement
          Trustpair's policy is to provide equal employment opportunity in all of our employment practices without regard to race, color, religion, sex, national origin, ancestry, marital status, protected veteran status, age, individuals with disabilities, sexual orientation or gender identity or expression or any other legally protected category.
          Applicants for all positions in Trustpair must be legally authorized to work in the country which they are applying for or be a citizen from Schengen / EU zone. The verification of employment eligibility will be required as a condition of hire.

          Envie d’en savoir plus ?

          D’autres offres vous correspondent !

          Ces entreprises recrutent aussi au poste de “Data / Business Intelligence”.

          Postuler