This position is no longer available.

Senior Data Engineer (full remote or hybrid)

Permanent contract
Paris
Salary: Not specified
Starting date: January 12, 2023
Fully-remote
Experience: > 4 years

Shippeo
Shippeo

Interested in this job?

Questions and answers about the job

The position

Job description

We are looking for a Data Engineer to join our Data Intelligence Tribe.

The Data Intelligence Tribe is responsible for leveraging Shippeo’s data from our large shipper and carrier base, to build data products that help our users (shippers and carriers alike) and ML models to provide predictive insights. This tribe’s typical responsibilities are to:

  • get accurately alerted in advance of any potential delays on their multimodal flows or anomalies so that they can proactively anticipate any resulting disruptions
  • extract the data they need, get direct access to it or analyze it directly on the platform to gain actionable insights that can help them increase their operational performance and the quality and compliance of their tracking
  • provide best-in-class data quality by implementing advanced cleansing & enhancement rules

As a Data Engineer at Shippeo, your objective is to ensure that data is available and exploitable by our Data Scientists and Analysts on our different data platforms.
You will contribute to the construction and maintenance of Shippeo’s modern data stack that’s composed of different technology blocks:

  • Data Acquisition (Kafka, KafkaConnect, RabbitMQ),
  • Batch data transformation (Airflow, DBT),
  • Cloud Data Warehousing (Snowflake, BigQuery),
  • Stream/event data processing (Python, docker, Kubernetes) and all the underlying infrastructure that support these use cases.

Preferred experience

Required:

  • You have a degree (MSc or equivalent) in Computer Science.

  • 3+ years of experience as a Data Engineer.

  • Experience building, maintaining, testing and optimizing data pipelines and architectures

  • Programming skills in Python and experience with asynchronous event processing (asyncio).

  • Advanced working knowledge of SQL, experience working with relational databases and familiarity with a variety of databases.

  • Working knowledge of message queuing and stream processing.

  • Knowledge of Docker and Kubernetes.

  • Knowledge of a cloud platform (preferably GCP).

  • Experience working with workflow management systems such as Airflow.

Desired:

  • Experience with cloud based data warehouse solutions (BigQuery, Snowflake).

  • Experience with Kafka and KafkaConnect (Debezium).

  • Experience with Infrastructure as code (Terraform/Terragrunt).

  • Experience building and evolving CI/CD pipelines with Github Actions.

  • Monitoring and alerting on Grafana / Prometheus.

  • Experience working on Apache Nifi.

Want to know more?

These job openings might interest you!

These companies are also recruiting for the position of “Data / Business Intelligence”.

See all job openings