We are searching for a Senior Data Engineer to play a key role in an exciting new team within Trainline that improves the customer experience for rail passengers with accurate train tracking and mapping tools. This role will involve innovating and developing new technology and working on the maintenance, monitoring, and reliability of services that are already in production.  

In addition, you will collaborate with an exciting new research and development team to bring innovations to the market. This will also involve building proof-of-concept prototypes, testing their viability, and bringing the technology to market.  

As a Senior Data Engineer at Trainline, you will...  🚄 

• Improve the passenger experience by developing data engineering pipelines that improve train tracking.   
• Work as part of the research and development team to test the viability of new products and services.   
• Work as part of a multi-discipline team that includes data scientists, front-end developers, and engineers to ship new features and products.   
• Create tools, frameworks and processes that accelerate service speed, efficiency, maintenance, and reliability.   

We'd love to hear from you have... 🔍   

• Data Engineering experience using SQL and Python.   
• Previous experience with data lakes in AWS, Glue Catalog and Athena or Starburst  
• Good understanding of Spark: optimisation and performance tuning   
• Capability of using popular data modelling tools to create a diagram of proposed tables to enable discussion   
• Good communication skills and are comfortable with presenting ideas and outputs to technical and non-technical users    
• Have an advanced degree in engineering, physics, computer science or a similar quantitative discipline
• Have extensive experience of cloud infrastructure, such as AWS services such as ECS, ECR, RDS, and Redis 
• Familiarity with DevOps technologies, such as Terraform, Bash, Linux operating systems, and Docker 
• Familiarity with Python libraries, such as Pandas, SqlAlchemy, Alembic, PySpark, Flask, and Fast API
• Experience in developing monitoring and alerting systems using technologies such as CloudWatch, CloudTrail, New Relic, and Grafana   
• Experience with advanced data management like sharding and partitioning and familiar with a range of data stores like PostgreSQL, DynamoDB, and Redis, and familiarity with optimisation techniques
• Extensive experience with CI/CD technologies, such as Docker, GitHub Actions, and Terraform

Nice to haves:   

• Geospatial analysis, for example by manipulating and processing using tools like PostGIS, GeoPandas, PyProj, Turn and Topology Suite
• Network analysis, for example knowledge of graph theory and tooling, like Neo4J, NetworkX and PgRouting   
• Signal processing experience, for example using digital signal processing like filters and transforms
• Navigation algorithms, for example designing and implementing Kalman filters and least squares estimators