Software Engineer (Enterprise)

Job summary
Permanent contract
London
A few days at home
Salary: Not specified
Experience: > 5 years
Skills & expertise
Collaboration and teamwork
Training and development
FastAPI
Kubernetes
NoSQL
+9
Apply

Scale AI
Scale AI

Interested in this job?

Apply
Questions and answers about the job

The position

Job description

  • We’re looking for a Backend Engineer to help bring large-scale GenAI systems to production
  • In this role, you’ll build the core infrastructure that powers AI products for some of the world’s largest enterprises—designing scalable APIs, distributed data systems, and robust deployment pipelines that enable production-grade reliability and performance.
  • This is a rare opportunity to be at the center of the GenAI revolution, solving hard backend and infrastructure challenges that make AI truly work at enterprise scale
  • At Scale, we don’t just follow AI advancements — we lead them
  • Backed by deep expertise in data, infrastructure, and model deployment, we are uniquely positioned to solve the hardest problems in AI adoption
  • Join us in shaping the future of enterprise AI, where your work will directly impact how businesses operate, innovate, and grow in the age of GenAI
  • Design, build, and scale backend systems that power enterprise GenAI products, focusing on reliability, performance, and deployment across both Scale’s and customers’ infrastructure
  • Develop core services and APIs that integrate AI models and enterprise data sources securely and efficiently, enabling production-scale AI adoption
  • Architect scalable distributed systems for data processing, inference, and orchestration of large-scale GenAI workloads
  • Optimize backend performance for latency, throughput, and cost—ensuring AI applications can operate at enterprise scale across hybrid and multi-cloud environments
  • Manage and evolve cloud infrastructure (AWS, Azure, or GCP), driving automation, observability, and security for large-scale AI deployments
  • Collaborate with ML and product teams to bring cutting-edge GenAI models into production through efficient APIs, model serving systems, and evaluation frameworks
  • Continuously improve reliability and scalability, applying strong engineering practices to make AI systems robust, maintainable, and enterprise-ready

Benefits

  • Health & Wellbeing: Our holistic approach to supporting Scaliens includes comprehensive health coverage, dental and vision insurance, mental healthcare services, and more. PTO policies and accommodating schedules ensure you’ll get time off when you need it to relax and recharge. Note that our offerings may vary by region as we strive to respond to the unique needs of Scaliens around the globe.
  • Personal & Career Growth: Continuously learn and grow through annual learning & development stipend, attending leadership breakfasts, manager training, speaker series, and joining an ERG.
  • Building Scale Community: We welcome guests to our offices, and you can expect to see Scalien families and friends around. Join local happy hours, and accept invites to game nights, book clubs, and many other employee-led community events.
  • Parental Support: Balancing work and family is essential, and Scale understands the importance of having adequate leave policies in place to promote a healthy home and work life.

Preferred experience

  • If you’re excited about pushing the boundaries of AI-driven product development, we want to hear from you
  • Strong understanding of observability, CI/CD, and security best practices for running services in enterprise or multi-tenant environments
  • Hands-on experience with GenAI applications, model integration, or AI agent systems—understanding how to deploy, evaluate, and scale AI workloads in production
  • Experience managing data systems such as relational and NoSQL databases (PostgreSQL, DynamoDB, etc.) and building pipelines for data-intensive applications
  • Proficiency in Python or TypeScript, with experience designing high-performance APIs and backend architectures using frameworks such as FastAPI, Flask, Express, or NestJS
  • Collaborative mindset, working closely with ML, infra, and product teams to bring complex GenAI systems into production at enterprise scale
  • 4+ years of experience developing large-scale backend or infrastructure systems, with a strong emphasis on distributed services, reliability, and scalability
  • Deep familiarity with cloud infrastructure (AWS and Azure preferred), including container orchestration (Kubernetes, Docker) and Infrastructure-as-Code tools like Terraform
  • Ability to balance rapid iteration with production-grade quality, shipping reliable backend systems in fast-paced environments

These job openings might interest you!

These companies are also recruiting for the position of “Software & Web Development”.

See all job openings
Apply