About Modjo

At Modjo, we’re on a mission to free salespeople to rediscover the art of selling.

The sales world is broken: even top performers spend more time documenting than selling.

We exist to change that.

By removing admin noise and empowering teams with AI agents, Modjo helps sellers focus on what truly matters: building trust, driving strategy, and closing deals.

Our AI doesn’t replace the human touch; it amplifies it. We build for people who want to perform, progress, and win.

With 70+ people and strong ambitions for our next stage of growth, we’re scaling fast across Europe and strengthening our AI team to move even faster in building our AI product capabilities.

About the role

Play a central role in building, maintaining, and scaling the LLM-powered and agentic features that drive Modjo’s product.

Your primary mission will be to design, develop, and evolve our agentic system, which is becoming the backbone of the entire product. You will work across model orchestration, tool execution, evaluation, reliability, and performance—ensuring these systems operate at production scale and deliver consistently high-quality results.

Experience with speech technologies and our self-hosted transcription pipeline is a plus but not a core requirement.

Responsibilities

Design, build, and optimize the agentic stack that powers both conversational and autonomous multi-step agents, ensuring reliability, scalability, and low-latency performance in production.

Architect, productionize, and maintain LLM-powered features end-to-end, including model orchestration, routing, monitoring, logging, and evaluation.

Develop and improve ML infrastructure, including observability, load balancing, scaling patterns, and deployment workflows for agentic and LLM-based systems.

Construct robust datasets and evaluation pipelines for both deterministic systems (ASR) and non-deterministic systems (LLMs and agents), enabling continuous quality improvements.

Collaborate with Software Engineers to build scalable, observable, and automated infrastructure supporting ML services across the platform.

Work closely with Product Managers to assess feasibility, shape feature specs, and ensure timely and reliable delivery of ML- and agent-driven capabilities.

Contribute to technical strategy, model/tool selection, architectural decisions, and long-term roadmap for Modjo’s agentic platform.

Stay ahead of the curve on new research, frameworks, and open-source developments in LLMs, agentic systems, and evaluation methodologies.

Desired Profile

3+ years of experience in ML Engineering, with a strong track record of deploying and maintaining ML or LLM systems in production—including monitoring, scaling, and performance optimization.

Deep familiarity with LLM integration, including model orchestration, prompt/graph design, evaluation methods, reliability patterns, and cost/performance tradeoffs.

Strong experience with production-grade ML infrastructure, including CI/CD, observability, monitoring, containerization, load balancing, and cloud deployment.

Direct experience with agentic systems—such as planning, tool execution, workflows, memory architectures, LangChain/LangGraph, or equivalent frameworks.

Experience with Vector and Graph Databases is a plus.

Experience with MCP (Model Context Protocol), DeepEval, FastAPI, Uvicorn, or production API development is a plus.

Experience with NLP technologies (ASR, diarization, embeddings, audio ML) is a plus.

Comfortable owning projects end-to-end in a fast-paced, highly collaborative engineering environment.

Our Stack

Cloud & Infra: AWS, Langfuse, Datadog

Agentic & LLM Tools: LangChain, LangGraph

LLMs: OpenAI GPT, Anthropic Claude, Google Gemini

Speech & Audio: OpenAI Whisper, NVIDIA NeMo, pyannote.audio

Data & Storage: Postgres, MongoDB, Weaviate, Neo4j