• Modular is building a next-generation AI infrastructure platform that unifies fragmented application frameworks and hardware backends into a single, programmable system – making it easier to deploy AI in production while accelerating innovation across models and hardware
• We’re looking for someone to drive the product vision for Modular’s cloud compute platform: a high-performance, scalable AI model-serving system designed for advanced GenAI developers, with deep visibility and control over performance, cost, and execution
• In this role, you’ll work closely with engineering, program management, and technical writing to turn cutting-edge infrastructure into real customer value, evolve the platform from early adoption into a scalable cloud business, and collaborate with leading AI companies and hardware partners as we redefine modern AI infrastructure through a more transparent, performance-driven cloud
• Own the product vision and strategy for Modular’s Cloud Platform, grounded in real customer workloads and measurable business outcomes
• Partner with engineering and leading AI application teams to design and deliver a high-performance, transparent AI serving platform, giving customers deep visibility and control over performance, cost, and execution
• Define and manage roadmaps, milestones, and success metrics, balancing near-term delivery with long-term platform evolution
• Drive customer- and data-informed prioritization, translating market signals, performance insights, and feedback into clear product decisions and trade-offs
• Work cross-functionally with engineering, program management, technical writing, design, and GTM to deliver a cohesive end-to-end cloud product experience
• Engage directly with advanced enterprise customers and partners to validate direction, support early deployments, and feed learnings back into the platform
• Identify and advance strategic integrations across hardware, cloud, and ecosystem partners while preserving performance and programmability as first-class principles

Benefits

• A variety of fantastic health benefits (health, dental, vision insurance; life insurance etc) are available
• A 401k plan with up to 5% match
• Free tax advice on Carta
• Generous work-from-home stipend of $1500 to help you improve your home office
• Unlimited paid time off and flexible work hours

• Experience defining product vision, shaping roadmap trade-offs, and driving products from early adoption toward broader production use
• Familiarity with security, privacy, and compliance considerations for cloud platforms
• 9+ years of product management experience, including significant work on technical cloud platforms, AI infrastructure, or data systems, or equivalent experience as a software or AI systems engineer
• Strong understanding of cloud architectures and technologies (e.g., Kubernetes), and/or experience with AI infrastructure platforms such as PyTorch, vLLM, CUDA, Vertex AI, SageMaker, or similar systems
• Excellent written and verbal communication skills, especially when working across technical and non-technical audiences
• Strong analytical and systems-level thinking, with the ability to reason about performance, scalability, and cost
• A growth-oriented mindset with a bias toward learning from customers, data, and real-world usage
• Master’s degree or Ph.D. in Computer Science or related technical field
• Experience developing, training, and/or deploying machine learning models into production environments
• Have worked in or around startups before or have a strong understanding of the nature of fast-moving, highly dynamic teams