No information about remote work conditions has been provided for this job.
Type of contract for this position: Permanent contract
The position
Job description
As Engineering Manager for Storage Products on the Runtime Fabric team, you will lead the engineers who build and run the storage products behind that stack: the Baseten Delivery Network (BDN), which sits in the cold start path of every model on the platform, the snapshotters and filesystems that expose model weights and container images to a running container, and the storage that model deployment and training need next
The team is advancing the next generation of caching for inference workloads, from the origin tier to the GPU host
You will own reliability for the area as a measured outcome, report to the head of Runtime Fabric, and stay close to the code through design and code review
If you’ve managed systems engineers and have hands-on experience with caching, content-addressable storage, or distributed filesystems, we’d love to talk
Team Leadership and Culture
Hire and grow a team of 5 to 10 systems engineers with storage, caching, and Linux expertise
Run the team’s planning and delivery: scope work against the Runtime Fabric roadmap, set priorities, and ship on a predictable cadence
Provide regular coaching, feedback, and career development support to your direct reports
Own on-call health for the team’s services, including escalation paths and follow-through on incidents
Technical Direction
Guide the architecture and evolution of the Baseten Delivery Network: the tiered caching and weight delivery product that makes cold starts 2-3x faster and eliminates thundering herd failures during burst scaling events
Shape storage products tailored to Baseten’s workloads: extend BDN from model weights to container images, training checkpoints, and deployment artifacts, and define the interfaces that model deployment, training, and customers use to reach them
Oversee the on-host side of delivery: lazy-loading snapshotters, EROFS and overlayfs layouts, and block-level delivery (FUSE, ublk) for multi-gigabyte files
Own reliability of the delivery path as a measured outcome: end-to-end instrumentation from snapshotter initialization to first inference request, targets for cold start and cache behavior, tolerance for failing upstream registries and object stores, and safe rollout of changes to a path every customer depends on
Make the delivery path work across heterogeneous clusters and cloud providers, each with its own object store and network
Review designs and code across the area, and take on hands-on work where it unblocks the team
Champion the team’s contributions back to containerd and the snapshotter ecosystem alongside the maintainers on the Runtime Fabric team
Cross-Functional Partnership
Act as the point of contact for storage across Baseten, ensuring model deployment, training, and platform teams have the integration support they need
Optimize requirements for the underlying storage platforms with the infrastructure team: object storage, local NVMe and block storage, and network bandwidth per cluster, so that capacity and provider decisions account for what the delivery path needs
Manage the team’s dependencies in both directions: sequence work that model deployment, training, and infrastructure teams block on, and negotiate interfaces and timelines with the teams and upstream projects the storage path depends on
Work with the head of Runtime Fabric and product stakeholders to prioritize storage investments based on customer impact and infrastructure reliability
Communicate team progress, technical trade-offs, and incidents clearly to the team and to leadership
Benefits
Remote-first work environment. The Baseten team is welcome to work from wherever they want; fully remote, in our San Francisco office, or a mix of both. Today, our team (including our founding team) is spread across the United States, Canada, and Armenia. We provide a $1,000 stipend for you to make your home-office comfortable and productive
Regular in-person team summits. We get together as a team three times a year to plan, workshop, and most importantly, get to know each other better
Unlimited PTO. We ask that everyone take at least 4 weeks of vacation. And we have a company-wide break between Christmas and New Year’s Day
Full healthcare coverage. Medical, dental and vision insurance for you and your family
Paid parental leave. 16-weeks fully paid parental leave (adoptive and non-birth parents included) and flexibility with schedules while returning to work
Company-sponsored 401(k) for you to contribute to
Learning and development budget. We encourage you to take classes, attend conferences, and invest in your craft and we’ll cover expenses to make it happen
Preferred experience
Strong written and verbal communication skills, with the ability to influence without authority across teams
Experience managing a team of engineers in a systems, infrastructure, or storage context, including hiring and performance management [TODO: confirm whether a tech lead stepping into management qualifies]
Understanding of how container images are structured, stored, and delivered at scale
Hands-on background in distributed storage systems, content-addressable storage, or large-scale caching infrastructure
Working knowledge of the Linux storage stack: filesystems, the page cache, block devices, and mounts
Strong systems programming background in Go, Rust, and/or C/C++, with the ability to engage credibly in code reviews and architectural discussions
Contributions to containerd/containerd, snapshotter projects (stargz, soci, nydus, overlaybd), distribution/distribution, or closely related open-source projects
Familiarity with lazy-loading snapshotters or peer-to-peer image distribution
Experience with EROFS, FUSE, ublk, or io_uring
Experience building or operating CDN, object storage, or large-scale caching infrastructure
Experience running storage services on Kubernetes
These job openings might interest you!
These companies are also recruiting for the position of “Engineering Disciplines”.