Infrastructure Engineer at Relace
Relace is hiring a Infrastructure Engineer in San Francisco, CA, US. On-site.
About Relace
Relace builds AI models and infrastructure for coding agents, including fast code generation, code retrieval, merging, and autonomous workflows. It provides small language models optimized for retrieval and code generation functions, and source control designed for agents. The company's technology is used by companies deploying code generation at scale.
Infrastructure Engineer job description
About Us
Relace is building the models and infrastructure that code agents reach for. We power the fastest model on OpenRouter (10,000 tok/s) and deliver optimized small language models designed for retrieval, application, and core code generation functions.
Our technology supports some of the world’s fastest-moving companies — including Lovable, Figma, and Vercel — as they deploy and scale code generation to hundreds of millions of users. We recently raised our Series A from a16z, and we’re growing quickly.
Our team is made up of mathematicians, physicists, and computer scientists who are deeply passionate about their craft. If you thrive on ambitious technical problems, care about elegant systems design, and want to build the foundation of how code gets written at scale, this is the place for you.
The Role
As an Infrastructure Engineer at Relace, you’ll design and operate the systems that power our high-performance inference and training infrastructure. You’ll work closely with our research and product teams to ensure our models run at scale with reliability, speed, and cost-efficiency. This is a hands-on engineering role where you’ll shape how we build and scale the backbone of modern code generation.
You’ll have the opportunity to:
- Architect and manage the infrastructure powering our ultra-fast inference and training stack.
- Build reliable, efficient systems for deploying and scaling ML workloads globally.
- Work on GPU scheduling, distributed systems, and high-performance cloud deployments.
- Optimize performance and cost across compute, networking, and storage layers.
- Collaborate with world-class engineers to push the limits of what small models can do.
Requirements
2+ years of experience writing high-quality production code
Strong experience with cloud infrastructure (AWS, GCP, Azure, or equivalent)
Experience with data science and systems optimization
Familiarity with ML infrastructure, GPU’s, etc. a plus
Work out of our SF office in FiDi
