Jobs · empllo
Staff Software Engineer, Model Infrastructure
Meridian Softworks · San Francisco · Posted 3d ago
About the role
Lead design and implementation of AI inference systems for Harvey's Model Infrastructure platform.
📋 Description Lead design and implementation of Harvey's Model Infrastructure platform. Build high-availability, low-latency AI inference systems. Design and improve Unified Model Controller and Model Selector for routing. Develop provisioning, capacity management, failover, and traffic engineering across providers. Integrate new model providers and maintain APIs/SDKs for frontier models. Improve observability with dashboards, alerts, token usage analytics, and cost reporting. 🎯 Requirements 7+ years building large-scale distributed systems. Design/operate highly available production services. Proficient in Go, Java, Python, Rust, or C++. Deep understanding of distributed systems and cloud infrastructure. Experience leading multi-team technical projects. Strong communication and collaboration skills. 🎁 Benefits Generous equity compensation Bonus opportunities Work on frontier AI platform Collaborative, fast-moving team culture On-site in San Francisco
Read the full posting on empllo →
FAQ
Is the Staff Software Engineer, Model Infrastructure role at Meridian Softworks remote?+
This Staff Software Engineer, Model Infrastructure position is listed as onsite (San Francisco).
What is the salary for the Staff Software Engineer, Model Infrastructure role at Meridian Softworks?+
The listing states 236000-290000 USD.
What seniority level is this Staff Software Engineer, Model Infrastructure role?+
This is a lead level position.
How do I apply for the Staff Software Engineer, Model Infrastructure role at Meridian Softworks?+
Use the "Apply on empllo" button to open the original posting on empllo, where you can submit your application directly to Meridian Softworks.