Machine Learning Engineer - Inference

📋 Description Design and build production systems powering the Nimbus Data Systems inference engine at scale. Develop and optimize runtime inference services for large-scale AI apps. Collaborate with researchers, engineers, PMs, and designers to bring new features. Conduct design and code reviews to ensure high-quality standards. Create services, tools, and docs to support the inference engine. Implement robust, fault-tolerant data ingestion and processing. 🎯 Requirements 3+ years of experience writing high-performance, production-quality code. Proficiency with Python and PyTorch. Experience building high-performance libraries and tooling. Strong grasp of OS concepts: multi-threading, memory, networking, storage, performance. Knowledge of CUDA/Triton programming. Knowledge of AI inference systems like TGI, vLLM, TensorRT-LLM, Optimum. 🎁 Benefits Startup equity, health insurance, and other benefits.