Senior Software Engineer - Model Evaluation & AI Systems

📋 Description Define evaluation methodologies for models across STT, TTS, and multimodal. Design, build, and maintain automated evaluation pipelines for batch and streaming (WER, latency). Build scalable evaluation infra — harnesses, orchestration, result-aggregation, GPU clusters. Translate benchmarks into automated pass/fail gates. Build and operate canaries and continuous monitoring to detect regressions. Integrate evaluation gates into CI/CD for continuous verification. 🎯 Requirements BS/MS/PhD in CS/AI/Applied Math or equivalent experience. 5+ years in software or QA with test infra or evaluation systems. Backend/scripting in Python, Rust, or Go. Experience designing automated test pipelines and evaluation frameworks. Strong analytical skills; distinguish real regressions from noise. Lead ambiguous challenges and communicate across teams.