Senior Software Engineer, Model Infrastructure

Job Description

Lead the design and implementation of a Model Infrastructure platform to ensure high availability and low latency for AI inference. Develop systems for model routing, capacity management, and integration with multiple AI providers.

Requirements: Requires 4+ years of experience building large-scale distributed systems and proficiency in languages like Go, Python, or Java. Candidates should have a deep understanding of cloud infrastructure and experience leading technical projects across teams.

Key Skills: Distributed Systems, Go, Java, Python, Rust, C++, Cloud Infrastructure, Observability, Kubernetes, LLM Serving, Model Routing, SRE, Kafka, Spark, Flink, Airflow