Senior Software Engineer

Job Description

Lead the architectural design and delivery of core AI platform systems, including the LLM Gateway and Knowledge Base infrastructure. Oversee AI FinOps for cost optimization and collaborate cross-functionally to build production-grade AI agents.

Requirements: Requires at least 5 years of software engineering experience in ML/AI infrastructure or distributed systems. Proficiency in Python and a systems language like Go, Rust, or C++ is essential, along with deep knowledge of LLM orchestration and vector databases.

Key Skills: ML/AI Infrastructure, LLM Systems, Distributed Platform Services, Python, Go, Rust, C++, API Design, Microservices, Vector Databases, Model Serving Architectures, AI FinOps, Orchestration Patterns, Agent Frameworks, Observability Tools, Fine-tuning

Benefits: Equity, Performance bonuses, Medical insurance, Dental insurance, Vision insurance, 401(k) plan