Member of Technical Staff (Software Engineer, Enterprise Agent Evals & Efficiency)

Job Description

Build realistic enterprise evaluation environments, infrastructure, task suites, and graders to measure agent performance on complex workflows. Analyze failures and ship improvements to agent tools, skills, models, and execution strategies that increase task success and reliability while reducing latency and cost.

Requirements: Requires at least five years of software or machine learning engineering experience, strong system design skills, proficiency in a backend language such as Python, Go, or Rust, and hands-on experience with LLM applications or agents. Candidates should have deep expertise in at least one relevant area, strong experimental judgment, and a record of leading cross-team initiatives through production adoption.

Key Skills: Software Engineering, Machine Learning Engineering, Python, Go, Rust, System Design, LLM Applications, AI Agents, Evaluation Infrastructure, Benchmark Design, Automated Grading, Agent Harnesses, Tool Interfaces, Model Routing, Inference Efficiency, Statistical Analysis