Software Engineer, Model Capabilities

Job Description

Integrate frontier models into production and improve the reliability, observability, and cost-effectiveness of Notion AI inference. Develop model-level capabilities and coordinate across AI teams to identify gaps, unblock work, and ensure fixes reach the appropriate owners.

Requirements: Candidates should have experience building and operating production systems using LLM APIs, with practical understanding of token economics, streaming, tool calling, and context limits. They should evaluate model and prompt changes with data, stay current on AI developments, and balance output quality against latency and cost.

Key Skills: Production AI Systems, Large Language Model APIs, Frontier Model Integration, Inference Reliability, Error Categorization, Self-Healing Retries, Cross-Provider Failover, Observability, Model Evaluation, Token Economics, Streaming, Tool Calling, Context Management, Cost Optimization, Latency Optimization, Cross-Functional Collaboration

Benefits: Equity