Software Engineer, Model Capabilities

Job Description

Integrate frontier models into production and improve the reliability, observability, and cost-effectiveness of Notion AI inference. Develop model-level capabilities, support adoption by product teams, and coordinate across AI teams to identify gaps and ensure issues are resolved.

Requirements: Candidates should have experience building and operating production systems using LLM APIs, with practical understanding of token economics, streaming, tool calling, context limits, and production failure modes. They should evaluate model and prompt changes with data, stay informed about evolving models, and balance output quality against latency and cost.

Key Skills: Production AI Systems, Large Language Model APIs, Frontier Model Integration, Inference Reliability, Error Categorization, Self-Healing Retries, Cross-Provider Failover, Observability, Model Evaluation, Prompt Evaluation, Token Economics, Streaming, Tool Calling, Context Limits, Latency Optimization, Cost Optimization

Benefits: Equity, Competitive Benefits