Senior Software Engineer, AI Frameworks

Job Description

Design and maintain production-grade integrations, adapters, plugins, and runtime components that connect NVIDIA Grove with AI frameworks and training and inference stacks. Improve performance, reliability, observability, and operational readiness, while collaborating with framework owners and the open-source community on APIs, reference workflows, and maintainable upstream contributions.

Requirements: Requires a bachelor's, master's, or doctoral degree in computer science, electrical engineering, or a related field, or equivalent experience, and at least five years of relevant experience. Candidates should have hands-on AI framework or runtime integration experience, knowledge of AI workloads and distributed systems, practical Kubernetes and container experience, and strong software engineering skills in Go, C++, and/or Python.

Key Skills: AI Framework Integration, Distributed Systems, Kubernetes, Go, C++, Python, PyTorch, Ray, Dynamo, llm-d, GPU Performance Optimization, Model Serving, Containerization, Observability, Open-Source Collaboration, CI/CD

Benefits: Equity, Benefits