Senior Software Engineer - AI Inference

Job Description

The Senior Software Engineer will contribute features and optimizations to upstream inference engines and improve runtime capabilities for high-throughput, low-latency inference. They will also profile and enhance performance across various layers and collaborate with teams to translate production requirements into effective solutions.

Requirements: Candidates should have over 5 years of experience in building production software with a focus on performance and reliability improvements. Strong programming skills in Python and C++/CUDA, along with experience in LLM inference stacks and profiling, are essential.

Key Skills: Python, C++, CUDA, Performance Optimization, Distributed Systems, Concurrency, Profiling, Benchmarking, Open-source Contributions, LLM Inference, Systems Engineering, Data Analysis, Resource Utilization, Collaboration, Debugging

Benefits: Equity, Health Insurance