Senior Software Engineer – TensorRT Edge-LLM

Job Description

Develop and evolve a state-of-the-art inference framework in modern C++ that extends TensorRT with autoregressive model serving capabilities. Collaborate with teams across CUDA, kernel libraries, compilers, and robotics to deliver high-performance, production-ready solutions.

Requirements: Candidates should have a BS, MS, PhD, or equivalent experience in a relevant field and at least 4 years of software development experience. A deep understanding of transformer models and proficiency in modern C++ are essential.

Key Skills: C++, TensorRT, LLM, VLM, GEMM, CUDA, Attention, MoE, KV Cache Management, Speculative Decoding, Quantization, Tensor Parallelism, Memory-Efficient Scheduling, Compiler Infrastructure, Robotics, Embedded AI

Benefits: Equity, Health Insurance