Principal Software Engineer

Job Description

Develop and optimize high-performance commercial software solutions for AI inference acceleration and serving frameworks like vLLM. Lead large-scale software projects and collaborate with cross-functional teams to improve neural network performance on multi-core architectures.

Requirements: Requires a Bachelor's degree in Computer Science or Engineering with over 8 years of experience in delivering commercial software projects. Must possess deep expertise in PyTorch, C++, Python, and the optimization of LLMs on SoC architectures.

Key Skills: PyTorch, C++, Python, vLLM, AI Inference Acceleration, Neural Network Optimization, LLMs, Multi-modal Models, Reasoning Models, SoC Architectures, Multi-core Architectures, Software Design

Benefits: Comprehensive Benefits Package