Lead Software Engineer

Job Description

Define and lead evaluation strategies for the safety, reliability, and quality of LLMs, RAG pipelines, and agentic workflows, and build automated evaluation frameworks integrated into CI/CD. Mentor AI testing specialists, lead agile teams, support presales, and contribute to industry authority through articles and open-source benchmarks.

Requirements: Requires 8–11 years of IT experience, including at least 3 years evaluating AI, LLM, and agentic systems, with expert-level Java, Python, and Node.js skills and advanced test automation experience. Candidates should also bring AI/ML and cloud expertise, familiarity with evaluation metrics and tools, strong communication skills, and experience managing onshore and offshore teams.

Key Skills: AI Evaluation, LLM Testing, Agentic Systems, Test Automation, Java, Python, Node.js, Selenium, Playwright, RestAssured, Transformer Architectures, Vector Databases, Cloud Infrastructure, Team Leadership, Manual Testing, CI/CD