Senior AI Platform Engineer

Code Metal
US - Massachusetts - Boston
View Company Profile / << Go Back

  • Job Type: Full time
  • 7 days ago

Job Description

Own platform components from design through production operation, building and maintaining services for model serving, agentic infrastructure, observability, and experimentation. Debug production issues, write and review tested code, collaborate with internal customers and research teams, and run benchmarks to inform platform decisions.

Requirements: Requires production-grade Python and platform engineering experience, plus production experience in at least one area: model serving, agentic infrastructure, or observability and experimentation. Candidates should understand LLMs, inference, experiment design, and evaluation; have working familiarity with PyTorch and Hugging Face; and have experience owning production services, writing design documents, reviewing code, and mentoring or onboarding teammates.

Key Skills: Python, Platform Engineering, Distributed Systems, Kubernetes, CI/CD, LLM Inference, Model Serving, Agentic Systems, Retrieval-Augmented Generation, Observability, Experiment Tracking, PyTorch, Hugging Face, Benchmarking, Model Evaluation, GPU Optimization

Benefits: Health Insurance, Dental Insurance, Vision Insurance, 401(k) With 5% Matching, Uncapped Paid Time Off, Sick Leave, Public Holidays, Flexible Hybrid or Remote Work, Relocation Assistance




Fast Track Upload