Remote Software Engineer - Python/Typescript

Job Description

Design and refine rubrics and evaluation criteria, review and label preference data, and build infrastructure and pipelines for data generation, collection, and evaluation. Summarize findings and collaborate with researchers and engineers to turn qualitative judgments into scalable processes.

Requirements: Proficiency in Python or TypeScript, including experience building or maintaining pipelines and infrastructure; experience with preference data collection or rubric creation is required. Strong communication and the ability to make and explain high-quality judgments are also required.

Key Skills: Python, TypeScript, Pipeline Development, Infrastructure, Preference Data Collection, Rubric Creation, Data Labeling, Data Quality Review, Evaluation Criteria, Written Communication, Verbal Communication, Technical Synthesis, Qualitative Judgment, Collaboration