Software Engineer - Evaluation (Remote)

About this role

This part-time remote position involves evaluating large language models by analyzing real open-source repositories, setting up testing environments, and assessing how well LLMs perform on bug-fixing tasks and code evaluation scenarios. The ideal candidate has at least three years of software engineering experience, strong Go skills, and comfort working with complex codebases, Docker, and Git workflows. A standout requirement is demonstrated ability to run and modify real-world projects locally while collaborating with researchers to identify challenging coding problems for LLM evaluation.

Sourced via google_jobs · HirePadi job board