Senior Software Engineer – LLM Evaluation

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Software Engineer – LLM Evaluation based in United States.

• This part-time consulting opportunity is designed for experienced software engineers interested in advancing the evaluation of large language models.
• You will curate high-quality code, develop technical solutions, and evaluate AI-generated software against real-world engineering standards.
• The role spans multiple programming languages and covers the complete software-development lifecycle, from architecture and prototyping through production and maintenance.
• You will design verification mechanisms and contribute to benchmarks that make AI evaluation more rigorous, consistent, and reproducible.
• Your engineering expertise will help research teams identify model strengths, weaknesses, and recurring coding errors.
• You will collaborate remotely with technical and research professionals on projects at the intersection of software engineering and AI.
• The flexible contractor structure requires a minimum of 10 hours per week, with the possibility of working up to 40 hours depending on project needs.