hirly

540

Forward Deployed Engineer

Arlington, VA

hirly Pro

Get in front of the people hiring at 540

  • Reach the hiring manager at 540 on LinkedIn, from your own account
  • hirly applies to this job for you, with unlimited applications
  • A resume and cover letter written for this job, unlimited
  • The hiring manager and recruiter at 540, with contact details
Get Pro for this job →

$49 a month · ₹1,999 for 30 days in India · cancel any time

See how you match this job — and similar ones. Free.

Upload your resume and hirly scores it against this role at 540 first, then against similar open jobs, and shows where you fit and why.

PDF or DOCX, up to 12MB. No sign-up to see your matches.

Get past the screening software and onto a recruiter's desk

hirly rewrites your resume for this job — matching the keywords and skills in the posting, moving your most relevant experience to the top, and writing a cover letter to fit. About 30 seconds.

  • Keywords matched to this posting
  • Fit score before you apply
  • Cover letter included

Matched against 2.3M live jobs from 220,000+ employers in 200+ countries.

Tailor my resume for this job →

Apply from your AI assistant

Connect hirly to Claude or ChatGPT and ask it to apply to this job. hirly tailors your resume, fills the employer’s form and asks before sending.

Some employer sites stop an application at a CAPTCHA or sign-in and hand it back with a link. Applying needs a paid plan. Works with any assistant that supports MCP.

hirly's read of this role

Seniority
Mid level
Country
US
Work mode
Remote-friendly
First seen by hirly
19 Nov 2026

Derived automatically from the posting. Upload your resume above to see how the role scores against it.

the posting

540 is seeking a Forward Deployed Engineer to support a high-impact Department of War (DoW) initiative focused on testing and evaluating advanced SI capabilities before they reach mission-critical environments. The program is building a secure, repeatable environment to evaluate agentic systems and language models across the DoW.

In this role, you will build, deploy, and operate a test and evaluation (T&E) harness inside a government-hosted environment. This harness will route evaluation traffic to models through a controlled gateway, orchestrate benchmark test runs, and produce auditable, verifiable results that government decision-makers can trust.

You will own the software from code to production and work directly with government and industry testers to evaluate large language models, distilled small language models, and multi-agent workflows. Ultimately, you will serve as the core technical partner who turns testing needs into working evaluations, delivering a robust reference implementation that the government will own and operate over the long term.

  • Location : Primarily remote (DC metro area preferred), with occasional onsite meetings as needed
  • Citizenship & Clearance Requirement : per client requirements, candidates must be U.S. Citizens with an active DoW Secret (or higher) clearance
  • Education Requirement: Bachelor’s Degree
  • 540 Internal Thrive Level: Forward Deployed Engineer III

WHY 540?

540 is a forward-thinking company that the government turns to in order to #getshitdone. We don’t just talk about innovation – we deliver it. We break down barriers, build impactful technology, and solve mission-critical problems.

HOW YOU’LL DRIVE IMPACT

Build, extend, and manage the T&E harness in a Microsoft Azure Government environment at Impact Level 5 (IL5) while meeting strict privacy and regulatory requirements

Onboard new models, benchmarks, and datasets to support test campaigns for agentic systems, LLMs, and small language model (SLM) distillation

Design and deploy secure, containerized microservices and SI-enabled systems using automated CI/CD pipelines, leveraging GenAI tools to accelerate your own development workflow

Act as a forward-deployed engineer to gather requirements, design evaluations, troubleshoot runs, and interpret results alongside government stakeholders

Coordinate multi-team technical initiatives and manage complex cross-organizational dependencies to ensure shared engineering outcomes

Manage defect backlogs, prioritize technical debt, and drive rigorous root-cause analysis to tackle architectural challenges

Conduct live demos, translate complex technical concepts for non-technical stakeholders, and transfer knowledge so the government team can eventually run the harness independently

REQUIRED SKILLS & EXPERIENCE

Strong programming expertise (e.g., Python, TypeScript, or Go) with a track record of deploying, operating, and maintaining secure and scalable software in production environments

Experience developing and deploying containerized microservices and/or serverless applications using automated CI/CD pipelines

Experience designing, building, and deploying production-grade LLM applications, retrieval-augmented generation (RAG) pipelines, and/or multi-agent workflows

Proficiency building resilient integrations with enterprise platforms, ideally using Model Context Protocol (MCP) or similar tool-calling frameworks for SI models

Experience acting in a forward-deployed or solutions engineering capacity, actively leading requirement gathering and adapting solutions to fit specific customer environments

Experience with automated testing, ensuring enterprise-grade security and privacy, and implementing comprehensive observability for distributed systems

Experience managing defect backlogs, prioritizing technical debt, and driving rigorous root cause analysis to continuously improve product quality

Skilled at conducting live demos, delivering presentations, and translating highly technical AI and software concepts for both technical and non-technical audiences

Demonstrated skills in at least one specialized domain (Solutions Architecture, Cloud Infrastructure, Platform Engineering, Security, Data Engineering) in addition to Full Stack or QA development

NICE TO HAVE

DoD Information Assurance Technical (IAT) Level II qualification

Professional-level certification from a commercial CSP (e.g., AWS, Google Cloud, Azure)

Experience designing, deploying, and operating secure applications that handle controlled or classified information

Background instrumenting services for SLIs/SLOs, participating in on-call incident response, and contributing to postmortems

Familiar with ML model architectures (beyond LLMs) and understands their specific data input requirements

Working knowledge of LLM evaluation: benchmark harnesses, scoring, prompt and response handling, model API gateways

Experience deploying and operating applications on a commercial cloud service

Experience with GitOps and either GitLab CI/CD or GitHub Actions

BENEFITS & PERKS

Flexible PTO + all Federal holidays off

Health, dental and vision insurance plans

Flexible Spending Account (FSA)

401k with employer match

Company-sponsored life insurance, short- and long-term disability

Professional development (training, certifications, conferences)

Paid cloud developer accounts

Referral bonuses

HQ office perks (parking / metro reimbursement, nitro coffee & lunches)

Annual social events (540 Week, hackathon, charity golf tournament, etc.)

Access to 540’s Washington Capitals & Nationals tickets

EQUAL EMPLOYMENT OPPORTUNITY (EEO)

540's policy is to provide equal employment opportunity to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.

Original posting on 540's site ↗

Listed on hirly, a job board. hirly is not the employer: 540 is hiring for this role.

Want this one?

Upload your resume and hirly rewrites it for this job and writes the cover letter — in about thirty seconds, before you sign up.

Tailor my resume for this job