hirly

CACI

QA / Test Automation Engineer

Remote (Any State)

See how you match this job — and similar ones. Free.

Upload your resume and hirly scores it against this role at CACI first, then against similar open jobs, and shows where you fit and why.

PDF or DOCX, up to 12MB. No sign-up to see your matches.

Get past the screening software and onto a recruiter's desk

hirly rewrites your resume for this job — matching the keywords and skills in the posting, moving your most relevant experience to the top, and writing a cover letter to fit. About 30 seconds.

  • Keywords matched to this posting
  • Fit score before you apply
  • Cover letter included

Matched against 2.4M live jobs from 200,000+ employers in 200+ countries.

Tailor my resume for this job →

Apply from your AI assistant

Connect hirly to Claude and ask it to apply to this job. hirly tailors your resume, fills the employer’s form and asks before sending. ChatGPT: manual setup today.

Some employer sites stop an application at a CAPTCHA or sign-in and hand it back with a link. Applying needs a paid plan. Works with any assistant that supports MCP.

hirly's read of this role

Seniority
Mid level
Country
US
Work mode
Remote-friendly
First seen by hirly
27 Sept 2026

Derived automatically from the posting. Upload your resume above to see how the role scores against it.

the posting

Job Title: QA / Test Automation Engineer

Job Category: Engineering

Time Type: Full time

Minimum Clearance Required to Start: Public Trust

Employee Type: Regular

Percentage of Travel Required: Up to 10%

Type of Travel: Local

* * *

  • The Opportunity:
  • CACI is seeking a Mid-Level QA / Test Automation Engineer to support an agile software modernization program by planning, executing, and documenting manual and automated testing of Java-based applications hosted in Amazon Web Services (AWS). Working with moderate independence, this role validates application functionality, APIs, integrations, databases, data exchanges, and legacy-system interfaces; develops and maintains automated regression tests using industry-standard test automation tools; and collaborates with cross-functional teams to confirm that releases meet business, technical, security, accessibility, and operational requirements.
  • Responsibilities:
  • In this role, the candidate will have practical experience testing Java applications in AWS and hands-on experience using automated testing tools to support a large-scale Grant Solutions platform modernization effort. The tester will independently complete assigned testing activities, identify and communicate quality risks, and help ensure that cloud-hosted capabilities are reliable, secure, accessible, data-consistent, and ready for release.

The tester will translate user stories and acceptance criteria into test scenarios; execute end-to-end, integration, API, database, and regression testing across AWS environments; log and retest defects; prepare test data and evidence; and build reusable automated tests for stable, repeatable scenarios. The role contributes to—but is not expected to architect—the program’s automation framework, AWS-based CI/CD quality gates, test processes, and release-readiness reporting.

Review user stories, acceptance criteria, Java application designs, API specifications, data mappings, and AWS environment documentation to identify test conditions and expected results.

Create, execute, and maintain manual test cases for functional, system, regression, smoke, integration, API, database, data validation, and user acceptance testing.

Develop, enhance, and maintain automated test scripts, reusable components, test data, locators, and regression suites using appropriate automated testing tools.

Use automated testing tools to test web user interfaces, REST or SOAP APIs, databases, and end-to-end business processes, as applicable.

Execute automated tests across AWS-hosted test environments; analyze results, logs, screenshots, and execution evidence; troubleshoot failures; and maintain tests as the Java applications evolve.

Test Java-based application components and their interactions with AWS services, APIs, databases, authentication services, data exchanges, legacy systems, workflows, reports, and downstream systems.

Validate application behavior across AWS environments and use available application, cloud, and pipeline logs to support defect isolation and root-cause analysis.

Prepare and manage test data, capture test evidence, maintain requirements traceability, and document testing outcomes.

Log defects with clear reproduction steps, expected and actual results, severity, AWS environment details, and supporting evidence; participate in defect triage and verify fixes.

Collaborate with Java developers, Product Owners, Scrum Masters, AWS and DevSecOps engineers, integration and data teams, security specialists, vendors, and business stakeholders throughout the sprint and release lifecycle.

Support automated test execution in CI/CD pipelines, scheduled regression runs, and release validation; investigate failures and improve test reliability with senior QA and DevSecOps staff.

Contribute to test estimates, sprint planning, test coverage reviews, release-readiness assessments, quality metrics, and continuous improvement of AWS and automated testing practices.

Qualifications:

Required:

Must be able to obtain and maintain a Federal Public Trust; candidates must receive approved adjudication before onboarding. Candidates with an active Public Trust or suitability determination are preferred.

Bachelor’s degree required.

Four (4) years of experience in software quality assurance, application testing, system testing, or a related technical role.

Hands-on experience testing Java-based web applications, services, APIs, integrations, and data flows.

Hands-on experience developing, maintaining, executing, and troubleshooting automated tests using one or more automated testing tools or frameworks.

Experience creating reusable automated test components, managing test data and locators, applying validations, and interpreting automated test results.

Experience testing applications deployed in AWS environments and working with cloud-hosted application components, APIs, databases, logs, and multiple test environments.

Hands-on experience creating and executing functional, system, regression, integration, API, smoke, database, data validation, and user acceptance tests.

Experience with defect tracking, test management, requirements traceability, test evidence, test data preparation, and defect retesting.

Working knowledge of the software development lifecycle, agile delivery, DevSecOps concepts, version control, AWS-based CI/CD pipelines, and release management.

Ability to interpret Java application behavior, user stories, acceptance criteria, business rules, API contracts, data mappings, and technical design documentation.

Ability to troubleshoot test failures, analyze automated test execution results and application or AWS logs, isolate defects, and clearly communicate findings and quality risks.

Strong documentation, analytical, collaboration, and communication skills.

Ability to manage assigned testing responsibilities with moderate supervision in a fast-paced environment with competing priorities and release timelines.

Desired:

Experience supporting Java application or platform modernization in an enterprise or government environment.

Experience using Subject7 for web, REST or SOAP API, database, reusable-component, data-driven, scheduled, parallel, or CI/CD-integrated test automation.

Familiarity with common AWS services used by Java applications, such as Amazon EC2, Amazon S3, Amazon RDS, AWS Lambda, Amazon CloudWatch, or related services.

Ability to read basic Java, SQL, JSON, XML, and application logs to support testing and defect investigation.

Experience with Jira, Confluence, Git, Jenkins, AWS CodePipeline, Azure DevOps, or comparable delivery and test-management tools.

Exposure to Section 508 accessibility requirements and automated or manual accessibility testing practices.

Familiarity with containerized Java applications, security testing, performance testing, or AWS observability tools.

ISTQB, Subject7, AWS, agile, testing, automation, cloud, or security certification.

-

What You Can Expect:

A culture of integrity.

At CACI, we place character and innovation at the center of everything we do. As a valued team member, you’ll be part of a high-performing group dedicated to our customer’s missions and driven by a higher purpose – to ensure the safety of our nation.

An environment of trust.

CACI values the unique contributions that every employee brings to our company and our customers - every day. You’ll have the autonomy to take the time you need through a unique flexible time off benefit and have access to robust learning resources to make your ambitions a reality.

A focus on continuous growth.

Together, we will advance our nation's most critical missions, build on our lengthy track record of business success, and find opportunities to break new ground — in your career and in our legacy.

Pay Range :

There are a host of factors that can influence final salary including, but not limited to, geographic location, Fede

Original posting on CACI's site ↗

Browse similar roles

Want this one?

Upload your resume and hirly rewrites it for this job and writes the cover letter — in about thirty seconds, before you sign up.

Tailor my resume for this job
QA / Test Automation Engineer – CACI | hirly.me