Senior AI Software Engineer

At Accenture Federal Services, nothing matters more than helping the US federal government make the nation stronger and safer and life better for people. Our 13,000+ people are united in a shared purpose to pursue the limitless potential of technology and ingenuity for clients across defense, national security, public safety, civilian, and military health organizations.

Join Accenture Federal Services, a technology company within global Accenture. Recognized as a Glassdoor Top 100 Best Place to Work, we offer a collaborative and caring community where you feel like you belong and are empowered to grow, learn and thrive through hands-on experience, certifications, industry training and more.

Join us to drive positive, lasting change that moves missions and the government forward!

Job Description:

We are looking for a Senior AI / Software Platform Engineer to help drive the integration of AI-assisted development workflows into a large-scale enterprise Linux environment.

This role is focused on practical AI application within software engineering, including code intelligence, developer tooling, requirements-driven development, and AI-assisted modernization of a large legacy codebase consisting primarily of C/C++ with additional modern languages and frameworks.

The ideal candidate is a strong software engineer first, with hands-on experience integrating and operationalizing modern AI/LLM technologies within real-world development environments.

Environment:

Large enterprise software platform (~6M+ LOC)

Primarily C/C++

Red Hat Enterprise Linux environment

GitLab-based development workflows

GPU-enabled internal AI infrastructure

Complex legacy and modern hybrid systems

Responsibilities:

Design, develop, and deploy scalable AI/ML and LLM-powered applications in production environments

Build and optimize high-performance inference pipelines using technologies such as vLLM and modern GPU-serving frameworks

Develop agentic AI workflows leveraging orchestration frameworks, tool calling, and retrieval-augmented generation (RAG)

Integrate LLMs, vector databases, APIs, and enterprise systems into production applications

Collaborate with software engineers, AI researchers, and platform teams to productionize AI prototypes and services

Improve model performance, throughput, latency, scalability, and operational efficiency

Implement monitoring, observability, evaluation, and testing frameworks for AI systems

Develop APIs, backend services, and automation workflows supporting AI-driven products

Evaluate emerging AI technologies, frameworks, and developer tooling including Open Code, OpenwebUI, Claude Code and modern AI coding assistants

Contribute to AI platform architecture, deployment standards, and engineering best practices

Required Skills:

4 years of software development with experience in any of the following:

Strong Linux experience (Red Hat / Enterprise Linux required)

Experience with LLMs, RAG systems, embeddings, or AI-assisted tooling

Advanced C/C++ experience

Experience with GitLab workflows and CI/CD

Strong Python development experience

Experience with APIs, backend systems, and automation

Strong understanding of software architecture and large-scale systems

Preferred Skills:

GPU infrastructure experience

Experience deploying or operating local/open-source models

Experience with vector databases and semantic search

Experience with developer tooling or IDE integrations

Experience with AI evaluation/testing frameworks

Experience with secure/offline AI environments

Familiarity with code indexing and static analysis systems

Ability to work independently and drive technical initiatives

Strong debugging and problem-solving skills

Experience working with legacy systems and modernization efforts

Clearance:

Must have an active secret federal security clearance

As required by local law, Accenture Federal Services provides reasonable ranges of compensation for hired roles based on labor costs in the states of California, Colorado, Hawaii, Illinois, Maine, Maryland, Massachusetts, Minnesota, New Jersey, New York, Vermont, Virginia, Washington, and the District of Columbia, and the city of Cleveland . The base pay range for this position in these locations is shown below. Compensation for roles at Accenture Federal Services varies depending on a wide array of factors, including but not limited to office location, role, skill set, and level of experience. Accenture Federal Services offers a wide variety of benefits. You can find more information on benefits here. We accept applications on an on-going basis and there is no fixed deadline to apply.

The pay range for the states of California, Colorado, Hawaii, Illinois, Maine, Maryland, Massachusetts, Minnesota, New Jersey, New York, Vermont, Virginia, Washington, and the District of Columbia, and the city of Cleveland is:

$115,300 — $160,100 USD

What We Believe

As a company wholly dedicated to serving the US federal government, we bring together the best talent to help reinvent how federal agencies operate and deliver greater value for their mission and the American people. We have an unwavering commitment to creating a culture in which all our people are respected, feel a sense of belonging, and have equal opportunity. As a business imperative, every person at Accenture Federal Services has the responsibility to create and sustain a culture where everyone feels welcomed and included. This is grounded in our core values and our experience that hiring and developing great people who reflect different perspectives, experiences, and backgrounds is key to driving innovation and delivering the results that our clients and the country count on.

Equal Employment Opportunity Statement

We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities. For details, view a copy of the Accenture Federal Services Equal Opportunity Policy Statement.

Accenture Federal Services is an Equal Employment Opportunity employer. Additionally, as an Affirmative Action Employer for Veterans and Individuals with Disabilities, Accenture Federal Services is committed to providing veteran employment opportunities to our service men and women.

Requesting An Accommodation

Accenture Federal Services is committed to providing equal employment opportunities for persons with disabilities or religious observances, including reasonable accommodation when needed. If you are hired by Accenture Federal Services and require accommodation to perform the essential functions of your role, you will be asked to participate in our reasonable accommodation process. Accommodations made to facilitate the recruiting process are not a guarantee of future or continued accommodations once hired.

If you are being considered for employment opportunities with Accenture Federal Services and need an accommodation for a disability or religious observance during the interview process or for the job you are interviewing for, please speak with your recruiter.

Other Employment Statements

Applicants for employment in the US must have work authorization that does not now or in the future require sponsorship of a visa for employment authorization in the United States.

Candidates who are currently employed by a client of Accenture Federal Services or an affiliated Accenture business may not be eligible for consideration.

Job candidates will not be obligated to disclose