Agentic AI Software Engineer

We are looking for a skilled and motivated Consultant to join our team. The ideal candidate combines strong software engineering expertise with hands-on experience in modern AI systems, including agentic AI and generative AI applications. You will support our clients in designing and building intelligent, production-ready systems that leverage LLMs, autonomous agents, and scalable cloud architectures.

Responsibilities:

· Design, build, and deploy scalable, production-grade systems on cloud platforms such as AWS, GCP, or Azure.

· Develop and operate agentic AI systems, including multi-step workflows, tool integration, and autonomous decision-making components.

· Lead end-to-end implementation of AI-driven features, from prototyping (PoC) to production deployment.

· Build high-performance APIs and backend services for AI applications using frameworks such as FastAPI, Flask, or Spring Boot.

· Integrate generative AI solutions (LLMs, vector databases, RAG pipelines, orchestration frameworks like LangChain/LangGraph) into enterprise environments.

· Design and implement robust orchestration and retrieval pipelines for scalable AI applications.

· Set up and maintain MLOps / LLMOps pipelines and CI/CD workflows for continuous integration, evaluation, and deployment.

· Ensure software quality through testing, monitoring, observability, and performance optimization.

· Collaborate closely with clients and cross-functional teams to identify requirements and deliver impactful AI solutions.

What we offer you:

· Work on innovative AI and Software Engineering projects across industries (Banking, Insurance, Automotive, Retail, etc.).

· Expand your skills in areas such as MLOps, cloud architecture, data engineering, and generative AI.

· Collaborate with top technology partners in the cloud, AI, and automation ecosystem.

· Access to training, certifications, and interdisciplinary projects.

· Join a vibrant community with hackathons, conferences, and knowledge-sharing events.

· Award-winning office space in downtown Munich with great transport connections.

· Flexible working model between client site, Reply office, and remote work.

Deutschlandticket for public

Job requirements

Minimum Qualifications:

· Completed university studies with a strong quantitative or technical background (e.g., Computer Science, Data Science, Engineering, or similar).

· Ideally, you have already gained some initial consulting and project management experience Teamwork & Collaboration – ability to work effectively with others toward common objectives.

· Adaptability – flexibility in taking on different roles within a team and understand the need of the costumer

· Solid programming experience in at least two programming languages such as Python, Java, Rust, or JavaScript.

· Practical experience deploying ML/AI models into production environments (on-premises or cloud).

· Experience with different database technologies, including SQL and NoSQL, with knowledge of database design, data modeling, and data management.

· Experience with large language models (LLMs), prompt engineering, fine-tuning, and integrating generative AI into actual solutions.

· Strong communication skills for explaining technical concepts to both technical and business stakeholders.

· Fluent in English and at least C1-level German. This requirement is mandatory.

Desired Qualifications:

· Hands-on experience with cloud AI services.

· Understanding of MLOps concepts (model registry, monitoring, CI/CD).

· Knowledge of modern AI/ML frameworks and tools such as PyTorch, TensorFlow, Hugging Face, LangChain, or OpenAI APIs.

· Awareness of software engineering principles (SOLID, testing, version control).

· Familiarity with containerization and orchestration (Docker, Kubernetes).

· Cloud certifications are a plus.

· Teamwork & Collaboration – ability to work effectively with others toward common objectives.

· Adaptability – flexibility in taking on different roles within a team and understand the need of the costumer

What are you waiting for?

Join our team at Machine Learning Reply as a Consultant for Software Engineering and AI in Munich or Berlin!

Find more English Speaking Jobs in Germany on Arbeitnow