GenAI Solutions Architect

Location: Bengaluru

Experience: 8 years+

Type: Full-time

About Us

Lyzr is building cutting-edge AI-powered platforms that simplify the creation, deployment, and scaling of intelligent systems. We’re now expanding our GenAI capabilities and looking for a GenAI Solutions Architect to design agentic architectures and drive end-to-end solutioning for enterprise and product use cases.

Role Overview

We’re seeking a GenAI Solutions Architect who can design and own the architecture for LLM- and agent-based solutions - from problem framing and system design to implementation and go-live. You’ll work closely with product, customers, and engineering teams to define agentic workflows, select the right models and infrastructure, and ensure our GenAI solutions are reliable, safe, and scalable in production.

What You’ll Do

Design end-to-end GenAI and agentic architectures (multi-agent workflows, tools, memory, RAG pipelines) for product and enterprise use cases

Translate business problems into GenAI solution blueprints, including model selection, orchestration, data flows, and integration points

Define standards and best practices for prompt design, tool-calling, context management, and long-running workflows

Architect retrieval and knowledge pipelines (RAG, vector stores, embeddings, indexing strategies)

Evaluate and recommend LLMs/model providers (OpenAI, Azure OpenAI, AWS Bedrock, open-source models, etc.) based on use case, cost, and constraints

Establish evaluation strategies for GenAI solutions (offline/online evals, guardrails, safety checks, quality metrics, human-in-the-loop feedback)

Work with engineering to implement agent-based systems using Lyzr’s platform and modern backend stacks (Python preferred)

Define APIs, contracts, and integration patterns between agents, microservices, and external systems

Drive non-functional requirements for GenAI systems: latency, scalability, observability, cost optimization, and resilience

Partner with product managers and customers to shape requirements and define solution scope, risks, and trade-offs

Prepare architecture diagrams, decision records, and technical documentation for internal and external stakeholders

Ensure solutions comply with security, privacy, and compliance requirements for AI systems (data handling, PII, access control)

Define monitoring and observability strategies for GenAI agents (logging, tracing, hallucination detection, drift monitoring)

Continuously refine architectures based on production feedback, performance data, and new GenAI capabilities

What We’re Looking For

6+ years of experience in software/solution architecture or backend engineering, with at least 1–2 years hands-on with LLM/GenAI systems

Practical experience designing and delivering GenAI solutions (e.g., RAG systems, chat/agents, document copilots, workflow automation)

Solid understanding of:

LLMs, embeddings, prompt engineering, and tool-calling

Vector databases (Qdrant, Weaviate, Chroma, PGVector) and retrieval patterns

System design and API architecture

Experience with at least one major cloud (AWS required; Azure or GCP is a plus)

Ability to balance experimentation with production rigor (cost, performance, reliability, safety)

Strong ownership, product mindset, and comfort working directly with customers and cross-functional teams

Excellent communication skills to simplify complex GenAI concepts for technical and non-technical stakeholders

Nice to Have

Experience working in fast-paced startup environments

Exposure to AI/ML product ecosystems