hirly

Roche

AI Solution Architect

Shanghai

hirly Pro

Get in front of the people hiring at Roche

  • Reach the hiring manager at Roche on LinkedIn, from your own account
  • hirly applies to this job for you, with unlimited applications
  • A resume and cover letter written for this job, unlimited
  • The hiring manager and recruiter at Roche, with contact details
Get Pro for this job →

$49 a month · ₹1,999 for 30 days in India · cancel any time

See how you match this job — and similar ones. Free.

Upload your resume and hirly scores it against this role at Roche first, then against similar open jobs, and shows where you fit and why.

PDF or DOCX, up to 12MB. No sign-up to see your matches.

Get past the screening software and onto a recruiter's desk

hirly rewrites your resume for this job — matching the keywords and skills in the posting, moving your most relevant experience to the top, and writing a cover letter to fit. About 30 seconds.

  • Keywords matched to this posting
  • Fit score before you apply
  • Cover letter included

Matched against 2.8M live jobs from 220,000+ employers in 200+ countries.

Tailor my resume for this job →

Apply from your AI assistant

Connect hirly to Claude or ChatGPT and ask it to apply to this job. hirly tailors your resume, fills the employer’s form and asks before sending.

Some employer sites stop an application at a CAPTCHA or sign-in and hand it back with a link. Applying needs a paid plan. Works with any assistant that supports MCP.

hirly's read of this role

Seniority
Mid level
Country
CN
Work mode
On-site / unstated
First seen by hirly
20 Sept 2026

Derived automatically from the posting. Upload your resume above to see how the role scores against it.

the posting

At Roche you can show up as yourself, embraced for the unique qualities you bring. Our culture encourages personal expression, open dialogue, and genuine connections, where you are valued, accepted and respected for who you are, allowing you to thrive both personally and professionally. This is how we aim to prevent, stop and cure diseases and ensure everyone has access to healthcare today and for generations to come. Join Roche, where every voice matters.

The Position

As a key driver of technological innovation, you will leverage cutting-edge AI technologies and advanced architectures to deliver strategic business value for Roche China. You will lead the end-to-end design, development, iterative enhancement, and ecosystem integration of the AI infrastructure, platform, and application adoption layers, ensuring all systems strictly adhere to enterprise security and compliance standards.

We are seeking a visionary architect who combines enterprise-level system design, platform engineering methodologies, and agile delivery with profound AI expertise. Your ultimate mission is to translate state-of-the-art AI capabilities into transformative, real-world healthcare solutions. In this role, you will be responsible for:

AI Platform Layer Design, Development, and Management

  • Kubernetes Cluster Management: Lead the deployment, administration, and full lifecycle management of Kubernetes clusters, including node scaling, upgrades/rollbacks, certificate rotation, RBAC administration, and cluster teardowns. Develop robust automation code for cluster operations and drive federated cluster management initiatives.
  • MLOps Platform Engineering: Architect, build, and manage MLOps platforms using open-source (e.g., Kubeflow, MLFlow) or commercial (Dataiku, Databricks) frameworks. Oversee the ML lifecycle by integrating core components (WebIDE, FeatureStore, ModelRegistry, AutoML, Pipelines, Model Serving) and implementing metrics for CMCT and Drift Detection.
  • LLMOps Architecture: Design and develop platforms to support the Large Language Model (LLM) lifecycle. Integrate critical LLMOps components (Data Assets, Model Cards, SFT, OpenAI-Compatible Inference) and operationalize mainstream fine-tuning and inference frameworks (DeepSpeed, TorchTune, vLLM, SGLang).
  • AI Gateway & Governance: Design and implement enterprise-level AI gateways and integration platforms. Establish governance frameworks (FinOps, Guardrails, MAAS PrivateLink) and integrate with domestic and international MAAS ecosystems (GCP Vertex AI, AWS Bedrock, Azure OpenAI, Ali DashScope).
  • Familiarity with at least one major large-scale model training framework (e.g., Megatron-LM or MindSpore).
  • Expertise in Ray for both distributed training and inference pipelines.
  • Strong understanding of cross-node/multi-node scaling and distributed systems, essential for supporting next-generation Large Language Models (LLMs).

AI Application Layer Design, Development, and Management

  • AI & Agentic Application Development: Architect, design, and develop highly scalable AI and Agentic applications, leveraging mainstream frameworks such as LangChain and LangGraph.
  • System Integration: Integrate applications across advanced platform tools (Kubernetes, Slurm, MLOps, LLMOps, AI Gateway) and diverse data ecosystems (S3, RDBMS, VectorDB, GraphDB).
  • Microservices Architecture & DDD: Drive Domain-Driven Design (DDD) to decompose APIs based on complex business requirements, defining clear service boundaries, contracts, and data models.
  • Team Leadership & Delivery: Organize, lead, and mentor engineering teams to successfully deliver multi-format services, including APIs, WebUIs, SDKs, CLIs, and APPs.
  • Engineering Excellence: Establish and enforce rigorous coding standards, comprehensive unit/integration testing protocols, and robust code review processes.
  • Backend System Design: Design and optimize backend systems utilizing diverse API standards (REST, gRPC, GraphQL), database technologies (SQL, NoSQL), messaging systems (Kafka, RabbitMQ), and caching mechanisms.
  • Architectural Strategy: Evaluate and implement appropriate architectural patterns (such as Event-Driven, CQRS, DDD, and Serverless) by conducting thorough trade-off analyses based on project needs.
  • End-to-End Execution: Oversee the full lifecycle of AI software development, ensuring successful implementation and maintaining a track record of high-quality product delivery.

Platform Engineering, SRE, and Enterprise Integration

  • Cloud-Native & Reusability Engineering: Drive platform hardening and component reusability engineering by leveraging mainstream CNCF projects (Prometheus, Grafana, OpenTelemetry, Ray, ELK, Kubeflow).
  • Observability & FinOps: Design and integrate comprehensive observability solutions (Metrics, Logs, Tracing) and alerting systems to ensure transparent monitoring of application performance, usage, and FinOps costs.
  • Non-Functional Requirements Assurance: Ensure all architectures strictly adhere to enterprise standards for high availability (HA), disaster recovery/rollback, security compliance, and component reusability.
  • Enterprise Integration: Execute seamless integrations with the wider enterprise IT ecosystem, including SSO, LDAP, Git repositories, Artifact repositories, Cloud Landing Zones, Cloudflare, and AI Gateways.

AI Infrastructure Layer Design, Development, and Management

  • Hardware & Storage Strategy: Evaluate, benchmark, and select AI infrastructure hardware (GPU and high-performance CPU bare metal servers), storage solutions (NAS, SAN), and coordinate physical data center requirements (power distribution, air/liquid cooling).
  • Network Planning & Optimization: Architect network topologies and subnets, managing out-of-band networks, business networks, and high-performance RDMA passthrough networks (InfiniBand, RoCEv2). Deploy centralized and automated monitoring for all network equipment.
  • OS & Toolchain Hardening: Administer Linux distributions and design automated security hardening protocols for large-scale server clusters. Manage supercomputing drivers and complete toolchains (Ansible, Packer, NVIDIA full-stack, RDMA full-stack, storage drivers, containerization).
  • Cloud Infrastructure Automation: Manage enterprise-level private cloud environments, ensuring robust IAM, data center direct-connect, cloud service security, and data encryption. Drive Infrastructure as Code (IaC) automation utilizing Terraform, CloudFormation, and CLI tools.
  • Privileged Access Management: Configure, manage, and maintain enterprise-level bastion hosts and oversee super-user access controls.

Demand Management, Process Design, and Agile Development

  • Project & Delivery Management: Drive large-scale, role-based project execution applying standard Project Management Methodologies (PMM), ensuring alignment with pharmaceutical industry compliance standards.
  • Agile Leadership: Champion Agile and Scrum methodologies. Perform WBS decomposition, manage project backlogs in Jira, and coordinate cross-team delivery through CI/CD pipelines (GitLab/GitHub, JFrog Artifactory).
  • Governance & Process Design: Collaborate on the design and implementation of product-related operational processes (user training/certification, workspace/model/data asset lifecycle management, system disclaimers) to guarantee system safety and compliance.

Collaborations

  • Project Documentation: Author and finalize critical architectural documents, including Solution Architectures, LLM specifications, and Installation Validation protocols.
  • Knowledge Base Maintenance: Create, update, and govern comprehensive technical documentation across platforms like GitLab MD, Confluence, and GitLab Pages, including drafting detailed process design documents.
  • Cross-Functional Team Leadership: Facilitate highly efficient collaboration across global and local cross-functional teams, ensuring seamless communication in both fluent Chinese and English.
  • Mentorship: Providing ar
Original posting on Roche's site ↗

Listed on hirly, a job board. hirly is not the employer: Roche is hiring for this role.

Browse similar roles

Want this one?

Upload your resume and hirly rewrites it for this job and writes the cover letter — in about thirty seconds, before you sign up.

Tailor my resume for this job