Rashid Reyaz Khan
Hyderabad · UTC+5:30 Open to work Tokyo-bound · HSP eligible

Senior AI Platform Engineer I build the infrastructure
behind production AI.

7+ years engineering the systems other teams build on — RAG pipelines, multi-agent platforms, LLM evaluation, and the cloud automation that keeps AI workloads observable and reliable.

Book a 1:1 → See the work
node/01About

I work one layer beneath the AI features people see — on the platform that makes them dependable in production.

Most of my career has been about reliability at scale: provisioning secure, observable infrastructure, automating the path from commit to deploy, and giving internal teams paved roads instead of one-off scripts. Over the last few years that's meant GenAI specifically — standing up RAG systems, orchestrating multi-agent workflows, and building the evaluation and telemetry layers that tell you whether a model is actually behaving.

I've done this across ServiceNow and Oracle, with earlier stints at EXL and TCS that grounded me in high-volume data systems and infrastructure automation. I'm now studying generative and agentic AI at IIT Kharagpur, learning Japanese, and planning a move to Tokyo.

Role
Sr. AI Platform Engineer
Experience
7+ years
Focus
GenAI infra · MAS · Evals
Cloud
AWS · K8s · Terraform
Based in
Hyderabad, India
Relocation
Tokyo · HSP eligible
Languages
EN · JP N5

Agent Platforms

Multi-agent systems and orchestration (LangChain, LlamaIndex, MCP) for autonomous, distributed task execution.

RAG Systems

Production retrieval pipelines with vector stores and secure model gateways — Bedrock, Azure OpenAI.

LLM Evaluation

Automated eval frameworks and observability that track model quality, regressions, and agent metrics before rollout.

Cloud Automation

IaC with Terraform, Kubernetes, and CI/CD — reusable platform templates that make delivery fast and repeatable.

node/02Experience
Apr 2025 — Present
ServiceNow

Senior Software Engineer · AI Platform

Hyderabad, India
  • AI platform architecture. Architected collaborative multi-agent platforms and cloud-native GenAI infrastructure, letting internal teams run autonomous agents for distributed task execution.
  • Infrastructure automation. Built deployment automation and reusable platform templates for RAG systems and agentic workflows with Terraform and CI/CD, for fast, reliable delivery.
  • Observability & auto-evals. Designed custom LLM evaluation frameworks and wired in OpenTelemetry to track model quality, agent execution, and infra reliability.
  • Cloud integrations & security. Tuned multi-model prompt strategies across secure gateways — AWS Bedrock, Azure OpenAI — with strict data governance.
Jan 2024 — Apr 2025
Oracle

Senior Software Engineer · IC3

Hyderabad, India
  • Enterprise platform engineering. Led infrastructure and high-throughput backend API orchestration for Oracle Redwood's core tier, with strict data isolation and security controls.
  • Event-driven pipelines. Built a data orchestration engine in Python + Kafka: +15% data-entry efficiency and −40% cross-border localization latency.
  • Sandbox & reliability. Engineered a secure sandbox compilation utility for multi-language components, cutting production errors 25%.
Jun 2022 — Jan 2024
EXL Service

Senior Software Engineer

Hyderabad, India
  • High-volume data processing. Led engineering for "EXL Vantage," serving 1,000+ data professionals at 99.9% uptime.
  • API orchestration. Integrated decoupled distributed services and built a reusable API-polling framework, +20% background-processing performance.
Dec 2018 — Jun 2022
Tata Consultancy Services

Software & Automation Engineer

Hyderabad, India
  • Data-center automation. Designed automated infrastructure tooling for Microsoft data-center operations, eliminating 70% of manual intervention.
  • System health & validation. Wrote maintenance scripts and health checks that reclaimed 700+ engineering hours monthly.
node/03Stack
Layer 01

AI Platform & GenAI

RAG SystemsMulti-Agent SystemsLangChain LlamaIndexVector StoresMCP Integrations LLM Auto-EvalsObservability
Layer 02

Cloud & Infrastructure

AWS BedrockECS / EKSLambdaS3 OpenSearchKubernetesTerraform GitHub ActionsDocker
Layer 03

Core & Backend

PythonGoJavaTypeScript Node.jsKafkaMicroservices REST APIsSQL
Layer 04

Observability & DevOps

PrometheusGrafanaOpenTelemetry Health MonitoringIncident MitigationTDD
node/04Recognition & Education
Award · ServiceNow

Llama Award

For outstanding technical contribution to launching production Generative AI solutions and platform tools.

Award · ServiceNow

Contextual Master Award

For self-healing automated utilities that minimized diagnostic friction across live clusters.

Education · 2026–

Exec PG · GenAI & Agentic AI

Indian Institute of Technology Kharagpur (IIT Kharagpur).

Education · 2014–2018

B.Tech

Kalinga Institute of Industrial Technology (KIIT).

node/05Book a 1:1

Let's talk AI platforms, infrastructure, or a role in Tokyo.

Tell me what you'd like to cover and I'll prep a focused 30 minutes. This composes an email — no account, no tracking. If a scheduler is configured, a booking button appears here automatically.

node/06Contact

Let's build AI that stays up in production.

✉ khanrashid11a@gmail.com ☎ +91 70771 02579 LinkedIn ↗ GitHub ↗