AWS Generative AI Architect
Generative AI on AWS is no longer just a model invocation problem. Production systems need retrieval, agents, tools, identity, guardrails, evals, observability, cost controls, deployment discipline, and human escalation.
This talk gives senior developers and architects a practical blueprint for becoming an AWS Generative AI Architect. We will explore how to design production-ready AI systems using Amazon Bedrock, Bedrock Knowledge Bases, Bedrock Agents, AgentCore, Guardrails, Evaluations, Lambda, API Gateway, Step Functions, EventBridge, OpenSearch, S3, DynamoDB, IAM, CloudWatch, and related AWS services.
The goal is not to memorize AWS service names. The goal is to learn how to design reliable, secure, measurable, cost-aware, and governable AI systems on AWS.
The hard part of AWS generative AI is no longer model access. The hard part is designing the system around the model: evidence, tools, identity, guardrails, evals, observability, cost, and safe action.
Learning outcomes
Participants will learn how to:
- Explain the architecture shift from model invocation to production AI systems.
- Design a production RAG architecture using Amazon Bedrock and AWS data services.
- Design safe agentic workflows using Bedrock Agents and AgentCore concepts.
- Apply guardrails to inference, agents, and knowledge-base workflows.
- Define evals for model quality, retrieval quality, groundedness, tool safety, and regression.
- Design observability for prompts, retrieval, tool calls, traces, latency, errors, and cost.
- Apply IAM, identity, secrets, data boundaries, and least privilege to AI systems.
- Control cost and latency through model selection, prompt design, caching, routing, quotas, and workflow design.
- Recognize anti-patterns in AWS generative AI architectures.
- Map production architecture skills to AWS Generative AI Developer – Professional readiness.
About Rohit Bhardwaj
Rohit Bhardwaj is a Director of AI & Data Architecture at Salesforce, where he focuses on enterprise AI, agentic systems, cloud-native architecture, distributed systems, data platforms, security, and large-scale transformation.
Over his career, Rohit has designed and led complex enterprise platforms across AWS, Google Cloud, microservices, real-time data, API ecosystems, resilient distributed systems, and AI-enabled architectures. His work increasingly focuses on the challenges enterprises face as software evolves from deterministic services to AI-native and agentic systems—particularly around reliability, governance, evidence, security, observability, cost, and safe autonomy.
Rohit is the author of System Design with AI Interview Guide: Designing Scalable, Agentic, and Defensible Systems, published by Apress. The book presents a modern approach to system design covering scalability, distributed systems, AI architecture primitives, security, reliability, economics, agentic systems, and real-world architectures including e-commerce, ride sharing, payments, fraud detection, messaging, video streaming, file storage, and search. (Springer Link)
Book:
Amazon: https://a.co/d/09Zs1twa
Publisher / Springer Nature: https://link.springer.com/book/10.1007/979-8-8688-2782-2
O'Reilly: https://learning.oreilly.com/library/view/system-design-with/9798868827822/
Rohit is also an O’Reilly instructor and a frequent speaker at technology conferences including No Fluff Just Stuff, UberConf, GIDS, and other international events. His talks focus on practical architecture lessons from building and operating complex systems, including AI control planes, trusted agents, inference at scale, evidence-first RAG, AI security, distributed-system failure, and AI-era software architecture.
As a trusted advisor and architecture leader, Rohit works at the intersection of business strategy and deep technical architecture—helping teams translate complex business problems into scalable, resilient, secure, and economically sustainable systems.
Rohit holds an MBA in Corporate Entrepreneurship from Babson College and graduate-level education in Computer Science from Boston University and Harvard University.
Connect with Rohit:
LinkedIn: http://linkedin.com/in/rohit-bhardwaj-cloud
X / Twitter: @rbhardwaj1