Architecting AI-Powered Cloud Systems on AWS - Full Day
As AI rapidly transforms how businesses operate, the cloud must evolve to support AI-first workloads—from large language model (LLM) inference to real-time personalization and intelligent automation. This talk delivers a hands-on deep dive into modern AWS architecture patterns for building secure, resilient, and cost-effective systems that power AI-driven applications at scale.
Attendees will explore the convergence of AI/ML, serverless, data lakes, edge computing, and cloud-native microservices on AWS. They'll learn how to design solutions that balance performance and cost, meet enterprise security expectations, and scale dynamically across use cases such as generative AI, predictive analytics, AI agents, and recommendation engines.
Audience
This talk is ideal for:
Cloud Architects and Technical Leads designing AI workloads
Platform Engineers and DevOps teams building scalable ML and LLM infrastructure
AI/ML Engineers and Data Scientists deploying models to AWS production environments
SaaS Product Engineers developing intelligent features for customers
Key Takeaways
Participants will learn:
Proven AWS patterns for serving GenAI and ML workloads
How to architect multi-tier AI applications using Lambda, Bedrock, ECS/EKS, and SageMaker
AI-specific security, governance, and cost strategies
How to optimize compute, storage, and data flow for real-time inference and high throughput
Patterns to make APIs and pipelines consumable by AI agents
Tools to monitor, scale, and secure AI-powered systems
About Rohit Bhardwaj
Rohit Bhardwaj is a Director of AI & Data Architecture at Salesforce, where he focuses on enterprise AI, agentic systems, cloud-native architecture, distributed systems, data platforms, security, and large-scale transformation.
Over his career, Rohit has designed and led complex enterprise platforms across AWS, Google Cloud, microservices, real-time data, API ecosystems, resilient distributed systems, and AI-enabled architectures. His work increasingly focuses on the challenges enterprises face as software evolves from deterministic services to AI-native and agentic systems—particularly around reliability, governance, evidence, security, observability, cost, and safe autonomy.
Rohit is the author of System Design with AI Interview Guide: Designing Scalable, Agentic, and Defensible Systems, published by Apress. The book presents a modern approach to system design covering scalability, distributed systems, AI architecture primitives, security, reliability, economics, agentic systems, and real-world architectures including e-commerce, ride sharing, payments, fraud detection, messaging, video streaming, file storage, and search. (Springer Link)
Book:
Amazon: https://a.co/d/09Zs1twa
Publisher / Springer Nature: https://link.springer.com/book/10.1007/979-8-8688-2782-2
O'Reilly: https://learning.oreilly.com/library/view/system-design-with/9798868827822/
Rohit is also an O’Reilly instructor and a frequent speaker at technology conferences including No Fluff Just Stuff, UberConf, GIDS, and other international events. His talks focus on practical architecture lessons from building and operating complex systems, including AI control planes, trusted agents, inference at scale, evidence-first RAG, AI security, distributed-system failure, and AI-era software architecture.
As a trusted advisor and architecture leader, Rohit works at the intersection of business strategy and deep technical architecture—helping teams translate complex business problems into scalable, resilient, secure, and economically sustainable systems.
Rohit holds an MBA in Corporate Entrepreneurship from Babson College and graduate-level education in Computer Science from Boston University and Harvard University.
Connect with Rohit:
LinkedIn: http://linkedin.com/in/rohit-bhardwaj-cloud
X / Twitter: @rbhardwaj1