Next-Gen Software Architecture with Large Language Models(LLMs) like ChatGPT
This is a dynamic session exploring the integration of cutting-edge AI technologies into software architecture. This talk provides senior developers and architects with actionable insights on leveraging large language models like ChatGPT to enhance design processes, manage architectural tradeoffs, and achieve scalable, innovative solutions.
Overview of the session
Importance of large language models (LLMs) in software architecture
Introduction to ChatGPT and its relevance for software architects
Part 1:
The Role of Large Language Models in Software Architecture
Understanding the capabilities of LLMs like ChatGPT
Benefits of integrating LLMs in modern software development
Real-world examples of AI-enhanced software architecture
Part 2: Prompt Engineering for Architectural Tasks
Crafting effective prompts for ChatGPT
Strategies for creating precise and effective prompts
Examples of architectural prompts and their impact
Interactive Exercise: Participants craft and test their own prompts
Feedback and discussion on prompt effectiveness
Part 3: Optimizing Requirement Analysis with ChatGPT
Leveraging ChatGPT for requirement analysis and design
Integration of AI in empathizing with client needs and journey mapping
Cost estimations, compliance, security, and performance
Case Study: Using empathy map and customer journey map tools in conjunction with AI
Hands-On Exercise: Requirement analysis and design
Part 4: Managing Architectural Tradeoffs
Defining and understanding architectural tradeoffs
Exploring real-world tradeoff scenarios
Case Study 1: Scalability vs. Flexibility
Case Study 2: Time-to-Market vs. Maintainability
Leveraging AI insights to analyze tradeoffs
Group Discussion and Q&A
Part 5: Best Practices for Integrating AI in Software Architecture
Techniques for gathering and prioritizing project requirements
Aligning architectural decisions with business objectives
Evaluating risks and potential outcomes of tradeoffs
Assessing tools, technologies, and architectural patterns
AI-powered decision support with ChatGPT
Collaborative decision-making and involving stakeholders
Part 6: Achieving Sustainable Innovation
Leveraging tradeoffs to drive innovation and creativity
Recap of key points and takeaways
Panel Discussion with Industry Experts
AI in architectural innovation: ChatGPT in action
Q&A and Open Discussion with the Audience
Conclusion
Recapitulation of key takeaways
Addressing final questions and facilitating discussions with the audience
Highlighting the future of AI and big data with technologies like ChatGPT
About Rohit Bhardwaj
Rohit Bhardwaj is a Director of AI & Data Architecture at Salesforce, where he focuses on enterprise AI, agentic systems, cloud-native architecture, distributed systems, data platforms, security, and large-scale transformation.
Over his career, Rohit has designed and led complex enterprise platforms across AWS, Google Cloud, microservices, real-time data, API ecosystems, resilient distributed systems, and AI-enabled architectures. His work increasingly focuses on the challenges enterprises face as software evolves from deterministic services to AI-native and agentic systems—particularly around reliability, governance, evidence, security, observability, cost, and safe autonomy.
Rohit is the author of System Design with AI Interview Guide: Designing Scalable, Agentic, and Defensible Systems, published by Apress. The book presents a modern approach to system design covering scalability, distributed systems, AI architecture primitives, security, reliability, economics, agentic systems, and real-world architectures including e-commerce, ride sharing, payments, fraud detection, messaging, video streaming, file storage, and search. (Springer Link)
Book:
Amazon: https://a.co/d/09Zs1twa
Publisher / Springer Nature: https://link.springer.com/book/10.1007/979-8-8688-2782-2
O'Reilly: https://learning.oreilly.com/library/view/system-design-with/9798868827822/
Rohit is also an O’Reilly instructor and a frequent speaker at technology conferences including No Fluff Just Stuff, UberConf, GIDS, and other international events. His talks focus on practical architecture lessons from building and operating complex systems, including AI control planes, trusted agents, inference at scale, evidence-first RAG, AI security, distributed-system failure, and AI-era software architecture.
As a trusted advisor and architecture leader, Rohit works at the intersection of business strategy and deep technical architecture—helping teams translate complex business problems into scalable, resilient, secure, and economically sustainable systems.
Rohit holds an MBA in Corporate Entrepreneurship from Babson College and graduate-level education in Computer Science from Boston University and Harvard University.
Connect with Rohit:
LinkedIn: http://linkedin.com/in/rohit-bhardwaj-cloud
X / Twitter: @rbhardwaj1