Speaker Topics - No Fluff Just Stuff

When Search Makes Decisions with AI

Enterprise RAG systems increasingly influence customer answers, policy interpretations, recommendations, and business actions. But a fluent, cited answer can still be unsafe if it relies on stale policy, unauthorized data, a superseded document, or an incomplete view of the truth.

This interactive session reframes RAG as an evidence-and-decision system. Participants examine a realistic stale-answer failure and redesign the retrieval path using source authority, freshness clocks, entitlement-aware access, lexical and semantic search, Graph RAG, structured data, citations, decision receipts, and safe refusal rules.

Most RAG talks focus on embeddings, chunking, vector databases, and prompts. Those are necessary—but not enough when AI influences real customers or business outcomes. The hard enterprise question is not “Did we retrieve something relevant?” It is:

“Was this evidence authorized, current, applicable, and strong enough for the AI to make this claim or recommendation?”

Without these controls, a system can look healthy—fast responses, good relevance, attractive citations—while exposing private data, applying an expired policy, or making promises the organization cannot defend.

Value for participants:

  • Learn how to prevent stale, superseded, or unauthorized evidence from reaching AI context.
  • Understand when to use BM25, semantic retrieval, Graph RAG, and structured system-of-record data together.
  • Design a practical evidence graph that captures ownership, policy versions, scope, conflicts, and applicability.
  • Separate the AI’s role in synthesizing evidence from policy’s role in allowing a decision.
  • Build citations that can be checked, and decision receipts that explain why the AI was allowed to respond.
  • Define when the system should answer, ask for clarification, defer, refuse, or escalate to a human.
  • Take away reusable architecture artifacts: Source Authority Map, - Freshness Clocks, Admissibility Contract, Retrieval Ensemble Map, Citation and Decision Receipt, and Refusal/Stop-Authority Ladder.

About Rohit Bhardwaj

Rohit Bhardwaj is Director of AI & Data Architecture at Salesforce, an O’Reilly instructor, and founder of AI Architect Circle. With 30 years of experience in software and enterprise architecture, he helps engineers, architects, and technology leaders make architecture decisions they can explain and defend.

His work brings together enterprise AI, agentic systems, data architecture, and distributed systems. He focuses on the decisions that determine whether a system remains reliable, secure, accountable, and economically sustainable when it encounters real-world demands.

Rohit’s talks and workshops explore practical questions: What happens when an AI agent acts on conflicting information? Can a failed payment be retried safely? Who can stop an autonomous action, and what evidence explains the decision afterward? His teaching connects these questions to architecture, customer trust, and business outcomes.

He is the author of System Design with AI Interview Guide: Designing Scalable, Agentic, and Defensible Systems, published by Apress. He also developed ARCHVIEW™, ROCS Loops™, and LLM-SHIELD™ to help teams structure architectural thinking and address the challenges of building trustworthy AI systems.

Through AI Architect Circle, Rohit extends this learning through live discussions, book walkthroughs, videos, and interactive architecture challenges. These challenges explore incidents such as payment timeouts and conflicting bookings, helping participants practice the judgment behind their design decisions.

Continue learning with Rohit

Join Rohit live on Saturdays at 9:00 a.m. Eastern
System Design with AI — Live with the Author is a free live podcast and Q&A series featuring practical system-design scenarios, AI architecture discussions, and questions from the community.
See the next session and register

Try an interactive architecture challenge
Put your design decisions under pressure and explore the consequences.
Explore the challenges

Explore AI Architect Circle
Find architecture lessons, videos, resources, and ways to continue learning.
Visit AIArchitectCircle.com

Read the book: Amazon · O’Reilly

Watch and connect: YouTube · Instagram: @aiarchitectcircle · LinkedIn · X / Twitter: @rbhardwaj1

More About Rohit »