Speaker Topics - No Fluff Just Stuff
NFJS2025

Beyond APIs: Orchestration Patterns & MCP for Multi-Agent Systems

Enterprises are moving from single AI agents to networks of agents that trigger thousands of API calls, retries, and tool-chains per prompt. Without orchestration discipline and APIs built for AI-scale, systems buckle under bursty load, retry storms, cache-miss spikes, inconsistent decisions, and runaway costs.

This talk shows how to combine MCP (Model Context Protocol) with proven inter-agent orchestration patterns — Supervisor, Pub/Sub, Blackboard, Capability Router — and how to harden APIs for autonomous traffic using rate limits, dedupe, backpressure, async workflows, resilient caching, and autoscaling without bill shock.

You’ll also learn the AIRLOCK Framework for governing multi-agent behavior with access boundaries, identity checks, rate controls, least-privilege routing, observability, compliance filters, and kill-switches.

You will walk away with a practical blueprint for building multi-agent systems that are fast, safe, reliable, and cost-predictable.

KEY TAKEAWAYS
Pattern Literacy: When to use Orchestrator, Pub/Sub, Blackboard, Router

MCP Fluency: Standardize agent↔tool integration

API Scaling: Rate limits, dedupe, backpressure, async, caching

Resilience: Bulkheads, jitter, circuit breakers, autoscaling guardrails

Observability: Trace chain-ID/tool-ID across agents & tools

AIRLOCK Governance: Access boundaries, identity, rate controls, least-privilege routing, compliance, kill-switches

AGENDA

  • Why AI Changes Load Patterns
    Bursty workloads · fan-out · retry amplification · cost spikes

  • MCP 101
    Standardized agent→tool access · hot-swappable tools

  • Orchestration Patterns
    Supervisor · Pub/Sub · Blackboard · Capability Router

  • Architecting APIs for AI Traffic
    Multi-dimensional rate limits · dedupe · backpressure · SWR caching · async

  • Resilience & Autoscaling
    Circuit breakers · bulkheads · kill-switches · budget caps

  • Observability & Governance
    Chain-ID tracing · anomaly detection · AIRLOCK boundaries


Rohit Bhardwaj

About Rohit Bhardwaj

Rohit Bhardwaj is a Director of Architecture working at Salesforce. Rohit has extensive experience architecting multi-tenant cloud-native solutions in Resilient Microservices Service-Oriented architectures using AWS Stack. In addition, Rohit has a proven ability in designing solutions and executing and delivering transformational programs that reduce costs and increase efficiencies.

As a trusted advisor, leader, and collaborator, Rohit applies problem resolution, analytical, and operational skills to all initiatives and develops strategic requirements and solution analysis through all stages of the project life cycle and product readiness to execution.
Rohit excels in designing scalable cloud microservice architectures using Spring Boot and Netflix OSS technologies using AWS and Google clouds. As a Security Ninja, Rohit looks for ways to resolve application security vulnerabilities using ethical hacking and threat modeling. Rohit is excited about architecting cloud technologies using Dockers, REDIS, NGINX, RightScale, RabbitMQ, Apigee, Azul Zing, Actuate BIRT reporting, Chef, Splunk, Rest-Assured, SoapUI, Dynatrace, and EnterpriseDB. In addition, Rohit has developed lambda architecture solutions using Apache Spark, Cassandra, and Camel for real-time analytics and integration projects.

Rohit has done MBA from Babson College in Corporate Entrepreneurship, Masters in Computer Science from Boston University and Harvard University. Rohit is a regular speaker at No Fluff Just Stuff, UberConf, RichWeb, GIDS, and other international conferences.

Rohit loves to connect on http://www.productivecloudinnovation.com.
http://linkedin.com/in/rohit-bhardwaj-cloud or using Twitter at rbhardwaj1.

More About Rohit »