Securing LLMs: DevSecOps in the Age of AI
As organizations race to integrate large language models (LLMs) into their platforms, a new threat landscape is emerging—one that exploits prompts, payloads, and intelligent automation. Traditional AppSec and DevSecOps tools weren’t built with prompt injection, model exploitation, or data leakage in mind.
This talk provides a security-first blueprint for software architects and DevOps teams who are responsible for building AI-powered platforms. It dives deep into the evolving risks of AI-native systems, explores the OWASP Top 10 for LLMs, and shows how to embed LLM-aware security practices throughout the development lifecycle—from CI/CD pipelines to production inference layers.
What You’ll Learn
How LLMs introduce new attack vectors, including prompt injection, training data poisoning, model hallucinations, and jailbreaks
How to apply OWASP Top 10 for LLMs to your AI application lifecycle
How to secure LLM endpoints with input sanitization, output filtering, role-based control, and inference governance
How to embed AI-specific security scans into DevSecOps pipelines
How to evaluate attack surfaces across prompts, APIs, vector stores, retrieval systems, and agents
Metrics and tools for measuring AI security posture and mitigating risks proactively
Who Should Attend
Software Architects embedding LLMs in enterprise systems
Platform Engineers & DevSecOps leads managing AI APIs and pipelines
Security Engineers assessing risks in AI-enhanced applications
CTOs and AI Product Owners accountable for safety, trust, and compliance
About Rohit Bhardwaj
Rohit Bhardwaj is a Director of Architecture working at Salesforce. Rohit has extensive experience architecting multi-tenant cloud-native solutions in Resilient Microservices Service-Oriented architectures using AWS Stack. In addition, Rohit has a proven ability in designing solutions and executing and delivering transformational programs that reduce costs and increase efficiencies.
As a trusted advisor, leader, and collaborator, Rohit applies problem resolution, analytical, and operational skills to all initiatives and develops strategic requirements and solution analysis through all stages of the project life cycle and product readiness to execution.
Rohit excels in designing scalable cloud microservice architectures using Spring Boot and Netflix OSS technologies using AWS and Google clouds. As a Security Ninja, Rohit looks for ways to resolve application security vulnerabilities using ethical hacking and threat modeling. Rohit is excited about architecting cloud technologies using Dockers, REDIS, NGINX, RightScale, RabbitMQ, Apigee, Azul Zing, Actuate BIRT reporting, Chef, Splunk, Rest-Assured, SoapUI, Dynatrace, and EnterpriseDB. In addition, Rohit has developed lambda architecture solutions using Apache Spark, Cassandra, and Camel for real-time analytics and integration projects.
Rohit has done MBA from Babson College in Corporate Entrepreneurship, Masters in Computer Science from Boston University and Harvard University. Rohit is a regular speaker at No Fluff Just Stuff, UberConf, RichWeb, GIDS, and other international conferences.
Rohit loves to connect on http://www.productivecloudinnovation.com.
http://linkedin.com/in/rohit-bhardwaj-cloud or using Twitter at rbhardwaj1.