Speaker Topics - No Fluff Just Stuff

Spark, Mesos, Akka, Cassandra and Kafka (SMACK) stack real time Big Data

Enterprise Big Data Cloud architect/developer need to use Big data solutions deployed in Cloud for reliability, scalability, agility, availability, and security. There are no comprehensive end-to-end hands on experience for Developers and Enterprise architects have to be able to design Big data solutions which can maximize for linear scalability and high availability. Why? Big data Analytics use-cases require sub-second response time with at least 99.99 % availability using massively parallel processing.

We will start with Apache Cassandra. Apache Cassandra is one of the best solutions for storing data for high availability and scalability. Modeling strategies help in designing solutions based on the application flow. Later, we will explore Cassandra time series data modeling.

Big Data applications require a faster speed of data processing and analysis. We will study topology with examples for building Spark applications. We will deep dive into Apache Spark applications, which connect into Cassandra. Spark streaming is used for processing real-time data.

We will explore Spark, Mesos, Akka, Cassandra and Kafka (SMACK) stack. We will look at how SMACK stack is helping build massively scalable applications in the cloud. Mesos is distributed systems kernel that can run on every machine and provides applications like Hadoop, Spark, Kafka, Elastic Search with APIs for resource management and scheduling across entire datacenter and cloud environments. Mesos help with scalability to 10,000 nodes and is fault-tolerant replicated master slave using ZooKeeper. Akka is a toolkit and runtime for building highly concurrent, distributed, and resilient message-driven applications on the JVM. Kafka is a distributed publish-subscribe messaging system that is designed to be fast, scalable, and durable.

The objective for this talk is to give clear direction on how to create scalable cloud ready Big Data applications with practical recopies to solve common problems. Building Elastic, Resilient, Scalable, Multi-workload, Efficient, and Isolated architecture using SMACK stack.

Enterprise Big Data Cloud architect/developer need to use Big data solutions deployed in Cloud for reliability, scalability, agility, availability, and security. There are no comprehensive end-to-end hands on experience for Developers and Enterprise architects have to be able to design Big data solutions which can maximize for linear scalability and high availability. Why? Big data Analytics use-cases require sub-second response time with at least 99.99 % availability using massively parallel processing.

We will start with Apache Cassandra. Apache Cassandra is one of the best solutions for storing data for high availability and scalability. Modeling strategies help in designing solutions based on the application flow. Later, we will explore Cassandra time series data modeling.

Big Data applications require a faster speed of data processing and analysis. We will study topology with examples for building Spark applications. We will deep dive into Apache Spark applications, which connect into Cassandra. Spark streaming is used for processing real-time data.

We will explore Spark, Mesos, Akka, Cassandra and Kafka (SMACK) stack. We will look at how SMACK stack is helping build massively scalable applications in the cloud. Mesos is distributed systems kernel that can run on every machine and provides applications like Hadoop, Spark, Kafka, Elastic Search with APIs for resource management and scheduling across entire datacenter and cloud environments. Mesos help with scalability to 10,000 nodes and is fault-tolerant replicated master slave using ZooKeeper. Akka is a toolkit and runtime for building highly concurrent, distributed, and resilient message-driven applications on the JVM. Kafka is a distributed publish-subscribe messaging system that is designed to be fast, scalable, and durable.

The objective for this talk is to give clear direction on how to create scalable cloud ready Big Data applications with practical recopies to solve common problems. Building Elastic, Resilient, Scalable, Multi-workload, Efficient, and Isolated architecture using SMACK stack.


About Rohit Bhardwaj

Rohit Bhardwaj is Director of AI & Data Architecture at Salesforce, an O’Reilly instructor, and founder of AI Architect Circle. With 30 years of experience in software and enterprise architecture, he helps engineers, architects, and technology leaders make architecture decisions they can explain and defend.

His work brings together enterprise AI, agentic systems, data architecture, and distributed systems. He focuses on the decisions that determine whether a system remains reliable, secure, accountable, and economically sustainable when it encounters real-world demands.

Rohit’s talks and workshops explore practical questions: What happens when an AI agent acts on conflicting information? Can a failed payment be retried safely? Who can stop an autonomous action, and what evidence explains the decision afterward? His teaching connects these questions to architecture, customer trust, and business outcomes.

He is the author of System Design with AI Interview Guide: Designing Scalable, Agentic, and Defensible Systems, published by Apress. He also developed ARCHVIEW™, ROCS Loops™, and LLM-SHIELD™ to help teams structure architectural thinking and address the challenges of building trustworthy AI systems.

Through AI Architect Circle, Rohit extends this learning through live discussions, book walkthroughs, videos, and interactive architecture challenges. These challenges explore incidents such as payment timeouts and conflicting bookings, helping participants practice the judgment behind their design decisions.

Continue learning with Rohit

Join Rohit live on Saturdays at 9:00 a.m. Eastern
System Design with AI — Live with the Author is a free live podcast and Q&A series featuring practical system-design scenarios, AI architecture discussions, and questions from the community.
See the next session and register

Try an interactive architecture challenge
Put your design decisions under pressure and explore the consequences.
Explore the challenges

Explore AI Architect Circle
Find architecture lessons, videos, resources, and ways to continue learning.
Visit AIArchitectCircle.com

Read the book: Amazon · O’Reilly

Watch and connect: YouTube · Instagram: @aiarchitectcircle · LinkedIn · X / Twitter: @rbhardwaj1

More About Rohit »