Great Lakes Software Symposium

November 2 - 4, 2018

Streaming Architecture Using Kafka (UberConf)

Saturday - Nov 3 3:15 PM - BALLROOM 3-5

Mark Richards

Mark Richards

Independent Software Architect, Author of Software Architecture Fundamentals

There are many different uses for Apache Kafka. It can be used as a streaming broker, event broker for transactional data, and even a database. This session is about understanding streaming architecture and how to implement it using Apache Kafka. I start this session by talking about some of the streaming architecture patterns, then dive into how Apache Kafka works using the Core API. Using live coding examples in Apache Kafka, I also talk about the differences between Kafka and regular messaging (RabbitMQ, ActiveMQ, etc.) and when you should use each. I end this session by putting everything together, showing an actual streaming architecture using Kafka within a Microservice ecosystem for gathering various metrics for business and operational monitoring and reporting.


  • Streaming architecture patterns
  • Kafka overview
  • Kafka producers and consumers
  • Kafka vs. standard messaging
  • Streaming examples in a microservices ecosystem

Video Preview

About Mark Richards

Mark Richards is an experienced, hands-on software architect involved in the architecture, design, and implementation of microservices architectures, service-oriented architectures, and distributed systems. He has been in the software industry since 1983 and has significant experience and expertise in application, integration, and enterprise architecture. Mark is the founder of, a website devoted to helping developers in the journey to software architect. He is the author of numerous technical books and videos, including several books on Microservices (O'Reilly), the Software Architecture Fundamentals video series (O’Reilly), Enterprise Messaging video series (O’Reilly), Java Message Service, 2nd Edition (O’Reilly), and a contributing author to 97 Things Every Software Architect Should Know (O’Reilly). Mark has a master’s degree in computer science and numerous architect and developer certifications from IBM, Sun, The Open Group, and Oracle. He is a regular conference speaker at the No Fluff Just Stuff (NFJS) Symposium Series and has spoken at hundreds of conferences and user groups around the world on a variety of enterprise-related technical topics.