Twin Cities Software Symposium - No Fluff Just Stuff

Twin Cities Software Symposium

March 8 - 10, 2019

Kafka Streams and KSQLDB

Sunday - Mar 10 11:00 AM CDT - SALON B

Kafka is more than just a messaging queue with storage. It goes beyond that and with technology from Confluent open source it has become a full-fledged data ETL and data streaming ecosystem.

When we utter the words, Kafka, it is no longer just one component but can be an entire data pipeline ecosystem to transform and enrich data from source to sink. It offers different ways to handle that data as well. In this presentation, we define:

  • Streaming Concepts
  • Using functional programming to manipulate your data
  • Co-partitioning
  • Aggregations

We then discuss KSQLDB. A SQL layer built upon Kafka Streams that provides a simple query language to perform streaming operations

  • Persistent Queries
  • Non-Persistent Queries
  • Fault-Tolerance
Daniel Hinojosa

Daniel Hinojosa

Independent Consultant

About Daniel Hinojosa

Daniel is a programmer, consultant, instructor, speaker, and recent author. With over 20 years of experience, he does work for private, educational, and government institutions. He is also currently a speaker for No Fluff Just Stuff tour. Daniel loves JVM languages like Java, Groovy, and Scala; but also dabbles with non JVM languages like Haskell, Ruby, Python, LISP, C, C++. He is an avid Pomodoro Technique Practitioner and makes every attempt to learn a new programming language every year. For downtime, he enjoys reading, swimming, Legos, football, and barbecuing.