NFJS 2021 Virtual Tour Stop #1
January 29, 2021
Kafka Connect: Harnessing Data Stores
Friday - Jan 29 3:30 PM EST
In this presentation, we will discuss Kafka Connect. Kafka Connect is an opensource project from Confluent. Kafka Connect provides us a way to move data from a data store as a source and stream or batch that information into Kafka. Kafka Connect also gives us a way to take information from Kafka and send that to another data store, a Sink. Every source and sink can be connected to and from various databases and message queues.
What this presentation will entail:
- A brief overview and review of Kafka
- The Architecture of Kafka Connect
- Where to find connectors
- Standalone vs Distributed
- Connecting a Source
- Creating Single Message Transforms
- Connecting a Sink
At the end of this presentation, we will have a live demonstration of watching a data pipeline using data stores.
Daniel Hinojosa
Independent Consultant
About Daniel Hinojosa
Daniel is a programmer, consultant, instructor, speaker, and recent author. With over 20 years of experience, he does work for private, educational, and government institutions. He is also currently a speaker for No Fluff Just Stuff tour. Daniel loves JVM languages like Java, Groovy, and Scala; but also dabbles with non JVM languages like Haskell, Ruby, Python, LISP, C, C++. He is an avid Pomodoro Technique Practitioner and makes every attempt to learn a new programming language every year. For downtime, he enjoys reading, swimming, Legos, football, and barbecuing.