Understand how Kafka Streams works, see what it does to become familiar with it and run it!
If you want to learn more: https://links.datacumulus.com/kafka-streams-coupon
Get the Kafka Streams for Data Processing course at a special price!
Don’t forget to subscribe to get more content about Apache Kafka and AWS!
I’m Stephane Maarek, a consultant and software developer, and I have a particular interest in everything related to Big Data, Cloud and API. I sat on the 2019 Program Committee organizing the Kafka Summit. I’m also an AWS Certified Solutions Architect, Developer, SysOps Administrator, and DevOps Engineer.
My other courses are available here: https://courses.datacumulus.com/
Follow me on social media:
LinkedIn – https://www.linkedin.com/in/stephanemaarek/
Twitter – https://twitter.com/stephanemaarek/
Medium – https://medium.com/@stephane.maarek
تطبيق
If you want to learn more, check out my Apache Kafka Series – Kafka Streams for Data Processing course : https://links.datacumulus.com/kafka-streams-coupon
Thank you Stephane, please where can I find the cmds to be executed ?
hello, how do i run kafka in android studio with gradle dependencies
can u please help me with one simple example.
Learned AWS SAA from your Udemy course, and now you saved me again for this Kafka wordcount Lab in this last semester of my IT master. Thanks for such clear and understandable teaching!
My understanding is Kafka streams did the counting part. But you didn't specify the topic from which the streams has to read and topic it has to write into . So how it worked??
when the consumer tries to get the messages with –from-beginning, it lists out "kafka streams course" first and then "kafka streams udemy" which is not the same as the order in which producer wrote the message. Is that expected? I thought ordering was important and followed in kafka.
Very good tutorial. Thanks Stephane.
Great demo
nice
how can we get the commands that u r running
It turns out the code of WordCountDemo process the content of input topic and continuously stream the result to the output topic, which was NOT mentioned in the video at all!!!
Check the official tutorial with the exactly same example here: https://kafka.apache.org/25/documentation/streams/quickstart
This video makes no sense to me and I really need some explanation here. We wrote the data to the topic "stream-file-input" by producer, but why the consumer reads data from topic"streams-wordcount-output"???
Did the data just go from one topic to another without any extra commands?
Hi Stephane.
Thanks for the video.
Is there any example of posting a message to kafka via kafka rest proxy in java.
It would be great if you can make one video on that
What to do when we get error while writing messages to producer "WARN [Producer clientId=console-producer] Error while fetching metadata with correlation id 266 : {streams-file-input=LEADER_NOT_AVAILABLE} (org.apache.kafka.clients.NetworkClient)"
Why is the output stream out of order compared to the input? 13:18 "data" was in the 3rd input message and appears 1st in the output.
Seems like in latest version of Kafka (2.12) the input topic needs to be streams-plaintext-input for this demo to work. https://github.com/axbaretto/kafka/blob/master/streams/examples/src/main/java/org/apache/kafka/streams/examples/wordcount/WordCountDemo.java
Great course. I purchased all of his Kafka courses and learned a ton.
Has a question about last step, when I try to run "bin/kafka-run-class.sh org.apache.streams.wordcount.WordCountDemo", It was said: Could not find or load main class org.apache.streams.wordcount.WordCountDemo
Super video , thank you for sharing with us.
When you run command for "kafka-run-classes" what's the parameter you gave? Is that a Java program class name that you separately built? I believe that you provide a class name as parameter and this class is a Producer class for that topic? Is my assumption correct?
Thank you for your time 🙂
What are your iterm customisations?
big help … thanks
One of the best tutorial for KafkaStreams. Good work !!!