ERROR Error when sending message to topic
While producing message in kafka, i am getting the following error :
$ bin/kafka-console-producer.sh –broker-list localhost:9092 –topic nil_PF1_P1
[2016-07-19 17:06:34,542] ERROR Error when sending message to … Read more
Kafka how to read from __consumer_offsets topic
I’m trying to find out which offsets my current High-Level consumers are working off. I use Kafka 0.8.2.1, with no “offset.storage” set in the server.properties of Kafka – … Read more
Counting Number of messages stored in a kafka topic
I’m using 0.9.0.0 version of Kafka and I want to count the number of messages in a topic without using the admin script kafka-console-consumer.sh.
I have … Read more
Fluentd vs Kafka
The use case is this:
I’ve several java applications running which all have to interact with different (each one has a specific target) elasticsearch indices. For instance an application A uses the … Read more
Kafka Consumer get key value pair
I’m currently working with Kafka and Flink, I have kafka running in my local PC and I created a topic that is being consumed.
Desktop\kafka\bin\windowskafka-console-consumer.bat –zookeeper localhost:2181 -topic … Read more
How to view kafka message
Is there any way I can view the message content sent to kafka for a given topic? Say some thing like view last 5 messages for this topic, if that … Read more
kafka get partition count for a topic
How can I get number of partitions for any kafka topic from the code. I have researched many links but none seem to work.
Mentioning a few:
http://grokbase.com/t/kafka/users/148132gdzk/find-topic-partition-count-through-simpleclient-api… Read more
How to run a Kafka connect worker in YARN?
I’m playing with Kafka-Connect. I’ve got the HDFS connector working both in stand-alone mode and distributed mode.
They advertise that the workers (which are responsible for … Read more
Kafka – How to commit offset after every message using High-Level consumer?
I’m using Kafka’s high-level consumer. Because I’m using Kafka as a ‘queue of transactions’ for my application, I need to make absolutely sure … Read more
kafka 8 and memory – There is insufficient memory for the Java Runtime Environment to continue
I am using DigiOcean instance with 512 megs of ram, I get the below error with kafka.
I am … Read more