java Kafka生产者错误

声明:本页面是StackOverFlow热门问题的中英对照翻译,遵循CC BY-SA 4.0协议,如果您需要使用它,必须同样遵循CC BY-SA许可,注明原文地址和作者信息,同时你必须将它归于原作者(不是我):StackOverFlow 原文地址: http://stackoverflow.com/questions/28163863/
Warning: these are provided under cc-by-sa 4.0 license. You are free to use/share it, But you must attribute it to the original authors (not me): StackOverFlow

提示:将鼠标放在中文语句上可以显示对应的英文。显示中英文
时间:2020-11-02 13:06:50  来源:igfitidea点击:

java Kafka producer error

javaapache-kafka

提问by Rabbit Summer

I made kafka java producer. but console said error. kafka server is on aws. and producer is on my mac. and yet kara server is reachable. When i send message from producer, kafka server shows "Accepted connection .. ". What is problem?

我做了 kafka java 生产者。但控制台说错误。kafka 服务器在 aws 上。制作人在我的 Mac 上。然而 kara 服务器是可访问的。当我从生产者发送消息时,kafka 服务器显示“已接受连接..”。什么是问题?

1 [main] INFO kafka.utils.VerifiableProperties - Verifying properties
28 [main] INFO kafka.utils.VerifiableProperties - Property      metadata.broker.list is overridden to xxxxxx:9092
28 [main] INFO kafka.utils.VerifiableProperties - Property serializer.class is overridden to kafka.serializer.StringEncoder
137 [main] INFO kafka.client.ClientUtils$ - Fetching metadata from broker id:0,host: xxxxxx,port:9092 with correlation id 0 for 1 topic(s) Set(words_topic)
189 [main] ERROR kafka.producer.SyncProducer - Producer connection to xxxxxx:9092 unsuccessful
198 [main] WARN kafka.client.ClientUtils$ - Fetching topic metadata with correlation id 0 for topics [Set(words_topic)] from broker [id:0,host: xxxxxx,port:9092] failed
199 [main] ERROR kafka.utils.Utils$ - fetching topic metadata for topics [Set(words_topic)] from broker [ArrayBuffer(id:0,host: xxxxxx,port:9092)] failed

And It's kafka console

这是 kafka 控制台

[2015-01-27 05:23:33,767] DEBUG Accepted connection from /xxxxx on /xxxx:9092. sendBufferSize [actual|requested]: [212992|1048576] recvBufferSize [actual|requested]: [212992|1048576] (kafka.network.Acceptor)
[2015-01-27 05:23:33,767] DEBUG Processor 1 listening to new connection from /xxxx:65307 (kafka.network.Processor)
[2015-01-27 05:23:33,872] INFO Closing socket connection to /xxxx. (kafka.network.Processor)
[2015-01-27 05:23:33,873] DEBUG Closing connection from /xxxx:65307 (kafka.network.Processor)

This is my code.

这是我的代码。

    Properties props = new Properties();
    props.put("metadata.broker.list", "?????:9092");
    props.put("serializer.class", "kafka.serializer.StringEncoder");
    ProducerConfig config = new ProducerConfig(props);
    Producer<String, String> producer = new Producer<String, String>(config);

    // Now we break each word from the paragraph
        for (String word :
            METAMORPHOSIS_OPENING_PARA.split("\s")) {
        // Create message to be sent to "words_topic" topic with the word
        KeyedMessage<String, String> data =
                new KeyedMessage<String, String>
                        ("words_topic", word);
        // Send the message
        producer.send(data);
    }
    System.out.println("Produced data");
    // close the producer
    producer.close();

}

// First paragraph from Franz Kafka's Metamorphosis
private static String METAMORPHOSIS_OPENING_PARA =
        "One morning, when Gregor Samsa woke from troubled dreams, "
                + "he found himself transformed in his bed into a horrible "
                + "vermin. He lay on his armour-like back, and if he lifted "
                + "his head a little he could see his brown belly, slightly "
                + "domed and divided by arches into stiff sections.";

回答by Rabbit Summer

I solve it

我解决了

Set 'advertised.host.name' on server.properties of Kafka broker to server's realIP(same to producer's 'metadata.broker.list' property)

将 Kafka 代理的 server.properties 上的 'advertised.host.name' 设置为服务器的 realIP(与生产者的 'metadata.broker.list' 属性相同)

refrence : https://issues.apache.org/jira/browse/KAFKA-1092

参考:https: //issues.apache.org/jira/browse/KAFKA-1092