kafka producer生产数据到kafka异常：Got error produce response with correlation id 16 on topic-partition…Error: NETWORK_EXCEPTION

攻城狮浩然技术 2022年11月10日

0 收藏 916 点赞 4,755 浏览 1091 个字

kafka producer生产数据到kafka异常：Got error produce response with correlation id 16 on topic-partition…Error: NETWORK_EXCEPTION

1.问题描述

2017-09-13 15:11:30.656 o.a.k.c.p.i.Sender [WARN] Got error produce response with correlation id 25 on topic-partition test2-rtb-camp-pc-hz-5, retrying (299 attempts left). Error: NETWORK_EXCEPTION
2017-09-13 15:11:30.656 o.a.k.c.p.i.Sender [WARN] Got error produce response with correlation id 25 on topic-partition test2-rtb-camp-pc-hz-23, retrying (299 attempts left). Error: NETWORK_EXCEPTION
2017-09-13 15:11:30.657 o.a.k.c.p.i.Sender [WARN] Got error produce response with correlation id 25 on topic-partition test2-rtb-camp-pc-hz-14, retrying (299 attempts left). Error: NETWORK_EXCEPTION
2017-09-13 15:11:30.657 o.a.k.c.p.i.Sender [WARN] Got error produce response with correlation id 16 on topic-partition test2-rtb-camp-pc-hz-5, retrying (299 attempts left). Error: NETWORK_EXCEPTION

2.问题原因

$KAFKA_HOME/config/server.properties中有如下注释：

大意是：kafka中每台broker会将hostname和port通知生产者和消费者，如果配置了listeners他就返回listeners的值，否则，就会调用java.net.InetAddress.getCanonicalHostName(),而这个方法返回的是linux这台主机的hostname，而不是IP。所以，在搭建kafka的时候需要配置listeners这个参数，最好也配上host.name=ip。