Kafka 网络中断导致leader,follower不断进行协调,导致无法处理消息

1.spark streaming 持续如下打印日志,无法进行任务处理,并无报错AbstractCoordinator: (Re-)joining group testpAbstractCoordinator: (Re-)joining group testpAbstractCoordinator: (Re-)joining group testp2.查看zookeeper...

dymkkj

2412人浏览 · 2018-04-20 15:26:27

dymkkj · 2018-04-20 15:26:27 发布

1.spark streaming 持续如下打印日志,无法进行任务处理,并无报错

AbstractCoordinator: (Re-)joining group testp

2.查看zookeeper.out发现consumer消费offset 出现问题,部分贴出:

2018-04-20 14:39:10,158 [myid:] - INFO [ProcessThread(sid:0 cport:2181)::PrepRequestProcessor@651] - Got user-level KeeperException when processing sessionid:0x162e0b4e63b001f type:setData cxid:0x2c72 zxid:0x23ba txntype:-1 reqpath:n/a Error Path:/kafka10/brokers/topics/__consumer_offsets/partitions/6/state Error:KeeperErrorCode = BadVersion for /kafka10/brokers/topics/__consumer_offsets/partitions/6/state
2018-04-20 14:39:10,161 [myid:] - INFO [ProcessThread(sid:0 cport:2181)::PrepRequestProcessor@651] - Got user-level KeeperException when processing sessionid:0x162e0b4e63b001f type:setData cxid:0x2c74 zxid:0x23bb txntype:-1 reqpath:n/a Error Path:/kafka10/brokers/topics/__consumer_offsets/partitions/10/state Error:KeeperErrorCode = BadVersion for /kafka10/brokers/topics/__consumer_offsets/partitions/10/state
2018-04-20 14:39:10,164 [myid:] - INFO [ProcessThread(sid:0 cport:2181)::PrepRequestProcessor@651] - Got user-level KeeperException when processing sessionid:0x162e0b4e63b001f type:setData cxid:0x2c76 zxid:0x23bc txntype:-1 reqpath:n/a Error Path:/kafka10/brokers/topics/__consumer_offsets/partitions/20/state Error:KeeperErrorCode = BadVersion for /kafka10/brokers/topics/__consumer_offsets/partitions/20/state
2018-04-20 14:39:10,167 [myid:] - INFO [ProcessThread(sid:0 cport:2181)::PrepRequestProcessor@651] - Got user-level KeeperException when processing sessionid:0x162e0b4e63b001f type:setData cxid:0x2c78 zxid:0x23bd txntype:-1 reqpath:n/a Error Path:/kafka10/brokers/topics/__consumer_offsets/partitions/4/state Error:KeeperErrorCode = BadVersion for /kafka10/brokers/topics/__consumer_offsets/partitions/4/state

原因:kafka中间出现过网络中断问题,导致leader,follower,follower不断进行协调消息,offset管理

解决: 确保网络正常后, 重启kafka broker ,kafka producer,用到的spark-streaming程序,

hdfs集群(如有必要)

天启AI社区

GitCode 天启AI是一款由 GitCode 团队打造的智能助手，基于先进的LLM（大语言模型）与多智能体 Agent 技术构建，致力于为用户提供高效、智能、多模态的创作与开发支持。它不仅支持自然语言对话，还具备处理文件、生成 PPT、撰写分析报告、开发 Web 应用等多项能力，真正做到“一句话，让 Al帮你完成复杂任务”。

更多推荐

对近期接触到的直播相关知识进行梳理

M3U8 文件是 HLS (HTTP Live Streaming) 协议的核心组件，它本质上是一个播放列表文件，包含媒体流的结构信息。直播与视频聊天的对比：我觉得直播是通过流媒体技术把现场的图像和声音采集后分发出去，供观众在线围观，可以认为是开放的，一般没有人数限制；而视频聊天是点对点的线上交流，是基于UDP/TCP的实时传输协议实现的。流媒体是通过互联网实时传输音视频内容的技术，用户无需等待完