kafka 不能自动创建__consumer_offsets topic问题
Linux-man.cn 发布于 阅读:31 技术文章
以前没有部署过单节点的kafka,所以习惯性的将配置文件的副本数设置为3,但是kafka单节点副本数只能为1,导致kafka不能自动创建__consumer_offsets topic。简单记录下这个问题。
下面是kafka日志的一些相关记录
server.log
[2025-05-16 18:31:07,166] INFO [GroupMetadataManager brokerId=1] Finished loading offsets and group metadata from __consumer_offsets-2 in 15 milliseconds for epoch 0, of which 15 milliseconds was spent in the scheduler. (kafka.coordinator.group.GroupMetadataManager)
controller.log
[2025-05-16 18:00:00,520] INFO [QuorumController id=1] CreateTopics result(s): CreatableTopic(name='__consumer_offsets', numPartitions=50, replicationFactor=3, assignments=[], configs=[CreatableTopicConfig(name='compression.type', value='producer'), CreatableTopicConfig(name='cleanup.policy', value='compact'), CreatableTopicConfig(name='segment.bytes', value='104857600')]): INVALID_REPLICATION_FACTOR (Unable to replicate the partition 3 time(s): The target replication factor of 3 cannot be reached because only 1 broker(s) are registered.) (org.apache.kafka.controller.ReplicationControlManager)