file_20240523105131.json
2024-05-23T14:27:04.212+08:00
reportconsumer
14:27:00.141 715107 [org.springframework.kafka.KafkaListenerEndpointContainer#1-2-C-1] ERROR o.a.k.c.c.i.ConsumerCoordinator - [Consumer clientId=consumer-md-report-consumer-9, groupId=md-report-consumer] Offset commit failed on partition WorkSheet-onlyimport-2 at offset 0: The coordinator is not aware of this member.
2024-05-23T14:27:04.212+08:00
reportconsumer
14:27:00.141 715107 [org.springframework.kafka.KafkaListenerEndpointContainer#1-1-C-1] ERROR o.a.k.c.c.i.ConsumerCoordinator - [Consumer clientId=consumer-md-report-consumer-8, groupId=md-report-consumer] Asynchronous auto-commit of offsets failed: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.. Will continue to join group.
2024-05-23T14:27:04.212+08:00
reportconsumer
14:27:00.140 715106 [org.springframework.kafka.KafkaListenerEndpointContainer#1-2-C-1] ERROR o.a.k.c.c.i.ConsumerCoordinator - [Consumer clientId=consumer-md-report-consumer-9, groupId=md-report-consumer] Asynchronous auto-commit of offsets failed: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.. Will continue to join group.
2024-05-23T14:27:04.212+08:00
reportconsumer
14:27:00.140 715106 [org.springframework.kafka.KafkaListenerEndpointContainer#1-1-C-1] WARN o.a.k.c.c.i.ConsumerCoordinator - [Consumer clientId=consumer-md-report-consumer-8, groupId=md-report-consumer] Asynchronous auto-commit of offsets {WorkSheet-onlyimport-1=OffsetAndMetadata{offset=0, leaderEpoch=null, metadata=''}, WorkSheet-1=OffsetAndMetadata{offset=189789, leaderEpoch=null, metadata=''}} failed: Commit cannot be completed since the group has already rebalanced and assigned the partitions to another member. This means that the time between subsequent calls to poll() was longer than the configured max.poll.interval.ms, which typically implies that the poll loop is spending too much time message processing. You can address this either by increasing max.poll.interval.ms or by reducing the maximum size of batches returned in poll() with max.poll.records.
2024-05-23T14:27:04.212+08:00
reportconsumer
14:27:00.138 715104 [org.springframework.kafka.KafkaListenerEndpointContainer#1-1-C-1] ERROR o.a.k.c.c.i.ConsumerCoordinator - [Consumer clientId=consumer-md-report-consumer-8, groupId=md-report-consumer] Offset commit failed on partition WorkSheet-onlyimport-1 at offset 0: The coordinator is not aware of this member.
2024-05-23T14:27:04.161+08:00
worksheetconsumer
%3|1716445621.021|ERROR|rdkafka#consumer-8| [thrd:app]: rdkafka#consumer-8: sc:9092/0: 1 request(s) timed out: disconnect (after 741847ms in state UP)
2024-05-23T14:27:04.161+08:00
worksheetconsumer
%3|1716445621.021|ERROR|rdkafka#consumer-5| [thrd:app]: rdkafka#consumer-5: sc:9092/0: 2 request(s) timed out: disconnect (after 741731ms in state UP)
是整个应用这么多还是单条记录?尝试视图中隐藏这个附件字段看下,这个应该是缩略图加载过程把 CPU 吃满了。
是的,我有一个应用记录里面有很多图片,大概 30 张左右。
你部署出问题的版本是 sc2.0.1 和 community5.4.1 吗?确认下版本,这边测试环境内部做下复现测试
存储组件服务版本退到 2.0.0 微服务退到 5.2.3 正常了
我新部署一台也是这样
运行过程中也会偶尔 100%,服务中断,这个日志在什么地方看,需要看什么日志?
服务器上看下 free -g 和 lscpu 的输出,50C80G 的资源不可能 CPU 吃满,日志启动内存不足
看报错,应该是 CPU 和内存资源不符合要求,应该是差很多。你说的 50+80 应该是系统盘和数据盘存储,不是 CPU 和内存
logs 启动日志没啥问题,50+80G
![image.png]()
服务器资源是多大?CPU 和内存
重启之后的容器日志看下 docker logs 容器 ID
重启和重装都没有用
看提示是 kafka 消费者掉线了,不知道和 CPU100% 是结果,还是原因。先重启一下