[KAFKA-593] Empty log index file created when it shouldn't be empty

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Assignee: Unassigned
• Reporter: Yang Ye
• Created: 30/Oct/12 00:07
• Updated: 06/Nov/12 03:44
• Resolved: 06/Nov/12 03:44

Description

We have met empty index file during system test when it shouldn't be empty. In this case, there're around 100 messages in each segment, each of size around 100 bytes, given the "logIndexIntervalBytes" 4096, there should be at least 2 log index entries, but we see empty index file. The kafka and zookeeper logs are attached

[yye@yye-ld kafka_server_3_logs]$ cd test_1-2/
[yye@yye-ld test_1-2]$ ls -l
total 84
rw-rr- 1 yye eng 8 Oct 29 15:22 00000000000000000000.index
rw-rr- 1 yye eng 10248 Oct 29 15:22 00000000000000000000.log
rw-rr- 1 yye eng 8 Oct 29 15:22 00000000000000000100.index
rw-rr- 1 yye eng 10296 Oct 29 15:22 00000000000000000100.log
rw-rr- 1 yye eng 0 Oct 29 15:23 00000000000000000200.index
rw-rr- 1 yye eng 10293 Oct 29 15:23 00000000000000000200.log
rw-rr- 1 yye eng 0 Oct 29 15:23 00000000000000000300.index
rw-rr- 1 yye eng 10274 Oct 29 15:23 00000000000000000300.log
rw-rr- 1 yye eng 0 Oct 29 15:23 00000000000000000399.index
rw-rr- 1 yye eng 10276 Oct 29 15:23 00000000000000000399.log
rw-rr- 1 yye eng 0 Oct 29 15:23 00000000000000000498.index
rw-rr- 1 yye eng 10256 Oct 29 15:23 00000000000000000498.log
rw-rr- 1 yye eng 10485760 Oct 29 15:23 00000000000000000596.index
rw-rr- 1 yye eng 3564 Oct 29 15:23 00000000000000000596.log

Issue Links

• blocks: KAFKA-583 SimpleConsumerShell may receive less data inconsistently