Kafka
  1. Kafka
  2. KAFKA-593

Empty log index file created when it shouldn't be empty

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      We have met empty index file during system test when it shouldn't be empty. In this case, there're around 100 messages in each segment, each of size around 100 bytes, given the "logIndexIntervalBytes" 4096, there should be at least 2 log index entries, but we see empty index file. The kafka and zookeeper logs are attached

      [yye@yye-ld kafka_server_3_logs]$ cd test_1-2/
      [yye@yye-ld test_1-2]$ ls -l
      total 84
      rw-rr- 1 yye eng 8 Oct 29 15:22 00000000000000000000.index
      rw-rr- 1 yye eng 10248 Oct 29 15:22 00000000000000000000.log
      rw-rr- 1 yye eng 8 Oct 29 15:22 00000000000000000100.index
      rw-rr- 1 yye eng 10296 Oct 29 15:22 00000000000000000100.log
      rw-rr- 1 yye eng 0 Oct 29 15:23 00000000000000000200.index
      rw-rr- 1 yye eng 10293 Oct 29 15:23 00000000000000000200.log
      rw-rr- 1 yye eng 0 Oct 29 15:23 00000000000000000300.index
      rw-rr- 1 yye eng 10274 Oct 29 15:23 00000000000000000300.log
      rw-rr- 1 yye eng 0 Oct 29 15:23 00000000000000000399.index
      rw-rr- 1 yye eng 10276 Oct 29 15:23 00000000000000000399.log
      rw-rr- 1 yye eng 0 Oct 29 15:23 00000000000000000498.index
      rw-rr- 1 yye eng 10256 Oct 29 15:23 00000000000000000498.log
      rw-rr- 1 yye eng 10485760 Oct 29 15:23 00000000000000000596.index
      rw-rr- 1 yye eng 3564 Oct 29 15:23 00000000000000000596.log

      1. kafka_583_zk_kafka_data.tar.gz
        525 kB
        Yang Ye
      2. kafka_593_v1.diff
        2 kB
        Yang Ye
      3. kafka_593_v2.diff
        3 kB
        Yang Ye
      4. kafka_593_v3.diff
        4 kB
        Yang Ye
      5. kafka_593_v4.diff
        4 kB
        Yang Ye
      6. kafka_593_v5.diff
        6 kB
        Yang Ye

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Unassigned
              Reporter:
              Yang Ye
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development