Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-593

Empty log index file created when it shouldn't be empty

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      We have met empty index file during system test when it shouldn't be empty. In this case, there're around 100 messages in each segment, each of size around 100 bytes, given the "logIndexIntervalBytes" 4096, there should be at least 2 log index entries, but we see empty index file. The kafka and zookeeper logs are attached

      [yye@yye-ld kafka_server_3_logs]$ cd test_1-2/
      [yye@yye-ld test_1-2]$ ls -l
      total 84
      rw-rr- 1 yye eng 8 Oct 29 15:22 00000000000000000000.index
      rw-rr- 1 yye eng 10248 Oct 29 15:22 00000000000000000000.log
      rw-rr- 1 yye eng 8 Oct 29 15:22 00000000000000000100.index
      rw-rr- 1 yye eng 10296 Oct 29 15:22 00000000000000000100.log
      rw-rr- 1 yye eng 0 Oct 29 15:23 00000000000000000200.index
      rw-rr- 1 yye eng 10293 Oct 29 15:23 00000000000000000200.log
      rw-rr- 1 yye eng 0 Oct 29 15:23 00000000000000000300.index
      rw-rr- 1 yye eng 10274 Oct 29 15:23 00000000000000000300.log
      rw-rr- 1 yye eng 0 Oct 29 15:23 00000000000000000399.index
      rw-rr- 1 yye eng 10276 Oct 29 15:23 00000000000000000399.log
      rw-rr- 1 yye eng 0 Oct 29 15:23 00000000000000000498.index
      rw-rr- 1 yye eng 10256 Oct 29 15:23 00000000000000000498.log
      rw-rr- 1 yye eng 10485760 Oct 29 15:23 00000000000000000596.index
      rw-rr- 1 yye eng 3564 Oct 29 15:23 00000000000000000596.log

        Attachments

        1. kafka_583_zk_kafka_data.tar.gz
          525 kB
          Yang Ye
        2. kafka_593_v1.diff
          2 kB
          Yang Ye
        3. kafka_593_v2.diff
          3 kB
          Yang Ye
        4. kafka_593_v3.diff
          4 kB
          Yang Ye
        5. kafka_593_v4.diff
          4 kB
          Yang Ye
        6. kafka_593_v5.diff
          6 kB
          Yang Ye

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                yeyangever Yang Ye
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: