Kafka
  1. Kafka
  2. KAFKA-593

Empty log index file created when it shouldn't be empty

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      We have met empty index file during system test when it shouldn't be empty. In this case, there're around 100 messages in each segment, each of size around 100 bytes, given the "logIndexIntervalBytes" 4096, there should be at least 2 log index entries, but we see empty index file. The kafka and zookeeper logs are attached

      [yye@yye-ld kafka_server_3_logs]$ cd test_1-2/
      [yye@yye-ld test_1-2]$ ls -l
      total 84
      rw-rr- 1 yye eng 8 Oct 29 15:22 00000000000000000000.index
      rw-rr- 1 yye eng 10248 Oct 29 15:22 00000000000000000000.log
      rw-rr- 1 yye eng 8 Oct 29 15:22 00000000000000000100.index
      rw-rr- 1 yye eng 10296 Oct 29 15:22 00000000000000000100.log
      rw-rr- 1 yye eng 0 Oct 29 15:23 00000000000000000200.index
      rw-rr- 1 yye eng 10293 Oct 29 15:23 00000000000000000200.log
      rw-rr- 1 yye eng 0 Oct 29 15:23 00000000000000000300.index
      rw-rr- 1 yye eng 10274 Oct 29 15:23 00000000000000000300.log
      rw-rr- 1 yye eng 0 Oct 29 15:23 00000000000000000399.index
      rw-rr- 1 yye eng 10276 Oct 29 15:23 00000000000000000399.log
      rw-rr- 1 yye eng 0 Oct 29 15:23 00000000000000000498.index
      rw-rr- 1 yye eng 10256 Oct 29 15:23 00000000000000000498.log
      rw-rr- 1 yye eng 10485760 Oct 29 15:23 00000000000000000596.index
      rw-rr- 1 yye eng 3564 Oct 29 15:23 00000000000000000596.log

      1. kafka_593_v5.diff
        6 kB
        Yang Ye
      2. kafka_593_v4.diff
        4 kB
        Yang Ye
      3. kafka_593_v3.diff
        4 kB
        Yang Ye
      4. kafka_593_v2.diff
        3 kB
        Yang Ye
      5. kafka_593_v1.diff
        2 kB
        Yang Ye
      6. kafka_583_zk_kafka_data.tar.gz
        525 kB
        Yang Ye

        Issue Links

          Activity

          Yang Ye created issue -
          Yang Ye made changes -
          Field Original Value New Value
          Attachment kafka_583_zk_kafka_data.tar.gz [ 12551284 ]
          John Fung made changes -
          Link This issue blocks KAFKA-583 [ KAFKA-583 ]
          Yang Ye made changes -
          Attachment kafka_593_v1.diff [ 12551812 ]
          Yang Ye made changes -
          Attachment kafka_593_v2.diff [ 12551947 ]
          Yang Ye made changes -
          Attachment kafka_593_v3.diff [ 12551957 ]
          Yang Ye made changes -
          Attachment kafka_593_v4.diff [ 12552148 ]
          Yang Ye made changes -
          Attachment kafka_593_v4.diff [ 12552148 ]
          Yang Ye made changes -
          Attachment kafka_593_v4.diff [ 12552150 ]
          Yang Ye made changes -
          Attachment kafka_593_v5.diff [ 12552187 ]
          Neha Narkhede made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Tony Stevenson made changes -
          Workflow no-reopen-closed, patch-avail [ 12731890 ] Apache Kafka Workflow [ 13052875 ]
          Tony Stevenson made changes -
          Workflow Apache Kafka Workflow [ 13052875 ] no-reopen-closed, patch-avail [ 13054995 ]

            People

            • Assignee:
              Unassigned
              Reporter:
              Yang Ye
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development