Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-593

Empty log index file created when it shouldn't be empty

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • None
    • None

    Description

      We have met empty index file during system test when it shouldn't be empty. In this case, there're around 100 messages in each segment, each of size around 100 bytes, given the "logIndexIntervalBytes" 4096, there should be at least 2 log index entries, but we see empty index file. The kafka and zookeeper logs are attached

      [yye@yye-ld kafka_server_3_logs]$ cd test_1-2/
      [yye@yye-ld test_1-2]$ ls -l
      total 84
      rw-rr- 1 yye eng 8 Oct 29 15:22 00000000000000000000.index
      rw-rr- 1 yye eng 10248 Oct 29 15:22 00000000000000000000.log
      rw-rr- 1 yye eng 8 Oct 29 15:22 00000000000000000100.index
      rw-rr- 1 yye eng 10296 Oct 29 15:22 00000000000000000100.log
      rw-rr- 1 yye eng 0 Oct 29 15:23 00000000000000000200.index
      rw-rr- 1 yye eng 10293 Oct 29 15:23 00000000000000000200.log
      rw-rr- 1 yye eng 0 Oct 29 15:23 00000000000000000300.index
      rw-rr- 1 yye eng 10274 Oct 29 15:23 00000000000000000300.log
      rw-rr- 1 yye eng 0 Oct 29 15:23 00000000000000000399.index
      rw-rr- 1 yye eng 10276 Oct 29 15:23 00000000000000000399.log
      rw-rr- 1 yye eng 0 Oct 29 15:23 00000000000000000498.index
      rw-rr- 1 yye eng 10256 Oct 29 15:23 00000000000000000498.log
      rw-rr- 1 yye eng 10485760 Oct 29 15:23 00000000000000000596.index
      rw-rr- 1 yye eng 3564 Oct 29 15:23 00000000000000000596.log

      Attachments

        1. kafka_593_v5.diff
          6 kB
          Yang Ye
        2. kafka_593_v4.diff
          4 kB
          Yang Ye
        3. kafka_593_v3.diff
          4 kB
          Yang Ye
        4. kafka_593_v2.diff
          3 kB
          Yang Ye
        5. kafka_593_v1.diff
          2 kB
          Yang Ye
        6. kafka_583_zk_kafka_data.tar.gz
          525 kB
          Yang Ye

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            yeyangever Yang Ye
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment