Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1497

Write pipeline sequence numbers should be sequential with no skips or duplicates

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Abandoned
    • 0.20-append, 0.22.0
    • None
    • hdfs-client
    • None

    Description

      In HDFS-895 we discovered that multiple hflush() calls in a row without intervening writes could cause a skip in sequence number. This doesn't seem to have any direct consequences, but we should maintain and assert the invariant that sequence numbers have no gaps or duplicates.

      Attachments

        1. hdfs-1497.txt
          7 kB
          Todd Lipcon
        2. hdfs-1497.txt
          6 kB
          Todd Lipcon
        3. hdfs-1497.txt
          11 kB
          Todd Lipcon
        4. hdfs-1497.txt
          11 kB
          Todd Lipcon
        5. hdfs-1497.txt
          11 kB
          Todd Lipcon

        Issue Links

          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-7058 Expose number of bytes in FSOutputSummer buffer to implementatins

          • Trivial - Cosmetic problem like misspelt words or misaligned text.
          • Closed
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-895 Allow hflush/sync to occur in parallel with new writes to the file

          • Major - Major loss of function.
          • Closed

          Activity

            People

              tlipcon Todd Lipcon
              tlipcon Todd Lipcon
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: