Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-4645

Move from randomly generated block ID to sequentially generated block ID

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.0.0-alpha1
    • 2.1.0-beta
    • namenode
    • None
    • Reviewed

    Description

      Currently block IDs are randomly generated. This means there is no pattern to block ID generation and no guarantees such as uniqueness of block ID for the life time of the system can be made. I propose using SequentialNumber for block ID generation.

      Attachments

        1. editsStored
          4 kB
          Arpit Agarwal
        2. HDFS-4645.001.patch
          42 kB
          Arpit Agarwal
        3. HDFS-4645.002.patch
          79 kB
          Arpit Agarwal
        4. HDFS-4645.003.patch
          78 kB
          Arpit Agarwal
        5. HDFS-4645.004.patch
          80 kB
          Arpit Agarwal
        6. HDFS-4645.005.patch
          90 kB
          Arpit Agarwal
        7. HDFS-4645.006.patch
          94 kB
          Arpit Agarwal
        8. HDFS-4645.branch-2.patch
          95 kB
          Arpit Agarwal
        9. SequentialblockIDallocation.pdf
          68 kB
          Arpit Agarwal

        Issue Links

          duplicates

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-898 Sequential generation of block ids

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4967 Generate block ID sequentially cannot work with QJM HA

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue HDFS-4961 BlockId and Generation Stamp code should be moved to the blockmanagement package

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-5381 ExtendedBlock#hashCode should use both blockId and block pool ID

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Activity

            People

              arp Arpit Agarwal
              sureshms Suresh Srinivas
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: