Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8031 Follow-on work for erasure coding phase I (striping layout)
  3. HDFS-8558

Remove the use of hard-coded cell size value in balancer Dispatcher

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • HDFS-7285
    • None
    • None

    Description

      This is part of work in HDFS-8494. To make it easy and discuss this case better, open this issue to remove the use of hard-coded cell size value in balancer Dispatcher separately. Also copied some good comments here:

      From walter.k.su:

      It's easy to pass cellSize from BlockInfoStriped to Dispatcher. But the question is BlockInfoStriped doesn't have it.
      You have to get it by: BlockInfoStriped --> getBlockCollection --> getZone --> getCellSize. A bit complicated, isn't it?
      I think BlockInfoStriped needs to keep cellSize.

      From vinayrpet:

      I too was thinking the same when the FSImageLoader problem has came up. This will increase the memory usage by ~4bytes for each block though.

      Attachments

        Issue Links

          Activity

            People

              walter.k.su Walter Su
              drankye Kai Zheng
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: