Uploaded image for project: 'Hadoop Distributed Data Store'
  1. Hadoop Distributed Data Store
  2. HDDS-1535

Space tracking for Open Containers : Handle Node Startup

    XMLWordPrintableJSON

    Details

    • Sprint:
      HDDS Biscayne

      Description

      This is related to HDDS-1511

      Space tracking for Open Containers (committed space in the volume) relies on usedBytes in the Container state. usedBytes is not persisted for every update (chunkWrite). So on a node restart the value is stale.

      The proposal is to:
      iterate the block DB for each open container during startup and compute the used space.
      The block DB process will be accelerated by spawning executors for each container.
      This process will be carried out as part of building the container set during startup.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                sdeka Supratim Deka
                Reporter:
                sdeka Supratim Deka
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 2h
                  2h