Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.4.1
    • Component/s: Ozone Datanode
    • Labels:
      None
    • Target Version/s:

      Description

      Included in the scope:
      1. Background scanner thread to iterate over container set and dispatch check tasks for individual containers
      2. Fixed rate scheduling - dispatch tasks at a pre-determined rate (for example 1 container/s)
      3. Check disk layout of Container - basic check for integrity of the directory hierarchy inside the container, include chunk directory and metadata directories
      4. Check container file - basic sanity checks for the container metafile
      5. Check Block Database - iterate over entries in the container block database and check for the existence and accessibility of the chunks for each block.

      Not in scope (will be done as separate subtasks):
      1. Dynamic scheduling/pacing of background scan based on system load and available resources.
      2. Detection and handling of orphan chunks
      3. Checksum verification for Chunks
      4. Corruption handling - reporting (to SCM) and subsequent handling of any corruption detected by the scanner. The current subtask will simply log any corruption which is detected.

        Attachments

        1. HDDS-1163.007.patch
          37 kB
          Supratim Deka
        2. HDDS-1163.006.patch
          37 kB
          Supratim Deka
        3. HDDS-1163.005.patch
          36 kB
          Supratim Deka
        4. HDDS-1163.004.patch
          41 kB
          Supratim Deka
        5. HDDS-1163.003.patch
          42 kB
          Supratim Deka
        6. HDDS-1163.002.patch
          48 kB
          Supratim Deka
        7. HDDS-1163.001.patch
          51 kB
          Supratim Deka
        8. HDDS-1163.000.patch
          40 kB
          Supratim Deka

          Activity

            People

            • Assignee:
              sdeka Supratim Deka
              Reporter:
              sdeka Supratim Deka
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: