XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.4.0
    • Fix Version/s: 0.4.2
    • Component/s: Ozone Recon
    • Labels:
      None
    • Target Version/s:

      Description

      Recon Server at a high level will maintain a global view of Ozone that is not available from SCM or OM. Things like how many volumes exist; and how many buckets exist per volume; which volume has maximum buckets; which are buckets that have not been accessed for a year, which are the corrupt blocks, which are blocks on data nodes which are not used; and answer similar queries.

        Attachments

        1. Ozone_Recon_Design_V1_Draft.pdf
          190 kB
          Siddharth Wagle

          Issue Links

          1.
          Create an OM API to serve snapshots to Recon server Sub-task Resolved Aravindan Vijayan

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 0.5h
          2.
          Add metric counters to capture the RocksDB checkpointing statistics. Sub-task Resolved Aravindan Vijayan

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 2h 10m
          3.
          Fix findbugs issues caused by HDDS-1085. Sub-task Resolved Aravindan Vijayan

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 40m
          4.
          Update DBCheckpointSnapshot to DBCheckpoint Sub-task Resolved Bharat Viswanadham

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 50m
          5.
          Implement a skeleton patch for Recon server with initial set of interfaces Sub-task Resolved Siddharth Wagle  
          6.
          Recon Container DB service definition Sub-task Resolved Aravindan Vijayan

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 10m
          7.
          Create an Ozone Manager Service provider for Recon. Sub-task Resolved Aravindan Vijayan  
          8.
          Iterate the OM DB snapshot and populate the recon container DB. Sub-task Resolved Aravindan Vijayan  
          9.
          Create Recon Server lifecyle integration with Ozone. Sub-task Resolved Vivek Ratnavel Subramanian

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 2.5h
          10.
          Add a docker compose for Ozone deployment with Recon. Sub-task Resolved Aravindan Vijayan

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 50m
          11.
          Recon Aggregate DB schema and ORM Sub-task Resolved Siddharth Wagle  
          12.
          Add List Containers API for Recon Sub-task Resolved Vivek Ratnavel Subramanian

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 4h 40m
          13.
          Recon Server REST API not working as expected. Sub-task Resolved Aravindan Vijayan

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h
          14.
          Recon start fails due to changes in Aggregate Schema definition (HDDS-1189). Sub-task Resolved Aravindan Vijayan

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 50m
          15.
          Bootstrap React framework for Recon UI Sub-task Resolved Vivek Ratnavel Subramanian

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 10m
          16.
          Create a Recon task interface that is used to update the aggregate DB whenever updates from OM are received. Sub-task Resolved Aravindan Vijayan

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 4.5h
          17.
          Recon: Add support for "start" query param to containers and containers/{id} endpoints Sub-task Resolved Vivek Ratnavel Subramanian

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 3h 40m
          18.
          Add limit support to /api/containers and /api/containers/{id} endpoints Sub-task Resolved Vivek Ratnavel Subramanian

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 5h 10m
          19.
          Add ability in OM to serve delta updates through an API. Sub-task Resolved Aravindan Vijayan

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 5h
          20.
          Recon: Add estimatedTotalCount to the response of containers and containers/{id} endpoints Sub-task Resolved Vivek Ratnavel Subramanian

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 4h
          21.
          Add mechanism in Recon to obtain DB snapshot 'delta' updates from Ozone Manager. Sub-task Resolved Aravindan Vijayan

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 3.5h
          22.
          Add ability in Recon to track the number of small files in an Ozone cluster. Sub-task Resolved Shweta

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 12h
          23.
          Add guice injection to Recon task framework. Sub-task Resolved Aravindan Vijayan  
          24.
          Fix kerberos principal error in Ozone Recon Sub-task Resolved Vivek Ratnavel Subramanian

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 2h 40m

            Activity

              People

              • Assignee:
                swagle Siddharth Wagle
                Reporter:
                swagle Siddharth Wagle
              • Votes:
                1 Vote for this issue
                Watchers:
                15 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 57h 50m
                  57h 50m