[HDDS-1084] Ozone Recon Service V0.1

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.4.0
• Fix Version/s: 0.5.0
• Component/s: Ozone Recon
• Target Version/s: 0.5.0
• Assignee: Siddharth Wagle
• Reporter: Siddharth Wagle
• Created: 11/Feb/19 19:15
• Updated: 24/Feb/20 20:51
• Resolved: 15/Nov/19 18:52

Description

Recon Server at a high level will maintain a global view of Ozone that is not available from SCM or OM. Things like how many volumes exist; and how many buckets exist per volume; which volume has maximum buckets; which are buckets that have not been accessed for a year, which are the corrupt blocks, which are blocks on data nodes which are not used; and answer similar queries.

Issue Links

• Parent Feature: HDDS-1996 Ozone Recon Service v0.2

Sub-Tasks

• Create an OM API to serve snapshots to Recon server: Resolved
• Add metric counters to capture the RocksDB checkpointing statistics.: Resolved
• Fix findbugs issues caused by HDDS-1085.: Resolved
• Update DBCheckpointSnapshot to DBCheckpoint: Resolved
• Implement a skeleton patch for Recon server with initial set of interfaces: Resolved
• Recon Container DB service definition: Resolved
• Create an Ozone Manager Service provider for Recon.: Resolved
• Iterate the OM DB snapshot and populate the recon container DB.: Resolved
• Create Recon Server lifecyle integration with Ozone.: Resolved
• Add a docker compose for Ozone deployment with Recon.: Resolved
• Recon Aggregate DB schema and ORM: Resolved
• Add List Containers API for Recon: Resolved
• Recon Server REST API not working as expected.: Resolved
• Recon start fails due to changes in Aggregate Schema definition (HDDS-1189).: Resolved
• Bootstrap React framework for Recon UI: Resolved
• Create a Recon task interface that is used to update the aggregate DB whenever updates from OM are received.: Resolved
• Recon: Add support for "start" query param to containers and containers/{id} endpoints: Resolved
• Add limit support to /api/containers and /api/containers/{id} endpoints: Resolved
• Add ability in OM to serve delta updates through an API.: Resolved
• Recon: Add estimatedTotalCount to the response of containers and containers/{id} endpoints: Resolved
• Add mechanism in Recon to obtain DB snapshot 'delta' updates from Ozone Manager.: Resolved
• Add ability in Recon to track the number of small files in an Ozone cluster.: Resolved
• Add guice injection to Recon task framework.: Resolved
• Fix kerberos principal error in Ozone Recon: Resolved