Details

    • Type: New Feature
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      HDFS Scalability-v2.pdf describes areas where HDFS does well and its scaling challenges and how to address those challenges. Scaling HDFS requires scaling the namespace layer and also the block layer. This jira provides a new block layer,  Hadoop Distributed Storage Layer (HDSL), that scales the block layer by grouping blocks into containers thereby reducing the block-to-location map and also reducing the number of block reports and their processing

      A scalable namespace can be put on top this scalable block layer:

      • HDFS-10419 describes how the existing NN can be modified to use the new block layer.
      • HDFS-13074  also provides, as an interim step; a scalable flat Key-Value namespace  on top of the new block layer; while it does not provide the HDFS API, it does support the Hadoop FS APIs (Hadoop FileSystem, FileContext).

       

      Old Description

      This jira proposes to add object store capabilities into HDFS.
      As part of the federation work (HDFS-1052) we separated block storage as a generic storage layer. Using the Block Pool abstraction, new kinds of namespaces can be built on top of the storage layer i.e. datanodes.
      In this jira I will explore building an object store using the datanode storage, but independent of namespace metadata.

      I will soon update with a detailed design document.

        Attachments

        1. HadoopStorageLayerSecurity.pdf
          445 kB
          Anu Engineer
        2. HDFS-7240.001.patch
          5.83 MB
          Mukul Kumar Singh
        3. HDFS-7240.002.patch
          5.96 MB
          Mukul Kumar Singh
        4. HDFS-7240.003.patch
          5.96 MB
          Mukul Kumar Singh
        5. HDFS-7240.003.patch
          5.96 MB
          Mukul Kumar Singh
        6. HDFS-7240.004.patch
          5.96 MB
          Mukul Kumar Singh
        7. HDFS-7240.005.patch
          6.03 MB
          Mukul Kumar Singh
        8. HDFS-7240.006.patch
          6.13 MB
          Mukul Kumar Singh
        9. HDFS-7240.007.patch
          6.15 MB
          Lokesh Jain
        10. HDFS Scalability and Ozone.pdf
          328 kB
          Sanjay Radia
        11. HDFS Scalability-v2.pdf
          443 kB
          Sanjay Radia
        12. MeetingMinutes.pdf
          94 kB
          Anu Engineer
        13. ozone_user_v0.pdf
          4.48 MB
          Anu Engineer
        14. Ozone-architecture-v1.pdf
          1.60 MB
          Jitendra Nath Pandey
        15. Ozonedesignupdate.pdf
          970 kB
          Anu Engineer

          Issue Links

          1.
          DataNode support for multiple datasets Sub-task Resolved Arpit Agarwal
          2.
          Ozone: Introduce STORAGE_CONTAINER_SERVICE as a new NodeType. Sub-task Resolved Arpit Agarwal
          3.
          Ozone: Refactor FsDatasetSpi to pull up HDFS-agnostic functionality into parent interface Sub-task Closed Arpit Agarwal
          4.
          OzoneHandler : Add Quota Support Sub-task Resolved Anu Engineer
          5.
          Create REST Interface for Volumes Sub-task Resolved Anu Engineer
          6.
          OzoneHandler : Add Error Table Sub-task Resolved Anu Engineer
          7.
          OzoneHandler: Add userAuth Interface and Simple userAuth handler Sub-task Resolved Anu Engineer
          8.
          Ozone: fix the missing entries in hdfs script Sub-task Resolved Chen Liang
          9.
          Ozone: TestBlockPoolManager fails in ozone branch. Sub-task Resolved Chen Liang
          10.
          Ozone:SCM: Add support for registerNode in datanode Sub-task Resolved Anu Engineer
          11.
          OzoneHandler : Support List and Info Volumes Sub-task Resolved Anu Engineer
          12.
          Ozone: StorageContainerManager fails to compile after merge of HDFS-10312 maxDataLength enforcement. Sub-task Resolved Chris Nauroth
          13.
          Ozone: Add Ozone Client lib for volume handling Sub-task Resolved Anu Engineer
          14.
          Ozone: Support starting StorageContainerManager as a daemon Sub-task Resolved Arpit Agarwal
          15.
          Ozone : move Chunk IO and container protocol calls to hdfs-client Sub-task Resolved Chen Liang
          16.
          Ozone : fix XceiverClient slow shutdown Sub-task Resolved Chen Liang
          17.
          Ozone : move ozone XceiverClient to hdfs-client Sub-task Resolved Chen Liang
          18.
          Ozone: SCM: Add datanode protocol Sub-task Resolved Anu Engineer
          19.
          Ozone: TestEndpoint task failure Sub-task Resolved Xiaoyu Yao
          20.
          Ozone:SCM: Add support for registerNode in SCM Sub-task Resolved Anu Engineer
          21.
          Ozone : add client-facing container APIs and container references Sub-task Resolved Chen Liang
          22.
          OzoneHandler : Add volume handler Sub-task Resolved Anu Engineer
          23.
          Ozone: SCM: Make SCM use container protocol Sub-task Resolved Anu Engineer
          24.
          DataNode should filter the set of NameSpaceInfos passed to Datasets Sub-task Closed Arpit Agarwal
          25.
          OzoneHandler : Add ACL support Sub-task Resolved Anu Engineer
          26.
          Move DatasetSpi to new package Sub-task Closed Arpit Agarwal
          27.
          OzoneHandler : Add Local StorageHandler support for volumes Sub-task Resolved Anu Engineer
          28.
          Ozone: Introduce KeyValueContainerDatasetSpi Sub-task Closed Arpit Agarwal
          29.
          OzoneHandler : Add Volume Interface to Data Node HTTP Server Sub-task Resolved Kanaka Kumar Avvaru
          30.
          OzoneHandler : Add common bucket objects Sub-task Resolved Anu Engineer
          31.
          OzoneHandler: Integration of REST interface and container data pipeline back-end Sub-task Resolved Chris Nauroth
          32.
          OzoneHandler : Add Bucket REST Interface Sub-task Resolved Anu Engineer
          33.
          Ozone: Add small file support RPC Sub-task Resolved Anu Engineer
          34.
          Ozone: Cleanup some dependencies Sub-task Resolved Anu Engineer
          35.
          Ozone: use containers with the state machine Sub-task Resolved Anu Engineer
          36.
          Ozone: Add allocateContainer RPC Sub-task Resolved Anu Engineer
          37.
          Ozone: Unify StorageContainerConfiguration with ozone-default.xml & ozone-site.xml Sub-task Resolved Kanaka Kumar Avvaru
          38.
          OzoneHandler : Enable stand-alone local testing mode Sub-task Resolved Anu Engineer
          39.
          OzoneHandler : Add localStorageHandler support for Buckets Sub-task Resolved Anu Engineer
          40.
          OzoneHandler : Enable MiniDFSCluster based testing for Ozone Sub-task Resolved Anu Engineer
          41.
          Ozone: Add container definitions Sub-task Resolved Anu Engineer
          42.
          Exclude Ozone protobuf-generated classes from Findbugs analysis. Sub-task Resolved Chris Nauroth
          43.
          Ozone: Add container transport server Sub-task Resolved Anu Engineer
          44.
          Ozone: Add container transport client Sub-task Resolved Anu Engineer
          45.
          Stop tracking CHANGES.txt in the HDFS-7240 feature branch. Sub-task Resolved Chris Nauroth
          46.
          OzoneHandler : Add Key handler Sub-task Resolved Anu Engineer
          47.
          Ozone: Add Ozone Client lib for bucket handling Sub-task Resolved Anu Engineer
          48.
          ozone : Add volume commands to CLI Sub-task Resolved Anu Engineer
          49.
          Ozone : Add container dispatcher Sub-task Resolved Anu Engineer
          50.
          Ozone: Add buckets commands to CLI Sub-task Resolved Anu Engineer
          51.
          OzoneHandler : Add localstorage support for keys Sub-task Resolved Anu Engineer
          52.
          Ozone: Adding logging support Sub-task Resolved Anu Engineer
          53.
          Ozone: Refactor container Namespace Sub-task Resolved Anu Engineer
          54.
          Ozone : Enable better error reporting for failed commands in ozone shell Sub-task Resolved Anu Engineer
          55.
          ozone : Add key commands to CLI Sub-task Resolved Anu Engineer
          56.
          Ozone: Add container persistence Sub-task Resolved Anu Engineer
          57.
          Ozone: Implement storage container manager Sub-task Resolved Chris Nauroth
          58.
          Fix failing HDFS tests on HDFS-7240 Ozone branch. Sub-task Resolved Xiaobing Zhou
          59.
          Ozone : Add chunk persistance Sub-task Resolved Anu Engineer
          60.
          Ozone: Add key Persistence Sub-task Resolved Anu Engineer
          61.
          Ozone: end-to-end integration for create/get volumes, buckets and keys. Sub-task Resolved Chris Nauroth
          62.
          Ozone: Make config key naming consistent Sub-task Resolved Anu Engineer
          63.
          Ozone: Shutdown cleanly Sub-task Resolved Anu Engineer
          64.
          Ozone : exclude cblock protobuf files from findbugs check Sub-task Resolved Xiaoyu Yao
          65.
          Ozone : reuse Xceiver connection Sub-task Resolved Chen Liang
          66.
          Ozone : move StorageContainerLocation protocol to hdfs-client Sub-task Resolved Chen Liang
          67.
          Ozone: Add metrics for container operations and export over JMX Sub-task Resolved Mukul Kumar Singh
          68.
          Ozone:SCM: Add chill mode support to NodeManager. Sub-task Resolved Anu Engineer
          69.
          Ozone: Add paging support to list Volumes Sub-task Resolved Anu Engineer
          70.
          Ozone: Optimize key writes to chunks by providing a bulk write implementation in ChunkOutputStream. Sub-task Resolved Chris Nauroth
          71.
          Ozone: Introduce new config keys for SCM service endpoints Sub-task Resolved Arpit Agarwal
          72.
          Fix Ozone unit tests to use MiniOzoneCluster Sub-task Resolved Arpit Agarwal
          73.
          Ozone: SCM: Add NodeManager Sub-task Resolved Anu Engineer
          74.
          Ozone: TestContainerMapping needs to cleanup levelDB files Sub-task Resolved Xiaoyu Yao
          75.
          Ozone: SCM: Send node report to SCM with heartbeat Sub-task Resolved Xiaoyu Yao
          76.
          Ozone: Fix flaky TestNodeManager#testScmNodeReportUpdate Sub-task Resolved Xiaoyu Yao
          77.
          Ozone: SCM: Add negative tests cases for datanodeStatemachine Sub-task Resolved Weiwei Yang
          78.
          Ozone: Exclude container protobuf files from findbugs check Sub-task Resolved Yuanbo Liu
          79.
          Ozone: Fix Container test regression. Sub-task Resolved Anu Engineer
          80.
          Ozone: TestDatanodeStateMachine is failing intermittently Sub-task Resolved Weiwei Yang
          81.
          Ozone: Add protobuf definitions for container reports Sub-task Resolved Anu Engineer
          82.
          Ozone: Fix TestEndpoint test regression Sub-task Resolved Anu Engineer
          83.
          Ozone: Improve logging and error handling in the container layer Sub-task Resolved Anu Engineer
          84.
          Ozone:SCM: Support MXBean for SCM and NodeManager Sub-task Resolved Weiwei Yang
          85.
          Ozone: Separate XceiverServer and XceiverClient into interfaces and implementations Sub-task Resolved Tsz Wo Nicholas Sze
          86.
          Ozone: SCM: Move SCM config keys to ScmConfig Sub-task Resolved Weiwei Yang
          87.
          Ozone: SCM: Container allocation based on node report Sub-task Resolved Xiaoyu Yao
          88.
          Ozone: Fix TestContainerPersistence failures Sub-task Resolved Xiaoyu Yao
          89.
          Ozone: Fix TestDatanodeStateMachine#testDatanodeStateContext Sub-task Resolved Anu Engineer
          90.
          Ozone: SCM: Add close container RPC Sub-task Resolved Anu Engineer
          91.
          Ozone: Fix datanode ID handling in MiniOzoneCluster Sub-task Resolved Weiwei Yang
          92.
          Ozone: Add the ability to handle sendContainerReport Command Sub-task Resolved Anu Engineer
          93.
          Ozone: Merge with trunk needed a ignore duplicate entry in pom file due to shading Sub-task Resolved Tsz Wo Nicholas Sze
          94.
          Ozone: MiniOzoneCluster prints too many log messages by default Sub-task Resolved Tsz Wo Nicholas Sze
          95.
          Ozone: Add a check to prevent removing a container that has keys in it Sub-task Resolved Weiwei Yang
          96.
          Ozone: SCM: Add node pool management API Sub-task Resolved Xiaoyu Yao
          97.
          Ozone: SCM: Support update container Sub-task Resolved Weiwei Yang
          98.
          Ozone: close container should call compactDB Sub-task Resolved Anu Engineer
          99.
          Ozone: SCM: Add Comparable Metric Support Sub-task Resolved Anu Engineer
          100.
          Ozone: Implement XceiverServerSpi and XceiverClientSpi using Ratis Sub-task Resolved Tsz Wo Nicholas Sze
          101.
          Ozone: Document missing metrics for container operations Sub-task Resolved Yiqun Lin
          102.
          Ozone: Unit tests running failed in Windows Sub-task Resolved Yiqun Lin
          103.
          Ozone: Allocate container for MiniOzone cluster fails because of insufficient space error Sub-task Resolved Mukul Kumar Singh
          104.
          Ozone: Fix UT failures that caused by hard coded datanode data dirs Sub-task Resolved Weiwei Yang
          105.
          Ozone: support setting chunk size in streaming API Sub-task Resolved Yiqun Lin
          106.
          Ozone:SCM: Remove null command Sub-task Resolved Yuanbo Liu
          107.
          Ozone: TestContainerPlacement fails because of string mismatch in expected Message Sub-task Resolved Mukul Kumar Singh
          108.
          Ozone: Implement listKey function for KeyManager Sub-task Resolved Weiwei Yang
          109.
          Ozone: SCM: CLI: Design SCM Command line interface Sub-task Resolved Anu Engineer
          110.
          Ozone: Add unit test for storage container metrics Sub-task Resolved Yiqun Lin
          111.
          Ozone: Support force delete a container Sub-task Resolved Yuanbo Liu
          112.
          Ozone: SCM daemon is unable to be started via CLI Sub-task Resolved Weiwei Yang
          113.
          Ozone: SCM: CLI: Add shell code placeholder classes Sub-task Resolved Chen Liang
          114.
          Ozone: SCM: Add Block APIs Sub-task Resolved Xiaoyu Yao
          115.
          Ozone: Fix compile error due to inconsistent package name Sub-task Resolved Yiqun Lin
          116.
          Ozone: misc improvements for SCM CLI Sub-task Resolved Weiwei Yang
          117.
          Ozone: SCM: Support listContainers API Sub-task Resolved Xiaoyu Yao
          118.
          Ozone: SCM CLI: Implement delete container command Sub-task Resolved Weiwei Yang
          119.
          Ozone: add the DB names to OzoneConsts Sub-task Resolved Chen Liang
          120.
          Ozone: Revise create container CLI specification and implementation Sub-task Resolved Weiwei Yang
          121.
          Ozone:SCM: Add support for getContainer in SCM Sub-task Resolved Nanda kumar
          122.
          Ozone : need to fix OZONE_SCM_DEFAULT_PORT Sub-task Resolved Chen Liang
          123.
          Ozone: Reuse ObjectMapper instance to improve the performance Sub-task Resolved Yiqun Lin
          124.
          Ozone: SCM: CLI: Add Debug command Sub-task Resolved Chen Liang
          125.
          Ozone : SCMNodeManager#close() should also close node pool manager object Sub-task Resolved Chen Liang
          126.
          Ozone: Get container report should only report closed containers Sub-task Resolved Weiwei Yang
          127.
          Ozone: SCM: CLI: Revisit delete container API Sub-task Resolved Weiwei Yang
          128.
          Ozone : add DEBUG CLI support of blockDB file Sub-task Resolved Chen Liang
          129.
          Ozone: Add finer error codes for container operaions Sub-task Resolved Yiqun Lin
          130.
          Ozone: SCM CLI: Implement info container command Sub-task Resolved Yuanbo Liu
          131.
          Ozone: Fix spotbugs warnings Sub-task Resolved Weiwei Yang
          132.
          Ozone: Correct description for ozone.handler.type in ozone-default.xml Sub-task Resolved Mukul Kumar Singh
          133.
          Ozone : add DEBUG CLI support for nodepool db file Sub-task Resolved Chen Liang
          134.
          Ozone: KSM: Create Key Space manager service Sub-task Resolved Anu Engineer
          135.
          Ozone : add DEBUG CLI support for open container db file Sub-task Resolved Chen Liang
          136.
          Ozone: SCM: Support Delete Block Sub-task Resolved Xiaoyu Yao
          137.
          Ensure LevelDB DBIterator is closed Sub-task Resolved Chen Liang
          138.
          CBlockManager#main should join() after start() service Sub-task Resolved Chen Liang
          139.
          Ozone: Add archive support to containers Sub-task Resolved Anu Engineer
          140.
          Ozone: fix the consistently timeout test testUpgradeFromRel22Image Sub-task Resolved Chen Liang
          141.
          Ozone: Improve the way of getting test file path in unit tests for Windows Sub-task Resolved Yiqun Lin
          142.
          Ozone: Fix javac warnings Sub-task Resolved Yiqun Lin
          143.
          Ozone : add sql debug CLI to hdfs script Sub-task Resolved Chen Liang
          144.
          Ozone: XceiverClientRatis should implement XceiverClientSpi.connect() Sub-task Resolved Tsz Wo Nicholas Sze
          145.
          Ozone: SCM: SCMContainerPlacementCapacity#chooseNode sometimes does not remove chosen node from healthy list. Sub-task Resolved Xiaoyu Yao
          146.
          Ozone: Fix Http connection leaks in ozone clients Sub-task Resolved Weiwei Yang
          147.
          Ozone: Stack Overflow in XceiverClientManager because of race condition in accessing openClient Sub-task Resolved Mukul Kumar Singh
          148.
          Ozone: Datanode needs to re-register to SCM if SCM is restarted Sub-task Resolved Weiwei Yang
          149.
          Ozone : need to refactor StorageContainerLocationProtocolServerSideTranslatorPB Sub-task Resolved Chen Liang
          150.
          Ozone : implement StorageContainerManager#getStorageContainerLocations Sub-task Resolved Chen Liang
          151.
          Ozone: KSM: Add createVolume API Sub-task Resolved Mukul Kumar Singh
          152.
          Ozone: KSM: Add setVolumeProperty Sub-task Resolved Mukul Kumar Singh
          153.
          Ozone: KSM : add createBucket Sub-task Resolved Nanda kumar
          154.
          Ozone: KSM: add getBucketInfo Sub-task Resolved Nanda kumar
          155.
          Ozone: SCM: Separate BlockLocationProtocol from ContainerLocationProtocol Sub-task Resolved Xiaoyu Yao
          156.
          Ozone: KSM : Add putKey Sub-task Resolved Chen Liang
          157.
          Ozone: Do not initialize Ratis cluster during datanode startup Sub-task Resolved Tsz Wo Nicholas Sze
          158.
          Ozone: CLI: Guarantees user runs SCM commands has appropriate permission Sub-task Resolved Weiwei Yang
          159.
          Ozone: KSM: Add getKey Sub-task Resolved Chen Liang
          160.
          Ozone: KSM: add SetBucketProperty Sub-task Resolved Nanda kumar
          161.
          Ozone:KSM : add deleteVolume Sub-task Resolved Mukul Kumar Singh
          162.
          Ozone: Differentiate time interval for different DatanodeStateMachine state tasks Sub-task Resolved Weiwei Yang
          163.
          Ozone: Cleaning up local storage when closing MiniOzoneCluster Sub-task Resolved Mingliang Liu
          164.
          Ozone: Cleanup imports Sub-task Resolved Weiwei Yang
          165.
          Ozone: Add Ratis management API Sub-task Resolved Tsz Wo Nicholas Sze
          166.
          Ozone: TestKeySpaceManager#testDeleteVolume fails Sub-task Resolved Weiwei Yang
          167.
          Ozone: MiniOzoneCluster should set "ozone.handler.type" key correctly Sub-task Resolved Mukul Kumar Singh
          168.
          Ozone: KSM: Add checkVolumeAccess Sub-task Resolved Mukul Kumar Singh
          169.
          Ozone: KSM: Add deleteKey Sub-task Resolved Yuanbo Liu
          170.
          Ozone: SCM: TestNodeManager takes too long to execute Sub-task Resolved Yiqun Lin
          171.
          Shared XceiverClient should be closed if there is no open clients to avoid resource leak Sub-task Resolved Mukul Kumar Singh
          172.
          Ozone: Create metadata path automatically after null checking Sub-task Resolved Mukul Kumar Singh
          173.
          Ozone: Implement a common helper to return a range of KVs in levelDB Sub-task Resolved Weiwei Yang
          174.
          Ozone: KSM: add deleteBucket Sub-task Resolved Nanda kumar
          175.
          Ozone: KSM: Remove protobuf formats from KSM wrappers Sub-task Resolved Nanda kumar
          176.
          Ozone: KSM: add listBuckets Sub-task Resolved Weiwei Yang
          177.
          Ozone: Fix TestContainerSQLCli#testConvertContainerDB Sub-task Resolved Weiwei Yang
          178.
          Remove Guava v21 usage from HDFS-7240 Sub-task Resolved Xiaoyu Yao
          179.
          Ozone: remove disabled tests Sub-task Resolved Anu Engineer
          180.
          Ozone: Output error when DN handshakes with SCM Sub-task Resolved Weiwei Yang
          181.
          Ozone: Ensure KSM is initiated using ProtobufRpcEngine Sub-task Resolved Weiwei Yang
          182.
          Ozone: Containers in different datanodes are mapped to the same location Sub-task Resolved Nanda kumar
          183.
          Ozone: Add start-ozone.sh to quickly start ozone. Sub-task Resolved Weiwei Yang
          184.
          Ozone: Add stop-ozone.sh script Sub-task Resolved Weiwei Yang
          185.
          Ozone: cannot enable test debug/trace log Sub-task Resolved Tsz Wo Nicholas Sze
          186.
          Ozone: TestContainerPersistence never uses MiniOzoneCluster Sub-task Resolved Tsz Wo Nicholas Sze
          187.
          Ozone: KSM: Add listKey Sub-task Resolved Yiqun Lin
          188.
          Ozone: Support force update a container Sub-task Resolved Yuanbo Liu
          189.
          Ozone: Clarify startup error message of Datanode in case namenode is missing Sub-task Resolved Elek, Marton
          190.
          Ozone: Documentation: Add getting started page Sub-task Resolved Anu Engineer
          191.
          Ozone: Add documentation for metrics in KSMMetrics to OzoneMetrics.md Sub-task Resolved Yiqun Lin
          192.
          Ozone: TestXceiverClientManager.testFreeByEviction fails occasionally Sub-task Resolved Mukul Kumar Singh
          193.
          Ozone: SCM: Container metadata are not loaded properly after datanode restart Sub-task Resolved Xiaoyu Yao
          194.
          Ozone: Recover SCM state when SCM is restarted Sub-task Resolved Anu Engineer
          195.
          Ozone: Add all configurable entries into ozone-default.xml Sub-task Resolved Yiqun Lin
          196.
          Ozone: Encapsulate KSM metadata key for better (de)serialization Sub-task Resolved Weiwei Yang
          197.
          Ozone: Enable HttpServer2 for SCM and KSM Sub-task Resolved Elek, Marton
          198.
          Ozone: Misc: Add CBlocks defaults to ozone-defaults.xml Sub-task Resolved Chen Liang
          199.
          Ozone: CLI: remove noisy slf4j binding output from hdfs oz command. Sub-task Resolved Chen Liang
          200.
          Ozone: Rename OzoneClient to OzoneRestClient Sub-task Resolved Nanda kumar
          201.
          Ozone: StorageHandler: Implementation of "close" for releasing resources during shutdown Sub-task Resolved Nanda kumar
          202.
          Ozone: Ozone shell: Multiple RPC calls for put/get key Sub-task Resolved Yiqun Lin
          203.
          Ozone: KSM : add listVolumes Sub-task Resolved Weiwei Yang
          204.
          Ozone: Set proper parameter default values for listBuckets http request Sub-task Resolved Weiwei Yang
          205.
          Ozone : SCM cli misc fixes/improvements Sub-task Resolved Chen Liang
          206.
          Ozone: CLI: support infoKey command Sub-task Resolved Yiqun Lin
          207.
          Ozone: Test if all the configuration keys are documented in ozone-defaults.xml Sub-task Resolved Elek, Marton
          208.
          Ozone: ozone server should create missing metadata directory if it has permission to Sub-task Resolved Weiwei Yang
          209.
          Ozone: Add REST API documentation Sub-task Resolved Weiwei Yang
          210.
          Ozone:TestOzoneContainerRatis & TestRatisManager are failing consistently Sub-task Resolved Mukul Kumar Singh
          211.
          Ozone: listKey doesn't work from ozone commandline Sub-task Resolved Yiqun Lin
          212.
          Ozone: Add infoKey REST API document Sub-task Resolved Weiwei Yang
          213.
          Ozone: Add the unit test for KSMMetrics Sub-task Resolved Yiqun Lin
          214.
          Ozone: Review all cases where we are returning FAILED_INTERNAL_ERROR Sub-task Resolved Chen Liang
          215.
          Ozone: OzoneClient: Implementation of OzoneClient Sub-task Resolved Nanda kumar
          216.
          Ozone: SCM CLI: Implement list container command Sub-task Resolved Yuanbo Liu
          217.
          Ozone: Improvement rest API output format for better looking Sub-task Resolved Weiwei Yang
          218.
          Ozone: Fix UT failure in TestOzoneConfigurationFields Sub-task Resolved Mukul Kumar Singh
          219.
          Ozone: listVolumes doesn't work from ozone commandline Sub-task Resolved Yiqun Lin
          220.
          Ozone: Bucket versioning design document Sub-task Resolved Weiwei Yang
          221.
          Ozone: SCM http server is not stopped with SCM#stop() Sub-task Resolved Weiwei Yang
          222.
          Ozone: KSM: previous key has to be excluded from result in listVolumes, listBuckets and listKeys Sub-task Resolved Nanda kumar
          223.
          Ozone: SCM: Add the ability to handle container reports Sub-task Resolved Anu Engineer
          224.
          Ozone: OzoneClient: Abstraction of OzoneClient and default implementation Sub-task Resolved Nanda kumar
          225.
          Ozone: add TestKeysRatis, TestBucketsRatis and TestVolumeRatis Sub-task Resolved Tsz Wo Nicholas Sze
          226.
          Ozone: KSM: Cleanup of keys in KSM for failed clients Sub-task Resolved Anu Engineer
          227.
          Ozone: Create a general abstraction for metadata store Sub-task Resolved Weiwei Yang
          228.
          Ozone: TestOzoneConfigurationFields is failing because ozone-default.xml has some missing properties Sub-task Resolved Weiwei Yang
          229.
          Ozone: Ozone shell: Add more testing for volume shell commands Sub-task Resolved Yiqun Lin
          230.
          Ozone: OzoneClient: OzoneClientImpl add getDetails calls Sub-task Resolved Nanda kumar
          231.
          Ozone : add an UT to test partial read of chunks Sub-task Resolved Chen Liang
          232.
          Ozone: Ozone shell: Add more testing for bucket shell commands Sub-task Resolved Yiqun Lin
          233.
          Ozone: Corona: Implementation of Corona Sub-task Resolved Nanda kumar
          234.
          Ozone: RocksDB implementation of ozone metadata store Sub-task Resolved Weiwei Yang
          235.
          Ozone: Ozone shell: Add more testing for key shell commands Sub-task Resolved Yiqun Lin
          236.
          Ozone: TestNodeManager times out before it is able to find all nodes Sub-task Resolved Yuanbo Liu
          237.
          Ozone: Fix TestContainerReplicationManager by setting proper log level for LogCapturer Sub-task Resolved Mukul Kumar Singh
          238.
          Ozone: Fix Leaking in TestStorageContainerManager#testRpcPermission Sub-task Resolved Xiaoyu Yao
          239.
          Ozone: Fix Leaking in TestXceiverClientManager Sub-task Resolved Xiaoyu Yao
          240.
          Ozone: SCM: Add queryNode RPC Call Sub-task Resolved Anu Engineer
          241.
          Ozone: OzoneFileSystem: Ozone & KSM should support "/" delimited key names Sub-task Resolved Mukul Kumar Singh
          242.
          Ozone: OzoneFileSystem: KSM should maintain key creation time and modification time Sub-task Resolved Mukul Kumar Singh
          243.
          Ozone: Corona: Add stats and progress bar to corona Sub-task Resolved Nanda kumar
          244.
          Ozone : add RocksDB support to DEBUG CLI Sub-task Resolved Chen Liang
          245.
          Ozone: Intermittent failure TestContainerPersistence#testListKey Sub-task Resolved Surendra Singh Lilhore
          246.
          Ozone: Fix the remaining failure tests for Windows caused by incorrect path generated Sub-task Resolved Yiqun Lin
          247.
          Ozone : add support to DEBUG CLI for ksm.db Sub-task Resolved Chen Liang
          248.
          Ozone: OzoneClient: OzoneClientImpl Add setBucketProperty and delete calls Sub-task Resolved Nanda kumar
          249.
          Ozone: KSM : Use proper defaults for block client address Sub-task Resolved Lokesh Jain
          250.
          Ozone: Corona: Adding corona as part of hdfs command Sub-task Resolved Nanda kumar
          251.
          Ozone : add key partition Sub-task Resolved Chen Liang
          252.
          Ozone: DeleteKey-1: KSM replies delete key request asynchronously Sub-task Resolved Yuanbo Liu
          253.
          Ozone: Web interface for KSM Sub-task Resolved Elek, Marton
          254.
          Ozone: Ensures listKey lists all required key fields Sub-task Resolved Yiqun Lin
          255.
          OzoneClientUtils#updateListenAddress should use server address to update listening addrees Sub-task Resolved Surendra Singh Lilhore
          256.
          Ozone: Support asynchronus client API for SCM and containers Sub-task Resolved Anu Engineer
          257.
          Ozone: TestStorageContainerManager#testRpcPermission fails when ipv6 address used Sub-task Resolved Yiqun Lin
          258.
          Ozone: OzoneClient: Handling SCM container creationFlag at client side Sub-task Resolved Nanda kumar
          259.
          Ozone: KeySpaceManager should unregister KSMMetrics upon stop Sub-task Resolved Yiqun Lin
          260.
          Ozone: Reduce MiniOzoneCluster handler thread count Sub-task Resolved Weiwei Yang
          261.
          Ozone: potential thread leaks Sub-task Resolved Weiwei Yang
          262.
          Ozone: KSM: Add creation time field in volume info Sub-task Resolved Yiqun Lin
          263.
          Ozone: KSM: Reduce default handler thread count from 200 Sub-task Resolved Ajay Kumar
          264.
          Ozone: OzoneClient: Refactor and move ozone client from hadoop-hdfs to hadoop-hdfs-client Sub-task Resolved Nanda kumar
          265.
          Ozone: XceiverClientManager should not close the connection if client holds the reference Sub-task Resolved Nanda kumar
          266.
          Ozone : add debug cli to hdfs script Sub-task Resolved Chen Liang
          267.
          Ozone: Corona: move corona from test to tools package Sub-task Resolved Nanda kumar
          268.
          Ozone: DeleteKey-2: Implement block deleting service to delete stale blocks at background Sub-task Resolved Weiwei Yang
          269.
          Ozone: Extend MBeans utility to add any key value pairs to the registered MXBeans Sub-task Resolved Elek, Marton
          270.
          Ozone: Ozone-default.xml has 3 properties that do not match the default Config value Sub-task Resolved Ajay Kumar
          271.
          Ozone: Web interface for SCM Sub-task Resolved Elek, Marton
          272.
          Ozone: KSM: Add creation time field in bucket info Sub-task Resolved Yiqun Lin
          273.
          Ozone: Block deletion service floods the log when deleting large number of block files Sub-task Resolved Yiqun Lin
          274.
          Ozone: Add valid trace ID check in sendCommandAsync Sub-task Resolved Ajay Kumar
          275.
          Ozone: SCM: Add StateMachine for pipeline/container Sub-task Resolved Xiaoyu Yao
          276.
          Ozone: TestKeys#testPutAndGetKeyWithDnRestart fails Sub-task Resolved Weiwei Yang
          277.
          Ozone: SCM: Add create replication pipeline RPC Sub-task Resolved Anu Engineer
          278.
          Ozone: Implement update volume owner in ozone shell Sub-task Resolved Lokesh Jain
          279.
          Ozone: SCM: move container/pipeline StateMachine to the right package Sub-task Resolved Xiaoyu Yao
          280.
          Ozone: TestKeys is failing consistently Sub-task Resolved Mukul Kumar Singh
          281.
          Ozone: support setting timeout in background service Sub-task Resolved Yiqun Lin
          282.
          Ozone: the static cache provided by ContainerCache does not work in Unit tests Sub-task Resolved Anu Engineer
          283.
          Ozone: Concurrent RocksDB open calls fail because of "No locks available" Sub-task Resolved Mukul Kumar Singh
          284.
          Ozone: DeleteKey-5: Implement SCM DeletedBlockLog Sub-task Resolved Yuanbo Liu
          285.
          Ozone: SCM: use state machine for open containers allocated for key/blocks Sub-task Resolved Xiaoyu Yao
          286.
          Ozone: TestQueryNode#testStaleNodesCount is failing. Sub-task Resolved Xiaoyu Yao
          287.
          Ozone: TestOzoneContainer#testCreateOzoneContainer fails Sub-task Resolved Lokesh Jain
          288.
          TestKeys#testPutAndGetKeyWithDnRestart failed Sub-task Resolved Mukul Kumar Singh
          289.
          Ozone: maven dist compilation fails with "Duplicate classes found" error Sub-task Resolved Mukul Kumar Singh
          290.
          Ozone: Corona: Support for random validation of writes Sub-task Resolved Nanda kumar
          291.
          Ozone: DeleteKey-4: Block delete between SCM and DN Sub-task Resolved Weiwei Yang
          292.
          Ozone: ListVolume displays incorrect createdOn time when the volume was created by OzoneRpcClient Sub-task Resolved Weiwei Yang
          293.
          Ozone: Shuffle container list for datanode BlockDeletingService Sub-task Resolved Yiqun Lin
          294.
          Ozone: SCM failed to start when a container metadata is empty Sub-task Resolved Weiwei Yang
          295.
          Ozone: Refactor KSM metadata class names to avoid confusion Sub-task Resolved Weiwei Yang
          296.
          Ozone: Fix TestArchive#testArchive Sub-task Resolved Xiaoyu Yao
          297.
          Ozone: Extend Datanode web interface with SCM information Sub-task Resolved Elek, Marton
          298.
          Ozone: Too many open files error while running corona Sub-task Resolved Nanda kumar
          299.
          Ozone: OzoneFileSystem: OzoneFileystem initialization code Sub-task Resolved Mukul Kumar Singh
          300.
          Ozone: TestKSMSQLCli is not working as expected Sub-task Resolved Weiwei Yang
          301.
          Ozone: SCM: BlockManager creates a new container for each allocateBlock call Sub-task Resolved Nanda kumar
          302.
          Ozone: Storage container data pipeline Sub-task Resolved Jitendra Nath Pandey
          303.
          Ozone: Datanode is unable to register with scm if scm starts later Sub-task Resolved Weiwei Yang
          304.
          Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions Sub-task Resolved Weiwei Yang
          305.
          Ozone: Implement TopN container choosing policy for BlockDeletionService Sub-task Resolved Yiqun Lin
          306.
          Ozone: oz commandline list calls should return valid JSON format output Sub-task Resolved Weiwei Yang
          307.
          Ozone: KSM: Garbage collect deleted blocks Sub-task Resolved Weiwei Yang
          308.
          Ozone: OzoneClient: Refactoring OzoneClient API Sub-task Resolved Nanda kumar
          309.
          Ozone: KSM: Unable to put keys with zero length Sub-task Resolved Mukul Kumar Singh
          310.
          Add markdown documentation about Ozone Sub-task Resolved Mukul Kumar Singh
          311.
          Ozone: Object store handler supports reusing http client for multiple requests. Sub-task Resolved Xiaoyu Yao
          312.
          Ozone: Cleanup Checkstyle issues Sub-task Resolved Shashikant Banerjee
          313.
          Ozone: TopN container choosing policy should ignore containers that has no pending deletion blocks Sub-task Resolved Yiqun Lin
          314.
          Ozone: SCM CLI: Implement close container command Sub-task Resolved Chen Liang
          315.
          Ozone: KSM: set creationTime for volume/bucket/key Sub-task Resolved Mukul Kumar Singh
          316.
          Ozone: Implement the trace ID generator Sub-task Resolved Yiqun Lin
          317.
          Ozone: OzoneClient : Remove createContainer handling from client Sub-task Resolved Yuanbo Liu
          318.
          Ozone: SCM: Container State Machine -1- Track container creation state in SCM Sub-task Resolved Xiaoyu Yao
          319.
          Ozone: KSM: multiple delete methods in KSMMetadataManager Sub-task Resolved Nanda kumar
          320.
          Ozone: Corona: Support for variable key length in offline mode Sub-task Resolved Nanda kumar
          321.
          Ozone: fix a KeySpaceManager startup message typo Sub-task Resolved Nanda kumar
          322.
          Ozone: fix hard coded version in the Ozone GettingStarted guide Sub-task Resolved Elek, Marton
          323.
          Ozone: Fix TestXceiverClientMetrics#testMetrics Sub-task Resolved Yiqun Lin
          324.
          Ozone: TestAllocateContainer fails on jenkins Sub-task Resolved Weiwei Yang
          325.
          Ozone: Misc : Make sure that ozone-site.xml is in etc/hadoop in tarball created from mvn package. Sub-task Resolved Mukul Kumar Singh
          326.
          Ozone: Ozone data placement is not even Sub-task Resolved Weiwei Yang
          327.
          Ozone: Add metrics for pending storage container requests Sub-task Resolved Yiqun Lin
          328.
          Ozone: Ratis: Readonly calls in XceiverClientRatis should use sendReadOnly Sub-task Resolved Mukul Kumar Singh
          329.
          Ozone : the sample ozone-site.xml in OzoneGettingStarted does not work Sub-task Resolved Chen Liang
          330.
          Ozone: SCM: NodeManager should log when it comes out of chill mode Sub-task Resolved Nanda kumar
          331.
          Ozone : handle inactive containers on DataNode Sub-task Resolved Chen Liang
          332.
          Ozone: Container: Move IPC port to 98xx range Sub-task Resolved Nanda kumar
          333.
          Ozone: Support Ratis as a first class replication mechanism Sub-task Resolved Anu Engineer
          334.
          Ozone: OzoneFileSystem: read/write/create/open/getFileInfo APIs Sub-task Resolved Mukul Kumar Singh
          335.
          Ozone: List Key on an empty ozone bucket fails with command failed error Sub-task Resolved Lokesh Jain
          336.
          Ozone: More detailed documentation about the ozone components Sub-task Resolved Elek, Marton
          337.
          Ozone: OzoneClient: Add list calls in RpcClient Sub-task Resolved Nanda kumar
          338.
          OzoneFileSystem: A Hadoop file system implementation for Ozone Sub-task Resolved Mukul Kumar Singh
          339.
          Ozone: enforce DependencyConvergence uniqueVersions Sub-task Resolved Tsz Wo Nicholas Sze
          340.
          Ozone: KSM: Make "ozone.ksm.address" as mandatory property for client Sub-task Resolved Nanda kumar
          341.
          Ozone: KSM: Changing log level for client calls in KSM Sub-task Resolved Shashikant Banerjee
          342.
          Ozone: OzoneRestClientException swallows exceptions which makes client hard to debug failures Sub-task Resolved Weiwei Yang
          343.
          Ozone: Cleanup findbugs issues Sub-task Resolved Mukul Kumar Singh
          344.
          Ozone: Cleanup javadoc issues Sub-task Resolved Mukul Kumar Singh
          345.
          Ozone: OzoneRestClient timeout is not configurable Sub-task Resolved Weiwei Yang
          346.
          Ozone: Cleanup javac issues Sub-task Resolved Yiqun Lin
          347.
          Ozone: some UX improvements to oz_debug Sub-task Resolved Weiwei Yang
          348.
          Ozone: Revert files not related to ozone change in HDFS-7240 branch Sub-task Resolved Mukul Kumar Singh
          349.
          Ozone: mvn package compilation fails on HDFS-7240 Sub-task Resolved Mukul Kumar Singh
          350.
          Ozone: mvn package is failing with out skipshade Sub-task Resolved Bharat Viswanadham
          351.
          Ozone: ListBucket is too slow Sub-task Resolved Weiwei Yang
          352.
          Ozone: Create UI page to show Ozone configs by tags Sub-task Resolved Ajay Kumar
          353.
          Ozone: DB listing operation performance improvement Sub-task Resolved Weiwei Yang
          354.
          Ozone: Add tags to config Sub-task Closed Ajay Kumar
          355.
          Ozone: Record number of keys scanned and hinted for getRangeKVs call Sub-task Resolved Weiwei Yang
          356.
          Ozone: OzoneClient: Verify bucket/volume name in create calls Sub-task Resolved Nanda kumar
          357.
          javadoc: error - class file for org.apache.http.annotation.ThreadSafe not found Sub-task Resolved Mukul Kumar Singh
          358.
          Ozone: Reduce key creation overhead in Corona Sub-task Resolved Lokesh Jain
          359.
          Ozone: node status text reported by SCM is a bit confusing Sub-task Resolved Weiwei Yang
          360.
          Ozone: Create docker-compose definition to easily test real clusters Sub-task Resolved Elek, Marton
          361.
          Ozone: refactor some functions in KSMMetadataManagerImpl to be more readable and reusable Sub-task Resolved Yuanbo Liu
          362.
          Ozone: Improve the formatting of the RPC stats on web UI Sub-task Resolved Elek, Marton
          363.
          Ozone: Add ASF license to docker files Sub-task Resolved Mukul Kumar Singh
          364.
          Ozone : allow create key without specifying size Sub-task Resolved Chen Liang
          365.
          Ozone: Some minor text improvement in SCM web UI Sub-task Resolved Elek, Marton
          366.
          Ozone: Fix TestDatanodeStateMachine#testDatanodeStateMachineWithInvalidConfiguration Sub-task Resolved Ajay Kumar
          367.
          Ozone: TestBlockDeletingService#testBlockDeletionTimeout sometimes timeout Sub-task Resolved Weiwei Yang
          368.
          Ozone: Documentation: Add Ozone overview documentation. Sub-task Resolved Anu Engineer
          369.
          Ozone: SCM: Open containers are not reused for block allocation after restart Sub-task Resolved Lokesh Jain
          370.
          Ozone: Creation time wrongly showed in OzoneRest.md Sub-task Resolved Yiqun Lin
          371.
          Ozone: update Ratis to the latest snapshot Sub-task Resolved Tsz Wo Nicholas Sze
          372.
          Ozone: Cleanup the ozone-default.xml Sub-task Resolved Anu Engineer
          373.
          Ozone: Reduce some KSM/SCM deletion log messages from INFO to DEBUG Sub-task Resolved Weiwei Yang
          374.
          Add Ozone config UI to KSM and SCM index page Sub-task Resolved Ajay Kumar
          375.
          Ozone: Fix swallow exceptions which makes hard to debug failures Sub-task Resolved Yiqun Lin
          376.
          Ozone: ContainerStorageLocation#scmUsage should count only SCM usage Sub-task Resolved Xiaoyu Yao
          377.
          Ozone: SCM Cli: Use the hostname of SCM server instead of the bind address Sub-task Resolved Elek, Marton
          378.
          Ozone: OzoneClient: RpcClient list calls throw NPE when iterating over empty list Sub-task Resolved Nanda kumar
          379.
          Ozone: SCM: Refactoring of chill mode logic in NodeManager Sub-task Resolved Nanda kumar
          380.
          Ozone: remove spaces from the beginning of the hdfs script Sub-task Resolved Elek, Marton
          381.
          Ozone: Fix 3 node ratis replication in Ozone Sub-task Resolved Mukul Kumar Singh
          382.
          Ozone: OzoneFileSystem: delete/list status/rename/mkdir APIs Sub-task Resolved Mukul Kumar Singh
          383.
          Ozone: Remove Warnings when building Sub-task Resolved Bharat Viswanadham
          384.
          Ozone : add documentation about Datanode http address Sub-task Resolved Lokesh Jain
          385.
          Ozone: Lease Manager framework Sub-task Resolved Nanda kumar
          386.
          Ozone: Mini cluster can't start up on Windows after HDFS-12159 Sub-task Resolved Yiqun Lin
          387.
          Ozone: OzoneClient: Add creation/modification time information in OzoneVolume/OzoneBucket/OzoneKey Sub-task Resolved Mukul Kumar Singh
          388.
          Ozone: Add container usage information to DN container report Sub-task Resolved Xiaoyu Yao
          389.
          Ozone: TestXceiverClientManager and TestAllocateContainer occasionally fails Sub-task Resolved Mukul Kumar Singh
          390.
          Ozone: OzoneFileSystem: Add contract tests to OzoneFileSystem Sub-task Resolved Mukul Kumar Singh
          391.
          Ozone: Support optional documentation link in KSM/SCM webui Sub-task Resolved Elek, Marton
          392.
          Ozone: KSM UI: Add description for configs in UI Sub-task Resolved Ajay Kumar
          393.
          Ozone: Log elapsed time for block deletion tasks Sub-task Resolved Yiqun Lin
          394.
          Ozone: dozone: Use (proposed) base image from HADOOP-14898 Sub-task Resolved Elek, Marton
          395.
          Ozone: SCM: Lease support for container creation Sub-task Resolved Nanda kumar
          396.
          Ozone: Clarify the meaning of rpc.metrics.percentiles.intervals on KSM/SCM web ui Sub-task Resolved Elek, Marton
          397.
          Ozone: Add hugo to the dev docker image Sub-task Resolved Elek, Marton
          398.
          Ozone: SCM: Add Node Metrics for SCM Sub-task Resolved Yiqun Lin
          399.
          Ozone: SCM should read all Container info into memory when booting up Sub-task Resolved Lokesh Jain
          400.
          Ozone: OzoneClient: Remove protobuf classes exposed to clients through OzoneBucket Sub-task Resolved Nanda kumar
          401.
          Ozone: use specific names for RPC.Server instances Sub-task Resolved Elek, Marton
          402.
          Ozone: SCMMXBean NodeCount is overlapping with NodeManagerMXBean Sub-task Resolved Weiwei Yang
          403.
          Ozone: SCM: Clean up of container in DELETING state Sub-task Resolved Nanda kumar
          404.
          Ozone: generate swagger descriptor for the Ozone REST Api Sub-task Resolved Elek, Marton
          405.
          Ozone: Decrease interval time of SCMBlockDeletingService for improving the efficiency Sub-task Resolved Yiqun Lin
          406.
          Ozone: Enable XFrame options for KSM/SCM web ui Sub-task Resolved Elek, Marton
          407.
          Ozone: TestLeaseManager#testLeaseCallbackWithMultipleLeases fails Sub-task Resolved Yiqun Lin
          408.
          Ozone: fix javadoc/unit test for calling MetadataStore.getRangeKVs with non existing key Sub-task Resolved Elek, Marton
          409.
          Ozone: Corona: Add statistical information to json output Sub-task Resolved Lokesh Jain
          410.
          Ozone: Fix Ozone's env vars (again) Sub-task Resolved Allen Wittenauer
          411.
          Ozone: SCM: Handling container report with key count and container usage. Sub-task Resolved Nanda kumar
          412.
          Ozone: Improve SCM block deletion throttling algorithm Sub-task Resolved Yiqun Lin
          413.
          Add Support for SCM --init command Sub-task Resolved Shashikant Banerjee
          414.
          Use GenericOptionsParser for scm and ksm daemon Sub-task Resolved Elek, Marton
          415.
          Ozone: Fix inconsistent default value in ozone settings Sub-task Resolved Bharat Viswanadham
          416.
          Ozone: add logger for oz shell commands and move error stack traces to DEBUG level Sub-task Resolved Yiqun Lin
          417.
          Ozone services must stay disabled in secure setup for alpha Sub-task Resolved Bharat Viswanadham
          418.
          Ozone: Add timeunit for ozone.scm.heartbeat.interval.seconds in ozone-default.xml Sub-task Resolved Bharat Viswanadham
          419.
          Ozone: add port/service names to the ksm/scm web ui Sub-task Resolved Elek, Marton
          420.
          Ozone: scm web: fix the node status table Sub-task Resolved Elek, Marton
          421.
          Ozone : TestSCMCli is failing consistently Sub-task Resolved Chen Liang
          422.
          Ozone: KSM: ADD support for KSM --createObjectStore command Sub-task Resolved Shashikant Banerjee
          423.
          Ozone: SCM: Aggregate the metrics from all the container reports Sub-task Resolved Yiqun Lin
          424.
          Ozone: TestOzoneConfigurationFields fails consistently Sub-task Resolved Yiqun Lin
          425.
          Ozone: SCM: BlockManagerImpl close is called twice during StorageContainerManager#stop Sub-task Resolved Nanda kumar
          426.
          Ozone: Expose RockDB stats via JMX for Ozone metadata stores Sub-task Resolved Elek, Marton
          427.
          Ozone: Turn off full synced write in RocksDB MetadataStore Sub-task Resolved Elek, Marton
          428.
          Ozone: TestOzoneRpcClient#testPutKeyRatisThreeNodes fails Sub-task Resolved Yiqun Lin
          429.
          Ozone: SCM: During startup SCM should check if the cluster is INITIALIZED Sub-task Resolved Nanda kumar
          430.
          Ozone: TestContainerPersistence#testListContainer fails frequently due to timed out Sub-task Resolved Yiqun Lin
          431.
          Ozone: moving NodeType from OzoneConsts to Ozone.proto Sub-task Resolved Nanda kumar
          432.
          Ozone: Upgrade to latest ratis build Sub-task Resolved Mukul Kumar Singh
          433.
          Ozone: SCM: Expose StorageContainerManager#getScmId through container protocol Sub-task Resolved Nanda kumar
          434.
          Ozone: OzoneClient: Support for REST protocol Sub-task Resolved Nanda kumar
          435.
          Ozone : delete open key entries that will no longer be closed Sub-task Resolved Chen Liang
          436.
          Ozone: Ratis options are not passed from KSM Client protobuf helper correctly. Sub-task Resolved Mukul Kumar Singh
          437.
          Ozone: Container : Add key versioning support-1 Sub-task Resolved Chen Liang
          438.
          Ozone: Add datanodeID to heartbeat responses and container protocol Sub-task Resolved Anu Engineer
          439.
          Ozone: Use time units in the Ozone configuration values Sub-task Resolved Elek, Marton
          440.
          Ozone: TestSCMCli#testHelp and TestSCMCli#testNonExistCommand fail consistently Sub-task Resolved Shashikant Banerjee
          441.
          Ozone: SCM: Close containers: extend SCMCommandResponseProto with SCMCloseContainerCmdResponseProto Sub-task Resolved Elek, Marton
          442.
          Ozone: SCM: Support for Container LifeCycleState PENDING_CLOSE and LifeCycleEvent FULL_CONTAINER Sub-task Resolved Nanda kumar
          443.
          Ozone: SCM: update container allocated size to container db for all the open containers in ContainerStateManager#close Sub-task Resolved Chen Liang
          444.
          Ozone : better handling of operation fail due to chill mode Sub-task Resolved Unassigned
          445.
          Ozone: Fix TestStorageContainerManager#testBlockDeletionTransactions Sub-task Resolved Xiaoyu Yao
          446.
          Ozone: OzoneClient: Moving OzoneException from hadoop-hdfs to hadoop-hdfs-client Sub-task Resolved Nanda kumar
          447.
          Ozone: Redundant characters printed in exception log Sub-task Resolved Yiqun Lin
          448.
          Ozone: web: integrate configuration reader page to the SCM/KSM web ui. Sub-task Resolved Elek, Marton
          449.
          Ozone: Fix checkstyle, javac, whitespace issues in HDFS-7240 branch Sub-task Resolved Mukul Kumar Singh
          450.
          Ozone: XceiverClient should have upper bound on async requests Sub-task Resolved Shashikant Banerjee
          451.
          SCM should not start if Cluster Version file does not exist Sub-task Resolved Shashikant Banerjee
          452.
          Ozone: write chunk call fails because of Metrics registry exception Sub-task Resolved Mukul Kumar Singh
          453.
          Ozone: Optimize chunk writes for Ratis by avoiding double writes Sub-task Resolved Mukul Kumar Singh
          454.
          Ozone: Service Discovery: RPC endpoint in KSM for getServiceList Sub-task Resolved Nanda kumar
          455.
          Ozone: ConfServlet does not trim values during the description parsing Sub-task Resolved Elek, Marton
          456.
          SCM should support a RPC to share the cluster Id with KSM and DataNodes Sub-task Resolved Shashikant Banerjee
          457.
          Ozone: Fix TestKeySpaceManager#testKSMInitializationFailure Sub-task Resolved Xiaoyu Yao
          458.
          Ozone: TestContainerPersistence is failing becaue of container data mismatch Sub-task Resolved Mukul Kumar Singh
          459.
          Ozone: Client: TestOzoneRpcClient#testPutKeyRatisThreeNodes is failing Sub-task Resolved Mukul Kumar Singh
          460.
          Ozone : TestSCMCli and TestContainerStateManager tests are failing consistently while updating the container state info. Sub-task Resolved Shashikant Banerjee
          461.
          Ozone: remove setAllocatedBytes method in ContainerInfo Sub-task Resolved Chen Liang
          462.
          Ozone: Service Discovery: REST endpoint in KSM for getServiceList Sub-task Resolved Nanda kumar
          463.
          Ozone: Use relative resource urls in KSM/SCM web ui Sub-task Resolved Elek, Marton
          464.
          Ozone: owner name should be set properly when the container allocation happens Sub-task Resolved Shashikant Banerjee
          465.
          Ozone: SCM: Restructuring container state transition and events Sub-task Resolved Nanda kumar
          466.
          Ozone: Service Discovery: Adding REST server details in ServiceList Sub-task Resolved Nanda kumar
          467.
          Fix closeContainer API with the right container state change Sub-task Resolved Xiaoyu Yao
          468.
          Ozone: Avoid configuration.get() call for each container report Sub-task Resolved Akira Ajisaka
          469.
          Ozone : add scm init command to document. Sub-task Resolved Rahul Pathak
          470.
          TestOzoneConfigurationFields fails due to missing configs in ozone-default.xml Sub-task Resolved Xiaoyu Yao
          471.
          Ozone: ContainerStateMachine should synchronize operations between createContainer and writeChunk Sub-task Resolved Mukul Kumar Singh
          472.
          Ozone: DatanodeStateMachine: Handling Uncaught Exception in command handler thread Sub-task Resolved Nanda kumar
          473.
          Ozone: KSM: TestKeySpaceManager#testExpiredOpenKey fails occasionally Sub-task Resolved Nanda kumar
          474.
          Ozone : Add an API to get Open Container by Owner, Replication Type and Replication Count Sub-task Resolved Shashikant Banerjee
          475.
          Ozone: dozone: initialize scm and ksm directory on cluster startup Sub-task Resolved Elek, Marton
          476.
          Ozone: Service Discovery API Sub-task Resolved Nanda kumar
          477.
          Ozone: Remove the Priority Queues used in the Container State Manager Sub-task Resolved Anu Engineer
          478.
          Ozone: Update ozone to latest ratis snapshot build (0.1.1-alpha-0f7169d-SNAPSHOT) Sub-task Resolved Lokesh Jain
          479.
          Ozone: XceiverClientManager should cache objects based on pipeline name Sub-task Patch Available Mukul Kumar Singh
          480.
          Ozone: Improve SQLCLI performance Sub-task Patch Available Yuanbo Liu
          481.
          Ozone: Documentation: Add version specific documentation site to KSM Sub-task Resolved Anu Engineer
          482.
          Ozone: Container : Add key versioning support-2 Sub-task Patch Available Chen Liang
          483.
          Ozone: Non-admin user is unable to run InfoVolume to the volume owned by itself Sub-task In Progress Lokesh Jain
          484.
          Ozone: KSM: Allocate key should honour volume quota if quota is set on the volume Sub-task In Progress Lokesh Jain
          485.
          Ozone : debug cli: add support to load user-provided SQL query Sub-task In Progress Chen Liang
          486.
          Ozone: Container : Add key versioning support-3 Sub-task In Progress Chen Liang
          487.
          Ozone : add read/write random access to Chunks of a key Sub-task In Progress Chen Liang
          488.
          Ozone: Container : Add key versioning support-4 Sub-task In Progress Chen Liang
          489.
          Ozone: Parallelize ChunkOutputSream Writes to container Sub-task Patch Available Shashikant Banerjee
          490.
          Make ContainerStateMachine#applyTransaction async Sub-task Patch Available Lokesh Jain
          491.
          Ozone: TestContainerPersistence#testListContainer sometimes timeout Sub-task Resolved Ajay Kumar
          492.
          Ozone: generate optional, version specific documentation during the build Sub-task Resolved Elek, Marton
          493.
          Ozone: SCM: avoid synchronously loading all the keys from containers upon SCM datanode start Sub-task Open Xiaoyu Yao
          494.
          Ozone: Ratis: Moving Ratis pipeline creation to client Sub-task Open Unassigned
          495.
          Ozone: write deleted block to RAFT log for consensus on datanodes Sub-task Open Unassigned
          496.
          Ozone: Documentation: Add Ozone-defaults documentation Sub-task Open Ajay Kumar
          497.
          Ozone: Purge metadata of deleted blocks after max retry times Sub-task Open Yuanbo Liu
          498.
          Ozone: SCM CLI: Implement get container metrics command Sub-task Open Yuanbo Liu
          499.
          Ozone: fix and reenable TestKeysRatis#testPutAndGetKeyWithDnRestart Sub-task Open Mukul Kumar Singh
          500.
          Ozone: Support range in getKey operation Sub-task Open Mukul Kumar Singh
          501.
          Ozone: Fix the Cluster ID generation code in SCM Sub-task Resolved Shashikant Banerjee
          502.
          Ozone:SCM: explore if we need 3 maps for tracking the state of nodes Sub-task Open Unassigned
          503.
          Ozone: SCM: Handle duplicate Datanode ID Sub-task Resolved Anu Engineer
          504.
          Ozone: add TestDistributedOzoneVolumesRatis, TestOzoneRestWithMiniClusterRatis and TestOzoneWebAccessRatis Sub-task Open Tsz Wo Nicholas Sze
          505.
          Ozone: SCM: clean up containers that timeout during creation Sub-task Open Xiaoyu Yao
          506.
          Ozone: In Ratis, leader should validate ContainerCommandRequestProto before propagating it to followers Sub-task Open Tsz Wo Nicholas Sze
          507.
          Ozone: Ozone shell: the root is assumed to hdfs Sub-task Open Shashikant Banerjee
          508.
          Ozone: change TestRatisManager to check cluster with data Sub-task Open Tsz Wo Nicholas Sze
          509.
          Ozone: Container server needs enhancements to control of bind address for greater flexibility and testability. Sub-task Resolved Anu Engineer
          510.
          Ozone:SCM: Add support for close containers in SCM Sub-task Resolved Anu Engineer
          511.
          Ozone: Refactor Pipeline to have transport and container specific information Sub-task Resolved Mukul Kumar Singh
          512.
          Ozone : Optimize putKey operation to be async and consensus Sub-task Open Weiwei Yang
          513.
          Ozone: provide a way to validate ContainerCommandRequestProto Sub-task Open Anu Engineer
          514.
          ChunkManager functions do not use the argument keyName Sub-task Open Chen Liang
          515.
          Ozone: Replace Jersey container with Netty Container Sub-task Resolved Anu Engineer
          516.
          Ozone: Document ozone metadata directory structure Sub-task Open Xiaoyu Yao
          517.
          OZone: SCM CLI: Implement get container command Sub-task Open Chen Liang
          518.
          Ozone: Compact DB should be called on Open Containers. Sub-task Open Weiwei Yang
          519.
          Ozone: Support SCM multiple instance for HA Sub-task Open Anu Engineer
          520.
          Ozone:KSM: Add setVolumeAcls to allow adding/removing acls from a KSM volume Sub-task Resolved Mukul Kumar Singh
          521.
          Ozone: KSM : Support for simulated file system operations Sub-task Open Shashikant Banerjee
          522.
          Ozone: Handle potential inconsistent states while listing keys Sub-task Open Weiwei Yang
          523.
          Ozone: Corona: Support for online mode Sub-task Open Nanda kumar
          524.
          Ozone: Add client Block cache for SCM Sub-task Open Mukul Kumar Singh
          525.
          Ozone: Put key operation concurrent executes failed on Windows Sub-task Open Unassigned
          526.
          Ozone: SCM: Lease support for pipeline creation Sub-task Open Unassigned
          527.
          Ozone: OzoneFileSystem: Add StorageStatistics to OzoneFileSystem Sub-task Open Mukul Kumar Singh
          528.
          Ozone: start-all script is missing ozone start Sub-task Resolved Bharat Viswanadham
          529.
          Ozone: SCM: Make container report processing async Sub-task Open Unassigned
          530.
          Ozone: SCM: ContainerStateManager#updateContainerState updates incorrect AllocatedBytes to container info. Sub-task Resolved Nanda kumar
          531.
          Ozone: Documentation : Add ksm -createObjectStore command documentation. Sub-task Resolved Shashikant Banerjee
          532.
          Ozone: Service Discovery: Limit the number of datanodes (REST servers) returned by KeySpaceManager#getServiceList call Sub-task Open Unassigned
          533.
          Ozone: Add support for Larger key sizes in Corona Sub-task Open Mukul Kumar Singh
          534.
          Ozone: Make finalhash in ContainerInfo of StorageContainerDatanodeProtocol.proto optional Sub-task Resolved Elek, Marton
          535.
          Ozone: OzoneFileSystem: Implement seek functionality for rest client Sub-task Open Lokesh Jain
          536.
          Ozone: TestContainerPersistence#testMultipleWriteSingleRead and TestContainerPersistence#testOverWrite fail consistently Sub-task Resolved Shashikant Banerjee
          537.
          Ozone: Add DN container open/close state to container report Sub-task Resolved Xiaoyu Yao
          538.
          Ozone: OzoneClient: Add configuration parameter to choose RestServerSelector implementation which will be used by RestClient Sub-task Open Unassigned
          539.
          Ozone: TestKeys, TestKeysRatis and TestOzoneShell are failing because of read timeout Sub-task Resolved Mukul Kumar Singh
          540.
          Ozone: Update the allocatedBlock size in SCM when delete blocks happen. Sub-task Resolved Unassigned
          541.
          Ozone: SCM: Support for container replica reconciliation - 1 Sub-task Resolved Nanda kumar
          542.
          Ozone: JMX name of RocksDbMetastore should be sanitized Sub-task Patch Available Elek, Marton
          543.
          Ozone: Handle datanode failures in Storage Container Manager Sub-task Patch Available Shashikant Banerjee
          544.
          Ozone: Format open containers on datanode restart Sub-task Patch Available Lokesh Jain
          545.
          Ozone: DeleteContainer call in SCM does not remove the container info from the container inmemory maps. Sub-task Open Shashikant Banerjee
          546.
          Ozone: Rename Corona to Freon Sub-task Resolved Anu Engineer
          547.
          Ozone: Make hadoop-common ozone free Sub-task Resolved Ajay Kumar
          548.
          Ozone: restructure Hdsl/Ozone code to separated maven subprojects Sub-task Resolved Elek, Marton
          549.
          Ozone: Make ozone/hdsl/cblock modules turned off by default Sub-task Resolved Elek, Marton
          550.
          Ozone: Remove DatanodeID dependency from HDSL and Ozone Sub-task Resolved Nanda kumar
          551.
          Ozone: Remove containerPort, ratisPort and ozoneRestPort from DatanodeID and DatanodeIDProto Sub-task Resolved Shashikant Banerjee
          552.
          Ozone: fix classpath of yarn components Sub-task Resolved Elek, Marton
          553.
          Document: update the new ozone docker file location Sub-task Resolved Xiaoyu Yao
          554.
          Ozone: Improve error message in case of missing nodes Sub-task Resolved Elek, Marton
          555.
          Ozone: Update the ksm/scm CLI usage info Sub-task Resolved Xiaoyu Yao
          556.
          Ozone: docker-compose should only be copied to hadoop-dist if Phdsl is enabled. Sub-task Resolved Xiaoyu Yao
          557.
          Ozone: start-ozone.sh/stop-ozone.sh fail because of unresolved path Sub-task Resolved Mukul Kumar Singh
          558.
          Ozone:Support for MicrobenchMarking Tool Sub-task Resolved Shashikant Banerjee
          559.
          Ozone: Remove InfoPort and InfoSecurePort from DatanodeDetails Sub-task Resolved Shashikant Banerjee
          560.
          Ozone: update log4j.properties changes for hdsl/ozone. Sub-task Resolved Xiaoyu Yao
          561.
          Ozone: Introduce a new SCM Exception which will be thrown when mandatory property is missing Sub-task Patch Available LiXin Ge
          562.
          Ozone: Store only datanode UUID in datanode.id file Sub-task Open Unassigned
          563.
          Ozone: remove hdsl/cblock/ozone source code from the official apache source release artifact Sub-task Resolved Elek, Marton
          564.
          Ozone: Fix false positive RAT warning when project built without hds/cblock Sub-task Resolved Elek, Marton
          565.
          Ozone: Move ozone specific ServiceRuntimeInfo utility to the framework Sub-task Resolved Elek, Marton
          566.
          Ozone: Provide docker based acceptance testing on pseudo cluster Sub-task Resolved Elek, Marton
          567.
          Ozone: Update IP and hostname in Datanode from SCM's response to the register call Sub-task Resolved Shashikant Banerjee
          568.
          Add config for min percentage of data nodes to come out of chill mode in SCM Sub-task Resolved Bharat Viswanadham
          569.
          Ozone: Remove commands from command queue when the datanode is declared dead Sub-task Open Shashikant Banerjee
          570.
          Ozone: The configuration of implement of DataNodeServicePlugin should obtain from datanode instance Sub-task Resolved Anu Engineer
          571.
          Ozone: Make dependency of internal sub-module scope as provided in maven. Sub-task Resolved Nanda kumar
          572.
          Ozone: ContainerID has incorrect package name Sub-task Resolved Lokesh Jain
          573.
          Ozone: Plugins support in HDSL Datanode Service Sub-task Resolved Nanda kumar
          574.
          Ozone: Rename and fix ozone CLI scripts Sub-task Resolved Shashikant Banerjee
          575.
          Ozone: Rename HDSL to HDDS Sub-task Resolved Anu Engineer
          576.
          Ozone: Use separated version schema for Hdds/Ozone projects Sub-task Resolved Elek, Marton
          577.
          Ozone: Update existing Ozone documentation according to the recent changes Sub-task Resolved Elek, Marton
          578.
          Ozone: Remove cblock code from HDFS-7240 Sub-task