Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-2106

Umbrella JIRA for separating block management and name space management in NameNode

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: namenode
    • Labels:
      None

      Description

      Namenode has two main components, block management and namespace management. The ultimate goal is to allow BM and NM running in separated servers. The short-term goal is to separate the codes.

      1. bm_api20110627.pdf
        53 kB
        Tsz Wo Nicholas Sze
      2. bm_api20110628.pdf
        54 kB
        Tsz Wo Nicholas Sze
      1.
      Move block management code to a package Sub-task Closed Tsz Wo Nicholas Sze
       
      2.
      Move datanode heartbeat handling to BlockManager Sub-task Closed Tsz Wo Nicholas Sze
       
      3.
      Move ReplicationMonitor to block management Sub-task Closed Uma Maheswara Rao G
       
      4.
      Move DecommissionManager to block management Sub-task Closed Tsz Wo Nicholas Sze
       
      5.
      Move Host2NodesMap to block management Sub-task Closed Tsz Wo Nicholas Sze
       
      6.
      Move cluster network topology to block management Sub-task Closed Tsz Wo Nicholas Sze
       
      7.
      Move dnsToSwitchMapping and hostsReader from FSNamesystem to DatanodeManager Sub-task Closed Tsz Wo Nicholas Sze
       
      8.
      Move datanodeMap from FSNamesystem to DatanodeManager Sub-task Closed Tsz Wo Nicholas Sze
       
      9.
      Move blockTokenSecretManager from FSNamesystem to BlockManager Sub-task Closed Uma Maheswara Rao G
       
      10.
      Set FSNamesystem.LOG to package private Sub-task Closed Tsz Wo Nicholas Sze
       
      11.
      Move block and datanode code from FSNamesystem to BlockManager and DatanodeManager Sub-task Closed Tsz Wo Nicholas Sze
       
      12.
      Change UnderReplicatedBlocks from public to package private Sub-task Closed Tsz Wo Nicholas Sze
       
      13.
      Reduce access levels of the fields and methods in FSNamesystem Sub-task Closed Tsz Wo Nicholas Sze
       
      14.
      Remove unnecessary BlockTokenSecretManager fields/methods from BlockManager Sub-task Closed Tsz Wo Nicholas Sze
       
      15.
      Add a Namesystem interface to avoid directly referring to FSNamesystem Sub-task Closed Tsz Wo Nicholas Sze
       
      16.
      Move datanodes size printing to BlockManager from FSNameSystem's metasave API Sub-task Closed Uma Maheswara Rao G
       
      17.
      Remove reference to FSNamesystem in blockmanagement classes Sub-task Closed Tsz Wo Nicholas Sze
       
      18.
      Clean up FSNamesystem and BlockManager Sub-task Closed Tsz Wo Nicholas Sze
       
      19.
      change INode to package private Sub-task Resolved John George
       
      20.
      change INode to package private Sub-task Resolved John George
       
      21.
      blockmanagement should stop using INodeFile & INodeFileUC Sub-task Resolved John George
       
      22.
      change variable names referring to inode in blockmanagement to more appropriate Sub-task Closed John George
       
      23.
      Change INodeFile and INodeFileUnderConstruction to package private Sub-task Closed Tsz Wo Nicholas Sze
       
      24.
      BlockId and Generation Stamp code should be moved to the blockmanagement package Sub-task Resolved Arpit Agarwal
       

        Activity

        Tsz Wo Nicholas Sze created issue -
        Tsz Wo Nicholas Sze made changes -
        Field Original Value New Value
        Description Namenode has two main components, block management and namespace management. The ultimate goal is to allow BM and NM running it separated servers. The short term goal is to separate the codes. Namenode has two main components, block management and namespace management. The ultimate goal is to allow BM and NM running in separated servers. The short-term goal is to separate the codes.
        Tsz Wo Nicholas Sze made changes -
        Attachment bm_api20110627.pdf [ 12484364 ]
        Tsz Wo Nicholas Sze made changes -
        Attachment bm_api20110628.pdf [ 12484570 ]
        Tsz Wo Nicholas Sze made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]

          People

          • Assignee:
            Tsz Wo Nicholas Sze
            Reporter:
            Tsz Wo Nicholas Sze
          • Votes:
            0 Vote for this issue
            Watchers:
            21 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development