Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-2106

Umbrella JIRA for separating block management and name space management in NameNode

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: namenode
    • Labels:
      None

      Description

      Namenode has two main components, block management and namespace management. The ultimate goal is to allow BM and NM running in separated servers. The short-term goal is to separate the codes.

      1. bm_api20110627.pdf
        53 kB
        Tsz Wo Nicholas Sze
      2. bm_api20110628.pdf
        54 kB
        Tsz Wo Nicholas Sze
      1.
      Move block management code to a package Sub-task Closed Tsz Wo Nicholas Sze
       
      2.
      Move datanode heartbeat handling to BlockManager Sub-task Closed Tsz Wo Nicholas Sze
       
      3.
      Move ReplicationMonitor to block management Sub-task Closed Uma Maheswara Rao G
       
      4.
      Move DecommissionManager to block management Sub-task Closed Tsz Wo Nicholas Sze
       
      5.
      Move Host2NodesMap to block management Sub-task Closed Tsz Wo Nicholas Sze
       
      6.
      Move cluster network topology to block management Sub-task Closed Tsz Wo Nicholas Sze
       
      7.
      Move dnsToSwitchMapping and hostsReader from FSNamesystem to DatanodeManager Sub-task Closed Tsz Wo Nicholas Sze
       
      8.
      Move datanodeMap from FSNamesystem to DatanodeManager Sub-task Closed Tsz Wo Nicholas Sze
       
      9.
      Move blockTokenSecretManager from FSNamesystem to BlockManager Sub-task Closed Uma Maheswara Rao G
       
      10.
      Set FSNamesystem.LOG to package private Sub-task Closed Tsz Wo Nicholas Sze
       
      11.
      Move block and datanode code from FSNamesystem to BlockManager and DatanodeManager Sub-task Closed Tsz Wo Nicholas Sze
       
      12.
      Change UnderReplicatedBlocks from public to package private Sub-task Closed Tsz Wo Nicholas Sze
       
      13.
      Reduce access levels of the fields and methods in FSNamesystem Sub-task Closed Tsz Wo Nicholas Sze
       
      14.
      Remove unnecessary BlockTokenSecretManager fields/methods from BlockManager Sub-task Closed Tsz Wo Nicholas Sze
       
      15.
      Add a Namesystem interface to avoid directly referring to FSNamesystem Sub-task Closed Tsz Wo Nicholas Sze
       
      16.
      Move datanodes size printing to BlockManager from FSNameSystem's metasave API Sub-task Closed Uma Maheswara Rao G
       
      17.
      Remove reference to FSNamesystem in blockmanagement classes Sub-task Closed Tsz Wo Nicholas Sze
       
      18.
      Clean up FSNamesystem and BlockManager Sub-task Closed Tsz Wo Nicholas Sze
       
      19.
      change INode to package private Sub-task Resolved John George
       
      20.
      change INode to package private Sub-task Resolved John George
       
      21.
      blockmanagement should stop using INodeFile & INodeFileUC Sub-task Resolved John George
       
      22.
      change variable names referring to inode in blockmanagement to more appropriate Sub-task Closed John George
       
      23.
      Change INodeFile and INodeFileUnderConstruction to package private Sub-task Closed Tsz Wo Nicholas Sze
       
      24.
      BlockId and Generation Stamp code should be moved to the blockmanagement package Sub-task Resolved Arpit Agarwal
       

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Tsz Wo Nicholas Sze
            Reporter:
            Tsz Wo Nicholas Sze
          • Votes:
            0 Vote for this issue
            Watchers:
            21 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development