Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12615

Router-based HDFS federation phase 2

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.2.0
    • Component/s: None
    • Labels:

      Description

      This umbrella JIRA tracks set of improvements over the Router-based HDFS federation (HDFS-10467).

        Attachments

          Issue Links

          1.
          RBF: Add WebHDFS Sub-task Resolved Wei Yan  
          2.
          RBF: Improve State Store FS implementation Sub-task Resolved Íñigo Goiri  
          3.
          RBF: Test Router-based federation using HDFSContract Sub-task Resolved Íñigo Goiri  
          4.
          RBF: Set MountTableResolver as default file resolver Sub-task Resolved Íñigo Goiri  
          5.
          RBF: Control MountTableResolver cache size Sub-task Resolved Íñigo Goiri  
          6.
          RBF: Fix Javadoc parameter errors Sub-task Resolved Wei Yan  
          7.
          RBF: Add router admin commands usage in HDFS commands reference doc Sub-task Resolved Yiqun Lin  
          8.
          RBF: Complete logic for -readonly option of dfsrouteradmin add command Sub-task Resolved Íñigo Goiri  
          9.
          RBF: Document Router and State Store metrics Sub-task Resolved Yiqun Lin  
          10.
          RBF: Add ACL support for mount table Sub-task Resolved Yiqun Lin  
          11.
          RBF: Add more unit tests for router admin commands Sub-task Resolved Yiqun Lin  
          12.
          RBF: Mount table entries not properly updated in the local cache Sub-task Resolved Íñigo Goiri  
          13.
          RBF: Support erasure coding methods in RouterRpcServer Sub-task Resolved Íñigo Goiri  
          14.
          RBF: Fix spurious TestRouterRpc#testProxyGetStats Sub-task Resolved Íñigo Goiri  
          15.
          RBF: Inconsistent Router OPTS config in branch-2 and branch-3 Sub-task Resolved Wei Yan  
          16.
          RBF: Fix doc error setting up client Sub-task Resolved tartarus

          0%

          Original Estimate - 24h
          Remaining Estimate - 24h
          17.
          RBF: Use the ZooKeeper as the default State Store Sub-task Resolved Yiqun Lin  
          18.
          RBF: Manage unavailable clusters Sub-task Resolved Yiqun Lin  
          19.
          RBF: Improve the unit test TestRouterRPCClientRetries Sub-task Resolved Yiqun Lin  
          20.
          RBF: Fix Routers information shown in the web UI Sub-task Resolved Wei Yan  
          21.
          RBF: Fix the hdfs router page missing label icon issue Sub-task Resolved maobaolong  
          22.
          RBF: Optimize name service safe mode icon Sub-task Resolved liuhongtong  
          23.
          RBF: Mount path not available after ADD-REMOVE-ADD Sub-task Resolved Wei Yan  
          24.
          RBF: Fix router location cache issue Sub-task Resolved Weiwei Wu  
          25.
          RBF: Complete document of Router configuration Sub-task Resolved Yiqun Lin  
          26.
          RBF: Move Router to its own module Sub-task Resolved Wei Yan  
          27.
          RBF: Resolvers to support mount points across multiple subclusters Sub-task Resolved Íñigo Goiri  
          28.
          RBF: Router to manage requests across multiple subclusters Sub-task Resolved Íñigo Goiri  
          29.
          RBF: Implement available space based OrderResolver Sub-task Resolved Yiqun Lin  
          30.
          RBF: Throw the exception if mount table entry validated failed Sub-task Resolved maobaolong  
          31.
          RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns Sub-task Resolved Chao Sun  
          32.
          RBF: ConnectionPool should return first usable connection Sub-task Resolved Ekanth Sethuramalingam  
          33.
          RBF: Update some inaccurate document descriptions Sub-task Resolved Yiqun Lin  
          34.
          RBF: Improve error message returned from subcluster Sub-task Resolved Íñigo Goiri  
          35.
          RBF: The RouterRPCServer should transfer CallerContext and client ip to NamenodeRpcServer Sub-task Patch Available Fei Hui  
          36.
          RBF: MountTableResolver doesn't return the correct mount point of the given path Sub-task Resolved wangzhiyuan  
          37.
          RBF: TestConnectionManager#testCleanup() test case need correction Sub-task Resolved Dibyendu Karmakar  
          38.
          RBF : Fix compilation error in branch-2 (TestMultipleDestinationResolver) Sub-task Resolved Brahma Reddy Battula  
          39.
          RBF: TestRouterAdminCLI#testCreateInvalidEntry fails on Windows Sub-task Resolved Íñigo Goiri  
          40.
          RBF: Fix FindBugs in hadoop-hdfs-rbf Sub-task Resolved Ekanth Sethuramalingam  
          41.
          RBF: Improve the interfaces to modify and view mount tables Sub-task Resolved Gang Li  
          42.
          RBF: Cache datanode reports Sub-task Resolved Íñigo Goiri  
          43.
          RBF: Add xsl stylesheet for hdfs-rbf-default.xml Sub-task Resolved Takanobu Asanuma  
          44.
          RBF: TestRouterWebHDFSContractCreate failed Sub-task Resolved Takanobu Asanuma  
          45.
          RBF: Support NamenodeProtocol in the Router Sub-task Resolved Íñigo Goiri  
          46.
          RBF: Improve timeout RPC call mechanism Sub-task Resolved Íñigo Goiri  
          47.
          RBF: Wrong date information in list file(-ls) result Sub-task Resolved Dibyendu Karmakar  
          48.
          RBF: Support federation with no subclusters Sub-task Resolved Íñigo Goiri  
          49.
          RBF: Fix java doc for StateStoreFileSystemImpl Sub-task Resolved Yiran Wu  
          50.
          RBF: Remove LinkedList From StateStoreFileImpl.java Sub-task Resolved BELUGA BEHR  
          51.
          RBF: Fix dead links in RBF document Sub-task Resolved Chetna Chaudhari  
          52.
          RBF: Improve the error loggings for printing the stack trace Sub-task Resolved Yiqun Lin  
          53.
          RBF: getMountPointDates should fetch latest subdir time/date when parent dir is not present but /parent/child dirs are present in mount table Sub-task Resolved Dibyendu Karmakar  
          54.
          RBF: Add more router-related information to the UI Sub-task Resolved Wei Yan  
          55.
          RBF: Disabled Nameservice store API Sub-task Resolved Íñigo Goiri  
          56.
          RBF: Disable Nameservices from the federation Sub-task Resolved Íñigo Goiri  
          57.
          RBF: Show disabled name services in the UI Sub-task Resolved Íñigo Goiri  
          58.
          RBF: Add unit test TestStateStoreDisabledNameservice Sub-task Resolved Yiqun Lin  
          59.
          RBF: Reject requests when a Router is overloaded Sub-task Resolved Íñigo Goiri  
          60.
          RBF: Fix setSafeMode in the Router Sub-task Resolved Íñigo Goiri  
          61.
          RBF: Normalize paths (automatically) when adding, updating, removing or listing mount table entries Sub-task Resolved Ekanth Sethuramalingam  
          62.
          RBF: Adding trace support Sub-task Resolved Íñigo Goiri  
          63.
          Add toString() for RemoteMethod Sub-task Resolved Chao Sun  
          64.
          RBF: Configurable value in xml for async connection request queue size. Sub-task Resolved CR Hota  
          65.
          RBF: Router fails when threadIndex (in ConnectionPool) wraps around Integer.MIN_VALUE Sub-task Resolved CR Hota  
          66.
          RBF: Fix RBF configuration links Sub-task Resolved Takanobu Asanuma  
          67.
          RBF: Add Web UI configurations and descriptions to RBF document Sub-task Resolved Takanobu Asanuma  
          68.
          RBF: Router throws NullPointerException due to the invalid initialization of MountTableResolver Sub-task Resolved Takanobu Asanuma  
          69.
          RBF: Router ID in RouterRpcClient is always null Sub-task Resolved Takanobu Asanuma  
          70.
          [Documentation] RBF: Mount points across multiple subclusters Sub-task Resolved Íñigo Goiri  
          71.
          RBF: Move ClientProtocol APIs to its own module Sub-task Patch Available Chao Sun  

            Activity

              People

              • Assignee:
                elgoiri Íñigo Goiri
                Reporter:
                elgoiri Íñigo Goiri
              • Votes:
                2 Vote for this issue
                Watchers:
                26 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - 24h
                  24h
                  Remaining:
                  Remaining Estimate - 24h
                  24h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified