Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12615

Router-based HDFS federation phase 2

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.2.0
    • None

    Description

      This umbrella JIRA tracks set of improvements over the Router-based HDFS federation (HDFS-10467).

      Attachments

        Issue Links

          1.
          RBF: Add WebHDFS Sub-task Resolved Wei Yan  
          2.
          RBF: Improve State Store FS implementation Sub-task Resolved Íñigo Goiri  
          3.
          RBF: Test Router-based federation using HDFSContract Sub-task Resolved Íñigo Goiri  
          4.
          RBF: Set MountTableResolver as default file resolver Sub-task Resolved Íñigo Goiri  
          5.
          RBF: Control MountTableResolver cache size Sub-task Resolved Íñigo Goiri  
          6.
          RBF: Fix Javadoc parameter errors Sub-task Resolved Wei Yan  
          7.
          RBF: Add router admin commands usage in HDFS commands reference doc Sub-task Resolved Yiqun Lin  
          8.
          RBF: Complete logic for -readonly option of dfsrouteradmin add command Sub-task Resolved Íñigo Goiri  
          9.
          RBF: Document Router and State Store metrics Sub-task Resolved Yiqun Lin  
          10.
          RBF: Add ACL support for mount table Sub-task Resolved Yiqun Lin  
          11.
          RBF: Add more unit tests for router admin commands Sub-task Resolved Yiqun Lin  
          12.
          RBF: Mount table entries not properly updated in the local cache Sub-task Resolved Íñigo Goiri  
          13.
          RBF: Support erasure coding methods in RouterRpcServer Sub-task Resolved Íñigo Goiri  
          14.
          RBF: Fix spurious TestRouterRpc#testProxyGetStats Sub-task Resolved Íñigo Goiri  
          15.
          RBF: Inconsistent Router OPTS config in branch-2 and branch-3 Sub-task Resolved Wei Yan  
          16.
          RBF: Fix doc error setting up client Sub-task Resolved tartarus

          0%

          Original Estimate - 24h
          Remaining Estimate - 24h
          17.
          RBF: Use the ZooKeeper as the default State Store Sub-task Resolved Yiqun Lin  
          18.
          RBF: Manage unavailable clusters Sub-task Resolved Yiqun Lin  
          19.
          RBF: Improve the unit test TestRouterRPCClientRetries Sub-task Resolved Yiqun Lin  
          20.
          RBF: Fix Routers information shown in the web UI Sub-task Resolved Wei Yan  
          21.
          RBF: Fix the hdfs router page missing label icon issue Sub-task Resolved Baolong Mao  
          22.
          RBF: Optimize name service safe mode icon Sub-task Resolved liuhongtong  
          23.
          RBF: Mount path not available after ADD-REMOVE-ADD Sub-task Resolved Wei Yan  
          24.
          RBF: Fix router location cache issue Sub-task Resolved Wu Weiwei  
          25.
          RBF: Complete document of Router configuration Sub-task Resolved Yiqun Lin  
          26.
          RBF: Move Router to its own module Sub-task Resolved Wei Yan  
          27.
          RBF: Resolvers to support mount points across multiple subclusters Sub-task Resolved Íñigo Goiri  
          28.
          RBF: Router to manage requests across multiple subclusters Sub-task Resolved Íñigo Goiri  
          29.
          RBF: Implement available space based OrderResolver Sub-task Resolved Yiqun Lin  
          30.
          RBF: Throw the exception if mount table entry validated failed Sub-task Resolved Baolong Mao  
          31.
          RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns Sub-task Resolved Chao Sun  
          32.
          RBF: ConnectionPool should return first usable connection Sub-task Resolved Ekanth Sethuramalingam  
          33.
          RBF: Update some inaccurate document descriptions Sub-task Resolved Yiqun Lin  
          34.
          RBF: Improve error message returned from subcluster Sub-task Resolved Íñigo Goiri  
          35.
          RBF: MountTableResolver doesn't return the correct mount point of the given path Sub-task Resolved wangzhiyuan  
          36.
          RBF: TestConnectionManager#testCleanup() test case need correction Sub-task Resolved Dibyendu Karmakar  
          37.
          RBF : Fix compilation error in branch-2 (TestMultipleDestinationResolver) Sub-task Resolved Brahma Reddy Battula  
          38.
          RBF: TestRouterAdminCLI#testCreateInvalidEntry fails on Windows Sub-task Resolved Íñigo Goiri  
          39.
          RBF: Fix FindBugs in hadoop-hdfs-rbf Sub-task Resolved Ekanth Sethuramalingam  
          40.
          RBF: Improve the interfaces to modify and view mount tables Sub-task Resolved Gang Li  
          41.
          RBF: Cache datanode reports Sub-task Resolved Íñigo Goiri  
          42.
          RBF: Add xsl stylesheet for hdfs-rbf-default.xml Sub-task Resolved Takanobu Asanuma  
          43.
          RBF: TestRouterWebHDFSContractCreate failed Sub-task Resolved Takanobu Asanuma  
          44.
          RBF: Support NamenodeProtocol in the Router Sub-task Resolved Íñigo Goiri  
          45.
          RBF: Improve timeout RPC call mechanism Sub-task Resolved Íñigo Goiri  
          46.
          RBF: Wrong date information in list file(-ls) result Sub-task Resolved Dibyendu Karmakar  
          47.
          RBF: Support federation with no subclusters Sub-task Resolved Íñigo Goiri  
          48.
          RBF: Fix java doc for StateStoreFileSystemImpl Sub-task Resolved YR  
          49.
          RBF: Remove LinkedList From StateStoreFileImpl.java Sub-task Resolved David Mollitor  
          50.
          RBF: Fix dead links in RBF document Sub-task Resolved Chetna Chaudhari  
          51.
          RBF: Improve the error loggings for printing the stack trace Sub-task Resolved Yiqun Lin  
          52.
          RBF: getMountPointDates should fetch latest subdir time/date when parent dir is not present but /parent/child dirs are present in mount table Sub-task Resolved Dibyendu Karmakar  
          53.
          RBF: Add more router-related information to the UI Sub-task Resolved Wei Yan  
          54.
          RBF: Disabled Nameservice store API Sub-task Resolved Íñigo Goiri  
          55.
          RBF: Disable Nameservices from the federation Sub-task Resolved Íñigo Goiri  
          56.
          RBF: Show disabled name services in the UI Sub-task Resolved Íñigo Goiri  
          57.
          RBF: Add unit test TestStateStoreDisabledNameservice Sub-task Resolved Yiqun Lin  
          58.
          RBF: Reject requests when a Router is overloaded Sub-task Resolved Íñigo Goiri  
          59.
          RBF: Fix setSafeMode in the Router Sub-task Resolved Íñigo Goiri  
          60.
          RBF: Normalize paths (automatically) when adding, updating, removing or listing mount table entries Sub-task Resolved Ekanth Sethuramalingam  
          61.
          RBF: Adding trace support Sub-task Resolved Íñigo Goiri  
          62.
          Add toString() for RemoteMethod Sub-task Resolved Chao Sun  
          63.
          RBF: Configurable value in xml for async connection request queue size. Sub-task Resolved CR Hota  
          64.
          RBF: Router fails when threadIndex (in ConnectionPool) wraps around Integer.MIN_VALUE Sub-task Resolved CR Hota  
          65.
          RBF: Fix RBF configuration links Sub-task Resolved Takanobu Asanuma  
          66.
          RBF: Add Web UI configurations and descriptions to RBF document Sub-task Resolved Takanobu Asanuma  
          67.
          RBF: Router throws NullPointerException due to the invalid initialization of MountTableResolver Sub-task Resolved Takanobu Asanuma  
          68.
          RBF: Router ID in RouterRpcClient is always null Sub-task Resolved Takanobu Asanuma  
          69.
          [Documentation] RBF: Mount points across multiple subclusters Sub-task Resolved Íñigo Goiri  
          70.
          RBF: Move ClientProtocol APIs to its own module Sub-task Resolved Chao Sun  

          Activity

            People

              elgoiri Íñigo Goiri
              elgoiri Íñigo Goiri
              Votes:
              2 Vote for this issue
              Watchers:
              35 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - 24h
                  24h
                  Remaining:
                  Remaining Estimate - 24h
                  24h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified