Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12615

Router-based HDFS federation phase 2

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.2.0
    • Component/s: None
    • Labels:

      Description

      This umbrella JIRA tracks set of improvements over the Router-based HDFS federation (HDFS-10467).

        Attachments

        Issue Links

        1.
        RBF: Add WebHDFS Sub-task Resolved Wei Yan   Actions
        2.
        RBF: Improve State Store FS implementation Sub-task Resolved Íñigo Goiri   Actions
        3.
        RBF: Test Router-based federation using HDFSContract Sub-task Resolved Íñigo Goiri   Actions
        4.
        RBF: Set MountTableResolver as default file resolver Sub-task Resolved Íñigo Goiri   Actions
        5.
        RBF: Control MountTableResolver cache size Sub-task Resolved Íñigo Goiri   Actions
        6.
        RBF: Fix Javadoc parameter errors Sub-task Resolved Wei Yan   Actions
        7.
        RBF: Add router admin commands usage in HDFS commands reference doc Sub-task Resolved Yiqun Lin   Actions
        8.
        RBF: Complete logic for -readonly option of dfsrouteradmin add command Sub-task Resolved Íñigo Goiri   Actions
        9.
        RBF: Document Router and State Store metrics Sub-task Resolved Yiqun Lin   Actions
        10.
        RBF: Add ACL support for mount table Sub-task Resolved Yiqun Lin   Actions
        11.
        RBF: Add more unit tests for router admin commands Sub-task Resolved Yiqun Lin   Actions
        12.
        RBF: Mount table entries not properly updated in the local cache Sub-task Resolved Íñigo Goiri   Actions
        13.
        RBF: Support erasure coding methods in RouterRpcServer Sub-task Resolved Íñigo Goiri   Actions
        14.
        RBF: Fix spurious TestRouterRpc#testProxyGetStats Sub-task Resolved Íñigo Goiri   Actions
        15.
        RBF: Inconsistent Router OPTS config in branch-2 and branch-3 Sub-task Resolved Wei Yan   Actions
        16.
        RBF: Fix doc error setting up client Sub-task Resolved tartarus

        0%

        Original Estimate - 24h
        Remaining Estimate - 24h
        Actions
        17.
        RBF: Use the ZooKeeper as the default State Store Sub-task Resolved Yiqun Lin   Actions
        18.
        RBF: Manage unavailable clusters Sub-task Resolved Yiqun Lin   Actions
        19.
        RBF: Improve the unit test TestRouterRPCClientRetries Sub-task Resolved Yiqun Lin   Actions
        20.
        RBF: Fix Routers information shown in the web UI Sub-task Resolved Wei Yan   Actions
        21.
        RBF: Fix the hdfs router page missing label icon issue Sub-task Resolved Baolong Mao   Actions
        22.
        RBF: Optimize name service safe mode icon Sub-task Resolved liuhongtong   Actions
        23.
        RBF: Mount path not available after ADD-REMOVE-ADD Sub-task Resolved Wei Yan   Actions
        24.
        RBF: Fix router location cache issue Sub-task Resolved Wu Weiwei   Actions
        25.
        RBF: Complete document of Router configuration Sub-task Resolved Yiqun Lin   Actions
        26.
        RBF: Move Router to its own module Sub-task Resolved Wei Yan   Actions
        27.
        RBF: Resolvers to support mount points across multiple subclusters Sub-task Resolved Íñigo Goiri   Actions
        28.
        RBF: Router to manage requests across multiple subclusters Sub-task Resolved Íñigo Goiri   Actions
        29.
        RBF: Implement available space based OrderResolver Sub-task Resolved Yiqun Lin   Actions
        30.
        RBF: Throw the exception if mount table entry validated failed Sub-task Resolved Baolong Mao   Actions
        31.
        RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns Sub-task Resolved Chao Sun   Actions
        32.
        RBF: ConnectionPool should return first usable connection Sub-task Resolved Ekanth Sethuramalingam   Actions
        33.
        RBF: Update some inaccurate document descriptions Sub-task Resolved Yiqun Lin   Actions
        34.
        RBF: Improve error message returned from subcluster Sub-task Resolved Íñigo Goiri   Actions
        35.
        RBF: MountTableResolver doesn't return the correct mount point of the given path Sub-task Resolved wangzhiyuan   Actions
        36.
        RBF: TestConnectionManager#testCleanup() test case need correction Sub-task Resolved Dibyendu Karmakar   Actions
        37.
        RBF : Fix compilation error in branch-2 (TestMultipleDestinationResolver) Sub-task Resolved Brahma Reddy Battula   Actions
        38.
        RBF: TestRouterAdminCLI#testCreateInvalidEntry fails on Windows Sub-task Resolved Íñigo Goiri   Actions
        39.
        RBF: Fix FindBugs in hadoop-hdfs-rbf Sub-task Resolved Ekanth Sethuramalingam   Actions
        40.
        RBF: Improve the interfaces to modify and view mount tables Sub-task Resolved Gang Li   Actions
        41.
        RBF: Cache datanode reports Sub-task Resolved Íñigo Goiri   Actions
        42.
        RBF: Add xsl stylesheet for hdfs-rbf-default.xml Sub-task Resolved Takanobu Asanuma   Actions
        43.
        RBF: TestRouterWebHDFSContractCreate failed Sub-task Resolved Takanobu Asanuma   Actions
        44.
        RBF: Support NamenodeProtocol in the Router Sub-task Resolved Íñigo Goiri   Actions
        45.
        RBF: Improve timeout RPC call mechanism Sub-task Resolved Íñigo Goiri   Actions
        46.
        RBF: Wrong date information in list file(-ls) result Sub-task Resolved Dibyendu Karmakar   Actions
        47.
        RBF: Support federation with no subclusters Sub-task Resolved Íñigo Goiri   Actions
        48.
        RBF: Fix java doc for StateStoreFileSystemImpl Sub-task Resolved Yiran Wu   Actions
        49.
        RBF: Remove LinkedList From StateStoreFileImpl.java Sub-task Resolved David Mollitor   Actions
        50.
        RBF: Fix dead links in RBF document Sub-task Resolved Chetna Chaudhari   Actions
        51.
        RBF: Improve the error loggings for printing the stack trace Sub-task Resolved Yiqun Lin   Actions
        52.
        RBF: getMountPointDates should fetch latest subdir time/date when parent dir is not present but /parent/child dirs are present in mount table Sub-task Resolved Dibyendu Karmakar   Actions
        53.
        RBF: Add more router-related information to the UI Sub-task Resolved Wei Yan   Actions
        54.
        RBF: Disabled Nameservice store API Sub-task Resolved Íñigo Goiri   Actions
        55.
        RBF: Disable Nameservices from the federation Sub-task Resolved Íñigo Goiri   Actions
        56.
        RBF: Show disabled name services in the UI Sub-task Resolved Íñigo Goiri   Actions
        57.
        RBF: Add unit test TestStateStoreDisabledNameservice Sub-task Resolved Yiqun Lin   Actions
        58.
        RBF: Reject requests when a Router is overloaded Sub-task Resolved Íñigo Goiri   Actions
        59.
        RBF: Fix setSafeMode in the Router Sub-task Resolved Íñigo Goiri   Actions
        60.
        RBF: Normalize paths (automatically) when adding, updating, removing or listing mount table entries Sub-task Resolved Ekanth Sethuramalingam   Actions
        61.
        RBF: Adding trace support Sub-task Resolved Íñigo Goiri   Actions
        62.
        Add toString() for RemoteMethod Sub-task Resolved Chao Sun   Actions
        63.
        RBF: Configurable value in xml for async connection request queue size. Sub-task Resolved CR Hota   Actions
        64.
        RBF: Router fails when threadIndex (in ConnectionPool) wraps around Integer.MIN_VALUE Sub-task Resolved CR Hota   Actions
        65.
        RBF: Fix RBF configuration links Sub-task Resolved Takanobu Asanuma   Actions
        66.
        RBF: Add Web UI configurations and descriptions to RBF document Sub-task Resolved Takanobu Asanuma   Actions
        67.
        RBF: Router throws NullPointerException due to the invalid initialization of MountTableResolver Sub-task Resolved Takanobu Asanuma   Actions
        68.
        RBF: Router ID in RouterRpcClient is always null Sub-task Resolved Takanobu Asanuma   Actions
        69.
        [Documentation] RBF: Mount points across multiple subclusters Sub-task Resolved Íñigo Goiri   Actions
        70.
        RBF: Move ClientProtocol APIs to its own module Sub-task Resolved Chao Sun   Actions

          Activity

            People

            • Assignee:
              elgoiri Íñigo Goiri
              Reporter:
              elgoiri Íñigo Goiri

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - 24h
                24h
                Remaining:
                Remaining Estimate - 24h
                24h
                Logged:
                Time Spent - Not Specified
                Not Specified

                  Issue deployment