Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13891

HDFS RBF stabilization phase I

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.2.0
    • None
    • None

    Description

      RBF(Router Based Federation) shipped in 3.0+ and 2.9..

      now its out various corner cases, scale and error handling issues are surfacing.

      And we are targeting security feaiure (HDFS-13532) also.

      this umbrella to fix all those issues and support missing protocols(HDFS-13655) before next 3.3 release.

      Attachments

        Issue Links

        1.
        RBF: TestRouterWebHDFSContractAppend.testRenameFileBeingAppended fails Sub-task Resolved Takanobu Asanuma Actions
        2.
        RBF: RouterAdmin update cmd is overwriting the entry not updating the existing Sub-task Resolved Ayush Saxena Actions
        3.
        RBF: Update mount table cache immediately after changing (add/update/remove) mount table entries. Sub-task Resolved Mohammad Arshad Actions
        4.
        RBF: Fail when try to remove mount point paths Sub-task Resolved Akira Ajisaka Actions
        5.
        RBF: Connection creator thread should catch Throwable Sub-task Resolved CR Hota Actions
        6.
        RBF: Add multiple paths for dfsrouteradmin "rm" and "clrquota" commands Sub-task Resolved Ayush Saxena Actions
        7.
        RBF: The DN_REPORT_TIME_OUT and DN_REPORT_CACHE_EXPIRE should be configured in RBFConfigKeys. Sub-task Resolved yanghuafeng Actions
        8.
        RBF: The default MountTableResolver should fail resolving multi-destination paths Sub-task Resolved yanghuafeng Actions
        9.
        RBF: Handle NPE for NamenodeBeanMetrics#getFederationMetrics Sub-task Resolved Ranith Sardar Actions
        10.
        RBF: Add more information to HdfsFileStatus for a mount point Sub-task Resolved Akira Ajisaka Actions
        11.
        RBF: ProvidedCapacityTotal json exception in NamenodeHeartbeatService Sub-task Resolved CR Hota Actions
        12.
        RBF: LS command for root shows wrong owner and permission information. Sub-task Resolved Ayush Saxena Actions
        13.
        RBF: Add option to fail operations when a subcluster is unavailable Sub-task Resolved Íñigo Goiri Actions
        14.
        RBF: MIN_ACTIVE_RATIO should be configurable Sub-task Resolved Hui Fei Actions
        15.
        RBF: Make the read-only column of Mount Table clearly understandable Sub-task Resolved Takanobu Asanuma Actions
        16.
        RBF: Fix a typo in RouterAdmin usage Sub-task Resolved Ayush Saxena Actions
        17.
        RBF: Throw StandbyException instead of IOException so that client can retry when can not get connection Sub-task Resolved Hui Fei Actions
        18.
        RBF: RouterAdmin should support dfsrouteradmin -refreshRouterArgs command Sub-task Resolved yanghuafeng Actions
        19.
        RBF: Add stale nodes to federation metrics Sub-task Resolved Íñigo Goiri Actions
        20.
        RBF: Quotas of the sub-cluster should be removed when removing the mount point Sub-task Resolved Takanobu Asanuma Actions
        21.
        RBF: Remove hard coded router status from FederationMetrics. Sub-task Resolved Ranith Sardar Actions
        22.
        RBF: Inconsistency with the Default Namespace Sub-task Resolved Ayush Saxena Actions
        23.
        RBF: Cleanup quota modules Sub-task Resolved Íñigo Goiri Actions
        24.
        RBF: rollEdit() command fails with Router Sub-task Resolved Shubham Dewan Actions
        25.
        RBF: setQuota() through router is working for only the mount Points under the Source column in MountTable Sub-task Resolved Shubham Dewan Actions
        26.
        RBF: ACL commands should work over all the destinations Sub-task Resolved Ayush Saxena Actions
        27.
        RBF: Remove dependency on availability of default namespace Sub-task Resolved Ayush Saxena Actions
        28.
        RBF: Add configuration documents for using multiple sub-clusters Sub-task Resolved Takanobu Asanuma Actions
        29.
        RBF: NPE in getContentSummary() for getEcPolicy() in case of multiple destinations Sub-task Resolved Ayush Saxena Actions
        30.
        RBF : MiniRouterDFSCluster should configure the failover proxy provider for namespace Sub-task Resolved Ranith Sardar Actions
        31.
        RBF: Setting attributes should set on all subclusters' directories. Sub-task Resolved Ayush Saxena Actions
        32.
        RBF: Tooling to identify the subcluster location of a file Sub-task Resolved Íñigo Goiri Actions
        33.
        RBF : Exceptions are exposing the actual sub cluster path Sub-task Resolved Ayush Saxena Actions
        34.
        RBF: Fix safemode message for Router Sub-task Resolved Ranith Sardar Actions
        35.
        RBF: Fix the location of the DNs in getDatanodeReport() Sub-task Resolved Íñigo Goiri Actions
        36.
        RBF: Throw RetriableException instead of IOException when no namenodes available Sub-task Resolved Hui Fei Actions
        37.
        RBF: Support unavailable subclusters for mount points with multiple destinations Sub-task Resolved Íñigo Goiri Actions
        38.
        RBF: Add maintenance nodes to federation metrics Sub-task Resolved Ayush Saxena Actions
        39.
        RBF: IOE While Removing Mount Entry Sub-task Resolved Ayush Saxena Actions
        40.
        RBF: Use human readable format for long numbers in the Router UI Sub-task Resolved Íñigo Goiri Actions
        41.
        RBF: Fix renaming folders spread across multiple subclusters Sub-task Resolved Ayush Saxena Actions
        42.
        RBF: Optimize configuration item resolving for monitor namenode Sub-task Resolved Xiaoqiao He Actions
        43.
        RBF: Fix trailing "/" for webhdfs Sub-task Resolved Akira Ajisaka Actions
        44.
        RBF: Prevent loading metric system when disabled Sub-task Resolved Íñigo Goiri Actions
        45.
        RBF: Router shouldn't allow READ operations in safe mode Sub-task Resolved Íñigo Goiri Actions
        46.
        RBF: Optimize the file write process in case of multiple destinations. Sub-task Resolved Ayush Saxena Actions
        47.
        RBF: Add safemode to Router UI Sub-task Resolved Fengnan Li Actions
        48.
        RBF: Router should support RefreshUserMappingsProtocol Sub-task Resolved Shen Yinjie Actions
        49.
        RBF: getContentSummary() should allow non-existing folders Sub-task Resolved Íñigo Goiri Actions
        50.
        RBF: Add order text SPACE in CLI command 'hdfs dfsrouteradmin' Sub-task Resolved luhuachao Actions
        51.
        RBF: Remove unnecessary quota checks Sub-task Resolved Ayush Saxena Actions
        52.
        RBF: Clean-up and refactor UI components Sub-task Resolved Takanobu Asanuma Actions
        53.
        RBF: Create hdfs-rbf-site.xml for RBF specific properties Sub-task Resolved Takanobu Asanuma Actions
        54.
        RBF: Separate namenodeHeartbeat and routerHeartbeat to different config key Sub-task Resolved Ayush Saxena Actions
        55.
        RBF: Update the document of RBF related metrics Sub-task Resolved Takanobu Asanuma Actions
        56.
        RBF: Router should support GetUserMappingsProtocol Sub-task Resolved Ayush Saxena Actions
        57.
        RBF: Failed to get statistics from NameNodes before 2.9.0 Sub-task Resolved Xiaoqiao He Actions
        58.
        RBF: updateMount should validate the newEntry in RouterAdmin Sub-task Resolved ZanderXu Actions
        59.
        RBF: Remove FSCK from Router Web UI Sub-task Resolved Hui Fei Actions
        60.
        RBF: Add FSCK to the Router Sub-task Resolved Akira Ajisaka Actions

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned Assign to me
            brahmareddy Brahma Reddy Battula
            Votes:
            0 Vote for this issue
            Watchers:
            24 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment