Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13891

HDFS RBF stabilization phase I

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.2.0
    • None
    • None

    Description

      RBF(Router Based Federation) shipped in 3.0+ and 2.9..

      now its out various corner cases, scale and error handling issues are surfacing.

      And we are targeting security feaiure (HDFS-13532) also.

      this umbrella to fix all those issues and support missing protocols(HDFS-13655) before next 3.3 release.

      Attachments

        Issue Links

          incorporates

          New Feature - A new feature of the product, which has yet to be developed. HDFS-13532 RBF: Adding security

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-13655 RBF: Add missing ClientProtocol APIs to RBF

          • Major - Major loss of function.
          • Resolved
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-12615 Router-based HDFS federation phase 2

          • Major - Major loss of function.
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-14603 Über-JIRA: HDFS RBF stabilization phase II

          • Major - Major loss of function.
          • Open
          1.
          		 RBF: TestRouterWebHDFSContractAppend.testRenameFileBeingAppended fails Sub-task Resolved Takanobu Asanuma
          2.
          		 RBF: RouterAdmin update cmd is overwriting the entry not updating the existing Sub-task Resolved Ayush Saxena
          3.
          		 RBF: Update mount table cache immediately after changing (add/update/remove) mount table entries. Sub-task Resolved Mohammad Arshad
          4.
          		 RBF: Fail when try to remove mount point paths Sub-task Resolved Akira Ajisaka
          5.
          		 RBF: Connection creator thread should catch Throwable Sub-task Resolved CR Hota
          6.
          		 RBF: Add multiple paths for dfsrouteradmin "rm" and "clrquota" commands Sub-task Resolved Ayush Saxena
          7.
          		 RBF: The DN_REPORT_TIME_OUT and DN_REPORT_CACHE_EXPIRE should be configured in RBFConfigKeys. Sub-task Resolved yanghuafeng
          8.
          		 RBF: The default MountTableResolver should fail resolving multi-destination paths Sub-task Resolved yanghuafeng
          9.
          		 RBF: Handle NPE for NamenodeBeanMetrics#getFederationMetrics Sub-task Resolved Ranith Sardar
          10.
          		 RBF: Add more information to HdfsFileStatus for a mount point Sub-task Resolved Akira Ajisaka
          11.
          		 RBF: ProvidedCapacityTotal json exception in NamenodeHeartbeatService Sub-task Resolved CR Hota
          12.
          		 RBF: LS command for root shows wrong owner and permission information. Sub-task Resolved Ayush Saxena
          13.
          		 RBF: Add option to fail operations when a subcluster is unavailable Sub-task Resolved Íñigo Goiri
          14.
          		 RBF: MIN_ACTIVE_RATIO should be configurable Sub-task Resolved Hui Fei
          15.
          		 RBF: Make the read-only column of Mount Table clearly understandable Sub-task Resolved Takanobu Asanuma
          16.
          		 RBF: Fix a typo in RouterAdmin usage Sub-task Resolved Ayush Saxena
          17.
          		 RBF: Throw StandbyException instead of IOException so that client can retry when can not get connection Sub-task Resolved Hui Fei
          18.
          		 RBF: RouterAdmin should support dfsrouteradmin -refreshRouterArgs command Sub-task Resolved yanghuafeng
          19.
          		 RBF: Add stale nodes to federation metrics Sub-task Resolved Íñigo Goiri
          20.
          		 RBF: Quotas of the sub-cluster should be removed when removing the mount point Sub-task Resolved Takanobu Asanuma
          21.
          		 RBF: Remove hard coded router status from FederationMetrics. Sub-task Resolved Ranith Sardar
          22.
          		 RBF: Inconsistency with the Default Namespace Sub-task Resolved Ayush Saxena
          23.
          		 RBF: Cleanup quota modules Sub-task Resolved Íñigo Goiri
          24.
          		 RBF: rollEdit() command fails with Router Sub-task Resolved Shubham Dewan
          25.
          		 RBF: setQuota() through router is working for only the mount Points under the Source column in MountTable Sub-task Resolved Shubham Dewan
          26.
          		 RBF: ACL commands should work over all the destinations Sub-task Resolved Ayush Saxena
          27.
          		 RBF: Remove dependency on availability of default namespace Sub-task Resolved Ayush Saxena
          28.
          		 RBF: Add configuration documents for using multiple sub-clusters Sub-task Resolved Takanobu Asanuma
          29.
          		 RBF: NPE in getContentSummary() for getEcPolicy() in case of multiple destinations Sub-task Resolved Ayush Saxena
          30.
          		 RBF : MiniRouterDFSCluster should configure the failover proxy provider for namespace Sub-task Resolved Ranith Sardar
          31.
          		 RBF: Setting attributes should set on all subclusters' directories. Sub-task Resolved Ayush Saxena
          32.
          		 RBF: Tooling to identify the subcluster location of a file Sub-task Resolved Íñigo Goiri
          33.
          		 RBF : Exceptions are exposing the actual sub cluster path Sub-task Resolved Ayush Saxena
          34.
          		 RBF: Fix safemode message for Router Sub-task Resolved Ranith Sardar
          35.
          		 RBF: Fix the location of the DNs in getDatanodeReport() Sub-task Resolved Íñigo Goiri
          36.
          		 RBF: Throw RetriableException instead of IOException when no namenodes available Sub-task Resolved Hui Fei
          37.
          		 RBF: Support unavailable subclusters for mount points with multiple destinations Sub-task Resolved Íñigo Goiri
          38.
          		 RBF: Add maintenance nodes to federation metrics Sub-task Resolved Ayush Saxena
          39.
          		 RBF: IOE While Removing Mount Entry Sub-task Resolved Ayush Saxena
          40.
          		 RBF: Use human readable format for long numbers in the Router UI Sub-task Resolved Íñigo Goiri
          41.
          		 RBF: Fix renaming folders spread across multiple subclusters Sub-task Resolved Ayush Saxena
          42.
          		 RBF: Optimize configuration item resolving for monitor namenode Sub-task Resolved Xiaoqiao He
          43.
          		 RBF: Fix trailing "/" for webhdfs Sub-task Resolved Akira Ajisaka
          44.
          		 RBF: Prevent loading metric system when disabled Sub-task Resolved Íñigo Goiri
          45.
          		 RBF: Router shouldn't allow READ operations in safe mode Sub-task Resolved Íñigo Goiri
          46.
          		 RBF: Optimize the file write process in case of multiple destinations. Sub-task Resolved Ayush Saxena
          47.
          		 RBF: Add safemode to Router UI Sub-task Resolved Fengnan Li
          48.
          		 RBF: Router should support RefreshUserMappingsProtocol Sub-task Resolved Shen Yinjie
          49.
          		 RBF: getContentSummary() should allow non-existing folders Sub-task Resolved Íñigo Goiri
          50.
          		 RBF: Add order text SPACE in CLI command 'hdfs dfsrouteradmin' Sub-task Resolved luhuachao
          51.
          		 RBF: Remove unnecessary quota checks Sub-task Resolved Ayush Saxena
          52.
          		 RBF: Clean-up and refactor UI components Sub-task Resolved Takanobu Asanuma
          53.
          		 RBF: Create hdfs-rbf-site.xml for RBF specific properties Sub-task Resolved Takanobu Asanuma
          54.
          		 RBF: Separate namenodeHeartbeat and routerHeartbeat to different config key Sub-task Resolved Ayush Saxena
          55.
          		 RBF: Update the document of RBF related metrics Sub-task Resolved Takanobu Asanuma
          56.
          		 RBF: Router should support GetUserMappingsProtocol Sub-task Resolved Ayush Saxena
          57.
          		 RBF: Failed to get statistics from NameNodes before 2.9.0 Sub-task Resolved Xiaoqiao He
          58.
          		 RBF: updateMount should validate the newEntry in RouterAdmin Sub-task Resolved ZanderXu
          59.
          		 RBF: Remove FSCK from Router Web UI Sub-task Resolved Hui Fei
          60.
          		 RBF: Add FSCK to the Router Sub-task Resolved Akira Ajisaka

          Activity

            People

              Unassigned Unassigned
              brahmareddy Brahma Reddy Battula
              Votes:
              0 Vote for this issue
              Watchers:
              24 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: