Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13891

HDFS RBF stabilization phase I

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.2.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:

      Description

      RBF(Router Based Federation) shipped in 3.0+ and 2.9..

      now its out various corner cases, scale and error handling issues are surfacing.

      And we are targeting security feaiure (HDFS-13532) also.

      this umbrella to fix all those issues and support missing protocols(HDFS-13655) before next 3.3 release.

        Attachments

          Issue Links

          1.
          RBF: TestRouterWebHDFSContractAppend.testRenameFileBeingAppended fails Sub-task Resolved Takanobu Asanuma
          2.
          RBF: RouterAdmin update cmd is overwriting the entry not updating the existing Sub-task Resolved Ayush Saxena
          3.
          RBF: Update mount table cache immediately after changing (add/update/remove) mount table entries. Sub-task Resolved Mohammad Arshad
          4.
          RBF: Fail when try to remove mount point paths Sub-task Resolved Akira Ajisaka
          5.
          RBF: Connection creator thread should catch Throwable Sub-task Resolved CR Hota
          6.
          RBF: Add multiple paths for dfsrouteradmin "rm" and "clrquota" commands Sub-task Resolved Ayush Saxena
          7.
          RBF: The DN_REPORT_TIME_OUT and DN_REPORT_CACHE_EXPIRE should be configured in RBFConfigKeys. Sub-task Resolved yanghuafeng
          8.
          RBF: The default MountTableResolver should fail resolving multi-destination paths Sub-task Resolved yanghuafeng
          9.
          RBF: Handle NPE for NamenodeBeanMetrics#getFederationMetrics Sub-task Resolved Ranith Sardar
          10.
          RBF: Add more information to HdfsFileStatus for a mount point Sub-task Resolved Akira Ajisaka
          11.
          RBF: ProvidedCapacityTotal json exception in NamenodeHeartbeatService Sub-task Resolved CR Hota
          12.
          RBF: LS command for root shows wrong owner and permission information. Sub-task Resolved Ayush Saxena
          13.
          RBF: Add option to fail operations when a subcluster is unavailable Sub-task Resolved Íñigo Goiri
          14.
          RBF: MIN_ACTIVE_RATIO should be configurable Sub-task Resolved Fei Hui
          15.
          RBF: Make the read-only column of Mount Table clearly understandable Sub-task Resolved Takanobu Asanuma
          16.
          RBF: Fix a typo in RouterAdmin usage Sub-task Resolved Ayush Saxena
          17.
          RBF: Throw StandbyException instead of IOException so that client can retry when can not get connection Sub-task Resolved Fei Hui
          18.
          RBF: RouterAdmin should support dfsrouteradmin -refreshRouterArgs command Sub-task Resolved yanghuafeng
          19.
          RBF: Add stale nodes to federation metrics Sub-task Resolved Íñigo Goiri
          20.
          RBF: Quotas of the sub-cluster should be removed when removing the mount point Sub-task Resolved Takanobu Asanuma
          21.
          RBF: Remove hard coded router status from FederationMetrics. Sub-task Resolved Ranith Sardar
          22.
          RBF: Inconsistency with the Default Namespace Sub-task Resolved Ayush Saxena
          23.
          RBF: Cleanup quota modules Sub-task Resolved Íñigo Goiri
          24.
          RBF: rollEdit() command fails with Router Sub-task Resolved Shubham Dewan
          25.
          RBF: setQuota() through router is working for only the mount Points under the Source column in MountTable Sub-task Resolved Shubham Dewan
          26.
          RBF: ACL commands should work over all the destinations Sub-task Resolved Ayush Saxena
          27.
          RBF: Remove dependency on availability of default namespace Sub-task Resolved Ayush Saxena
          28.
          RBF: Add configuration documents for using multiple sub-clusters Sub-task Resolved Takanobu Asanuma
          29.
          RBF: NPE in getContentSummary() for getEcPolicy() in case of multiple destinations Sub-task Resolved Ayush Saxena
          30.
          RBF : MiniRouterDFSCluster should configure the failover proxy provider for namespace Sub-task Resolved Ranith Sardar
          31.
          RBF: Setting attributes should set on all subclusters' directories. Sub-task Resolved Ayush Saxena
          32.
          RBF: Tooling to identify the subcluster location of a file Sub-task Resolved Íñigo Goiri
          33.
          RBF : Exceptions are exposing the actual sub cluster path Sub-task Resolved Ayush Saxena
          34.
          RBF: Fix safemode message for Router Sub-task Resolved Ranith Sardar
          35.
          RBF: Fix the location of the DNs in getDatanodeReport() Sub-task Resolved Íñigo Goiri
          36.
          RBF: Throw RetriableException instead of IOException when no namenodes available Sub-task Resolved Fei Hui
          37.
          RBF: Support unavailable subclusters for mount points with multiple destinations Sub-task Resolved Íñigo Goiri
          38.
          RBF: Add maintenance nodes to federation metrics Sub-task Resolved Ayush Saxena
          39.
          RBF: IOE While Removing Mount Entry Sub-task Resolved Ayush Saxena
          40.
          RBF: Use human readable format for long numbers in the Router UI Sub-task Resolved Íñigo Goiri
          41.
          RBF: Fix renaming folders spread across multiple subclusters Sub-task Resolved Ayush Saxena
          42.
          RBF: Optimize configuration item resolving for monitor namenode Sub-task Resolved Xiaoqiao He
          43.
          RBF: Fix trailing "/" for webhdfs Sub-task Resolved Akira Ajisaka
          44.
          RBF: Prevent loading metric system when disabled Sub-task Resolved Íñigo Goiri
          45.
          RBF: Router shouldn't allow READ operations in safe mode Sub-task Resolved Íñigo Goiri
          46.
          RBF: Optimize the file write process in case of multiple destinations. Sub-task Resolved Ayush Saxena
          47.
          RBF: Add safemode to Router UI Sub-task Resolved Fengnan Li
          48.
          RBF: Router should support RefreshUserMappingsProtocol Sub-task Resolved Shen Yinjie
          49.
          RBF: getContentSummary() should allow non-existing folders Sub-task Resolved Íñigo Goiri
          50.
          RBF: Add order text SPACE in CLI command 'hdfs dfsrouteradmin' Sub-task Resolved luhuachao
          51.
          RBF: Remove unnecessary quota checks Sub-task Resolved Ayush Saxena
          52.
          RBF: Clean-up and refactor UI components Sub-task Resolved Takanobu Asanuma
          53.
          RBF: Create hdfs-rbf-site.xml for RBF specific properties Sub-task Resolved Takanobu Asanuma
          54.
          RBF: Separate namenodeHeartbeat and routerHeartbeat to different config key Sub-task Resolved Ayush Saxena
          55.
          RBF: Update the document of RBF related metrics Sub-task Resolved Takanobu Asanuma
          56.
          RBF: Router should support GetUserMappingsProtocol Sub-task Resolved Ayush Saxena
          57.
          RBF: Failed to get statistics from NameNodes before 2.9.0 Sub-task Resolved Xiaoqiao He
          58.
          RBF: updateMount should validate the newEntry in RouterAdmin Sub-task Resolved xuzq

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                brahmareddy Brahma Reddy Battula
              • Votes:
                0 Vote for this issue
                Watchers:
                24 Start watching this issue

                Dates

                • Created:
                  Updated: