[HDFS-14603] Über-JIRA: HDFS RBF stabilization phase II

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: rbf
• Assignee: Unassigned
• Reporter: Brahma Reddy Battula
• Created: 24/Jun/19 17:01
• Updated: 25/Jul/19 17:59

Description

To track the pending issues/any new issues after HDFS-13891.(Even for grouping all the RBF issues which will easier for tracking/maintenance)

Issue Links

• is related to: HDFS-13891 HDFS RBF stabilization phase I

Sub-Tasks

• RBF: Add destination path length validation for add/update mount entry: Resolved
• RBF: Create destination directory when adding mount entry using router admin cmds.: Open
• RBF: Remove update functionality from routeradmin's add cmd: Patch Available
• RBF: Support Router Admin REST API: Patch Available
• RBF: Add Browse the Filesystem button to the UI: Resolved
• RBF: Correct the logic of mount validate to avoid the bad mountPoint: Resolved
• RBF: State store DBMS implementation: Resolved
• RBF: Extend RouterRpcClient to use multiple sockets: Resolved
• RBF: Namenode need to choose block location for the client: Resolved
• RBF: Router audit logger: Patch Available
• RBF: Support InodeID in the Router: Open
• RBF: Cannot mv/cp file cross namespace: Open
• RBF: Cluster information on Router is not correct when the Federation shares datanodes: Open
• RBF: Synchronous way to create RPC client connections to NN: Open
• RBF: Failed mount point operations, returns wrong exit code.: Resolved
• RBF: Add methods to RouterAdmin to set order, read only, and chown: Patch Available
• RBF: NamenodeHeartbeat test cases around jmx parameters: Open
• RBF: RouterAdmin should have failover concept for router: Patch Available
• RBF: Race condition between router admin quota update and periodic quota update service: Resolved
• RBF: We can only delete the files or dirs of one subcluster in a cluster with multiple subclusters when trash is enabled: Patch Available
• RBF: Correct the returned value in case of IOException in NamenodeBeanMetrics#getFederationMetrics: Patch Available
• RBF: Web UI not displaying clearly which target path is pointing to which name service in mount table: Patch Available
• RBF: Getfacl gives a wrong acl entries when the order of the mount table set to HASH_ALL or RANDOM: Patch Available
• RBF: Optimize MiniRouterDFSCluster with optional light weight MiniDFSCluster: Patch Available
• RBF: Optimize some testing set up logic in MiniRouterDFSCluster: Open
• RBF: Log Router identifier when reporting exceptions: Patch Available
• RBF: Fix MockNamenode bug about mocking RPC getListing and mkdir: Patch Available
• RBF: Rename with multiple subclusters should fail if no eligible locations: Patch Available
• RBF: Isolation/Fairness documentation: Resolved
• RBF: Add hdfs-rbf-default.xml to HdfsConfiguration by default: Resolved
• RBF: Fix intermittently failing kerberos related unit test: Resolved
• RBF: Implement deletion feature for expired records in State Store: Resolved
• RBF: Duplicate FederationRPCMetrics: Patch Available
• RBF: FederationUtil#newInstance should allow constructor without context: Resolved
• RBF: Add security to UI: Resolved
• RBF: Integrate security changes with audit logging.: Open
• RBF: File Read and Writing is failing when security is enabled.: Patch Available
• RBF: Add E2E tests for digest auth (token based): Open
• RBF: Client should be able to renew DT immediately after it fetched the DT: Open
• RBF: Fix 'not a super user' error when disabling a namespace in kerberos with superuser principal: Resolved
• RBF: Correct the default value for dfs.federation.router.namenode.heartbeat.enable: Resolved
• RBF: TestRouterRpc#testNamenodeMetrics is flaky: Resolved
• RBF: NPE in RBFMetrics: Resolved
• RBF: Create secret manager instance using FederationUtil#newInstance.: Resolved
• RBF: ServiceAddress and webAddress should not be null in NamenodeHeartbeatService: Patch Available
• RBF: RBFMetrics throws NullPointerException if stateStore disabled: Resolved
• RBF: implement getReplicatedBlockStats interface: Resolved
• RBF: Fix RBF failed tests: Resolved
• RBF: RouterAdmin supports refreshRouterArgs command but not on display: Resolved
• RBF:TestRouterFaultTolerant tests are flaky: Resolved
• RBF: Non secured routers should not log in error mode when UGI is default.: Resolved
• RBF: Isolation across multiple downstream hdfs clusters: Open
• RBF: getQuotaUsage may ignore some folders: Resolved
• RBF: MountTableStoreImpl#getMountTableEntries returns extra entry: Resolved
• RBF: Router Update Doesn't Sync Quota: Resolved
• RBF: namenode links in NameFederation Health page (federationhealth.html) cannot use https scheme: Resolved
• RBF: NullPointer When Misconfigured: Patch Available
• RBF: Add dfsrouteradmin -refreshSuperUserGroupsConfiguration command option: Resolved
• RBF: Delegation Token can't remove correctly in absence of cancelToken and restart the router.: Resolved
• RBF: The detail of the Exception is not shown in ZKDelegationTokenSecretManagerImpl: Resolved
• RBF: Impose directory level permissions for Mount entries: Resolved
• RBF: Add permission check for safemode operation: Resolved
• RBF: Client maybe get an unexpected result with network anomaly: Resolved
• RBF: Check each component length of destination path when add/update mount entry: Resolved
• RBF: Correct annotation typo of RouterPermissionChecker#checkPermission: Resolved
• RBF: Print stacktrace when DFSRouter fails to fetch/parse JMX output from NameNode: Resolved
• RBF: Plugin interface to enable delegation of Router: Open
• RBF: Router FSCK should consider the mount table: Patch Available
• RBF: Delete repeated configuration 'dfs.federation.router.metrics.enable': Resolved
• RBF: Refresh cacheNS when SocketException occurs: Resolved
• RBF: Create test cases that simulate general exceptions on NameNodes: Open
• RBF: Router FSCK fails after HDFS-14442: Resolved
• RBF: Fix test failures after HADOOP-17281: Resolved
• RBF: TestRouterRpc#testErasureCoding is flaky: Resolved
• RBF: The RouterRPCServer should transfer client IP via CallerContext to NamenodeRpcServer: Resolved
• RBF: Get the datanode report from cache for federation WebHDFS operations: Resolved
• RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations.: Resolved
• RBF: invokeConcurrent may run unexpected when enable standby read: Patch Available
• RBF: Fix contract tests after HADOOP-13327: Resolved
• RBF: Data loss when Router setup connection timeout: Open
• RBF: Remove the useless configuration of rpc isolation in md: Resolved
• RBF: improve renewLease() to call only a specific NameNode rather than make fan-out calls: Resolved