[HADOOP-16095] Support impersonation for AuthenticationFilter

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.3.0
• Component/s: security
• Assignee: Eric Yang
• Reporter: Eric Yang
• Created: 06/Feb/19 18:54
• Updated: 23/Oct/19 16:15
• Resolved: 17/Jun/19 20:24

Description

External services or YARN service may need to call into WebHDFS or YARN REST API on behave of the user using web protocols. It would be good to support impersonation mechanism in AuthenticationFilter or similar extensions. The general design is similar to UserGroupInformation.doAs in RPC layer.

The calling service credential is verified as a proxy user coming from a trusted host verifying Hadoop proxy user ACL on the server side. If proxy user ACL allows proxy user to become doAs user. HttpRequest object will report REMOTE_USER as doAs user. This feature enables web application logic to be written with minimal changes to call Hadoop API with UserGroupInformation.doAs() wrapper.

HTTP Request

A few possible options:

1. Using query parameter to pass doAs user:

POST /service?doAs=foobar
Authorization: [proxy user Kerberos token]

2. Use HTTP Header to pass doAs user:

POST /service
Authorization: [proxy user Kerberos token]
x-hadoop-doas: foobar

HTTP Response

403 - Forbidden (Including impersonation is not allowed)

Proxy User ACL requirement

Proxy user kerberos token maps to a service principal, such as yarn/host1.example.com. The host part of the credential and HTTP request origin are both validated with hadoop.proxyuser.yarn.hosts ACL. doAs user group membership or identity is checked with either hadoop.proxyuser.yarn.groups or hadoop.proxyuser.yarn.users. This governs the caller is coming from authorized host and belong to authorized group.

Issue Links

• relates to: YARN-9633 Support doas parameter at rest api of yarn-service

Sub-Tasks

• Make sure all end point URL is covered by the same AuthenticationFilter: Resolved
• KerberosAuthenticationHandler Trusted Proxy Support for Knox: Resolved
• Distcp with webhdfs is not working with ProxyUserAuthenticationFilter or AuthenticationFilter: Resolved
• Enable AuthFilter as default for WebHdfs: Resolved
• Fix TimelineReaderServer ignores ProxyUserAuthenticationFilterInitializer: Resolved
• ApplicationHistoryServer related testcases failing: Resolved