[HDFS-17501] Add a parameter "redirectByIPAddress" to WebHDFS

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: webhdfs
• Labels: pull-request-available
• Assignee: Ye Ni
• Reporter: Ye Ni
• Created: 27/Apr/24 07:36
• Updated: 28/Apr/24 15:18

Description

Provide a WebHDFS parameter so the redirect URL to a datanode can have an option on hostname or IP address.

This takes effect for both NameNode and Router WebHDFS. Default value is false, which is consistent with current behavior.

 

curl --insecure -i -X PUT "https://localhost:81/webhdfs/v1/user/test/test.ini?op=CREATE&redirectByIpAddress=true"
HTTP/1.1 307 Temporary Redirect
Location: https://127.0.0.1:10076/webhdfs/v1/user/test/test.ini?op=CREATE&namenoderpcaddress=localhost&createflag=&createparent=true&overwrite=false

curl --insecure -i -X PUT "https://localhost:81/webhdfs/v1/user/test/test.ini?op=CREATE&redirectByIpAddress=false"
HTTP/1.1 307 Temporary Redirect
Location: https://localhost:10076/webhdfs/v1/user/test/test.ini?op=CREATE&namenoderpcaddress=localhost&createflag=&createparent=true&overwrite=false

curl --insecure -i -X PUT "https://localhost:81/webhdfs/v1/user/test/test.ini?op=CREATE"
HTTP/1.1 307 Temporary Redirect
Location: https://localhost:10076/webhdfs/v1/user/test/test.ini?op=CREATE&namenoderpcaddress=localhost&createflag=&createparent=true&overwrite=false

 

HttpFS doesn't need this change because HttpFS always uses the same URI as requested to redirect.

Issue Links

• links to: GitHub Pull Request #6775