[HDFS-15706] HttpFS: Log more information on request failures

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.3.1, 3.4.0, 3.2.3
• Component/s: httpfs
• Labels: pull-request-available
• Assignee: Ahmed Hussein
• Reporter: Ahmed Hussein
• Created: 03/Dec/20 18:12
• Updated: 10/Jun/21 07:44
• Resolved: 03/Dec/20 23:16

Description

kihwal reported that the exception provider does not log anything for the requests failing with 403 or 500. This has made debugging extremely difficult. As more customers are using HttpFS server, this needs an improvement:

• Turn on/off logging.
• Log the full stack trace with the exception when it is on.

Issue Links

• links to: GitHub Pull Request #2515