[HADOOP-16076] SPNEGO+SSL Client Connections with HttpClient Broken

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.3.0, 3.2.1
• Component/s: build, security
• Assignee: Larry McCay
• Reporter: Larry McCay
• Created: 25/Jan/19 22:30
• Updated: 22/Feb/19 05:32
• Resolved: 04/Feb/19 17:41

Description

Client connections with HttpClient to a SPNEGO secured endpoint with TLS enabled break due to a misrepresentation of the SPN to include HTTPS instead of just HTTP.

The current use of HTTPClient 4.5.2 is affected by HTTPCLIENT-1712 and breaks SPNEGO with HTTPS endpoints since it include the httpS in the principal name.

We need to migrate to at least 4.5.3 as we have tested with that version and observed it fixing the issue. Need to do some due diligence to determine the cleanest version to upgrade to but will provide a patch in a day or so.

Issue Links

• is depended upon by: HADOOP-9991 Fix up Hadoop POMs, roll up JARs to latest versions
• relates to: HIVE-21306 Upgrade HttpComponents to the latest versions similar to what Hadoop has done.
• relates to: SPARK-22919 Bump Apache httpclient versions