[HBASE-22314] shaded byo-hadoop client should list needed hadoop modules as provided scope to avoid inclusion of unnecessary transitive depednencies

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.1.0, 2.2.0, 2.3.0
• Fix Version/s: 3.0.0-alpha-1, 2.2.0, 2.3.0, 2.1.5
• Component/s: hadoop2, hadoop3, shading
• Assignee: Sean Busbey
• Reporter: Sean Busbey
• Created: 25/Apr/19 16:01
• Updated: 17/May/19 00:16
• Resolved: 06/May/19 03:28

Description

attempting to build against current hadoop trunk for HBASE-22087 shows that hte byo-hadoop client is trying to package transitive dependencies from the hadoop dependencies that we expressly say we don't need to bring with us.

it's because we don't list those modules as provided, so all of their transitives are also in compile scope. The shading module does simple filtering when excluding things in a given scope, it doesn't e.g. make sure to also exclude the transitive dependencies of things it keeps out.

since we don't want to list all the transitive dependencies of hadoop in our shading exclusion, we should list the needed hadoop modules as provided.

Issue Links

• relates to: HBASE-22087 Update LICENSE/shading for the dependencies from the latest Hadoop trunk