[HADOOP-12048] many undeclared used dependencies (and declared unused dependencies)

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.0.0-alpha1
• Component/s: build
• Release Note: HADOOP-12048 Clean undeclared used dependencies and declared unused dependencies
• Assignee: Gabor Liptak
• Reporter: Sangjin Lee
• Created: 01/Jun/15 19:19
• Updated: 12/May/16 18:27

Description

Currently there are numerous undeclared used dependencies and declared unused dependencies in the hadoop projects.

Undeclared used dependencies are easier errors to correct, and correcting them will lead to a better management of dependencies (enabling stricter dependency frameworks down the road).

Declared unused dependencies are harder to resolve, as many may be legitimate runtime dependencies. But fixing them would lead to smaller profiles for hadoop projects.

We can do a one-time scan of dependency issues and fix them. However, in the long run, it would be nice to be able to enforce those rules via maven plug-in.

Issue Links

• is related to: HADOOP-11804 Shaded Hadoop client artifacts and minicluster

Sub-Tasks

• Clean undeclared used dependencies: Patch Available