[GIRAPH-1180] Remove support for Hadoop 1 and older

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.3.0
• Component/s: mapreduce
• Assignee: Unassigned
• Reporter: Adam Kennedy
• Created: 20/Mar/18 18:20
• Updated: 09/Nov/18 16:12

Description

Due to all the munge logic and support for nearly 10 year old APIs, Giraph feels much harder to maintain than it should be.

The majority of projects in this large scale Hadoop based compute space maintain a much shorter compatibility window. I'm not sure if anyone is still running installations of Hadoop 0.20 but it doesn't seem reasonable to continue to support them if it adds a maintenance burden.

Removing support for, at minimum, Hadoop versions before 1.0 would start to reduce the amount of munging that is needed and likely make it easier to maintain and contribute to the project.

Removing support for Hadoop 1.X versions and support for legacy MapReduce 1 might remove even more complexity.

If there is concern about users of ancient Hadoop releases who are currently building from trunk and don't have the option of a production release, we could do this following a 1.3.0 release which could be declared as the last release to support Hadoop releases prior to 2.0.

 

Issue Links

• Blocked: GIRAPH-1121 CDH Profile does not work
• is duplicated by: GIRAPH-940 Cleanup the list of supported hadoop versions.