[SOLR-11261] Update to Hadoop 2.7.4

• Type: Improvement
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 6.6
• Fix Version/s: 6.6.1, 6.7, 7.0, 7.1, 8.0
• Component/s: Hadoop Integration, hdfs
• Assignee: Uwe Schindler
• Reporter: Uwe Schindler
• Created: 20/Aug/17 11:20
• Updated: 08/Jun/19 15:21
• Resolved: 20/Aug/17 22:24

Description

In SOLR-10966 we added a "bad" workaround to prevent Hadoop's Shell class from breaking with Java 9 (StringIndexOutOfBoundsException). This was resolved in Hadoop 2.7.4, released a few weeks ago. We should revert the bad hack and update Hadoop.

After running tests, I see no issue with the bugfix relaese.

I will commit to master and 7.x and once it settled, I will backport. If we can't get this into 6.6.1, it's not so bad, but then we have to live with the "bad" hack there.

Issue Links

• depends upon: HADOOP-14586 StringIndexOutOfBoundsException breaks org.apache.hadoop.util.Shell on 2.7.x with Java 9
• supercedes: SOLR-10966 Add workaround for Hadoop-Common 2.7.2 incompatibility with Java 9