[MAPREDUCE-1334] contrib/index - test - TestIndexUpdater fails due to an additional presence of file _SUCCESS in hdfs

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.23.0
• Component/s: contrib/index
• Hadoop Flags: Reviewed
• Assignee: Karthik K
• Reporter: Karthik K
• Created: 25/Dec/09 10:17
• Updated: 15/Nov/11 00:50
• Resolved: 10/Dec/10 02:12

Description

$ cd src/contrib/index
$ ant clean test

This fails the test TestIndexUpdater due to a mismatch in the - doneFileNames - data structure, when it is being run with different parameters.

(ArrayIndexOutOfBoundsException raised when inserting elements in doneFileNames, array ).

Debugging further - there seems to be an additional file called as - hdfs://localhost:36021/myoutput/_SUCCESS , taken into consideration in addition to those that begins with done* . The presence of the extra file causes the error.

Attaching a patch that would circumvent this by increasing the array length of shards by 1 .

But longer term the test fixtures need to be probably revisited to see if the presence of _SUCCESS as a file is a good thing to begin with before we even get to this test case.

Any comments / suggestions on the same welcome.