[MAPREDUCE-4234] SortValidator.java is incompatible with multi-user or parallel use (due to a /tmp file with static name) - ASF JIRA

Voters

Watch issue

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Resolved
Priority: Minor
Resolution: Fixed
Affects Version/s: 0.23.3
Fix Version/s: None
Component/s: examples
Labels:
None

Target Version/s:

0.23.3, 2.0.2-alpha

Description

The SortValidator.java file checkRecords method creates a file in the /tmp/sortvalidator directory using a static filename. This can result in failures due to name collisions when the hadoop-mapreduce-client-jobclient-*-tests jar is used by more than one task or one user simultaneously. We use this jar when testing compression codecs and after we started running tests in parallel (four at a time to reduce overall test time) we started experiencing random test failures due to name collisions. Creating a random or unique per thread filename may resolve this issue. We have developed a change to introduce per use unique file names.