[OODT-572] Replace mkdir with more multi-thread resilient forceMkdir in LocalDataTransferer

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.1-incubating, 0.2, 0.3, 0.4, 0.5
• Fix Version/s: 0.6
• Component/s: file manager

Environment

internal JPL ACOS/OCO2 environment

• Assignee: Chris A. Mattmann
• Reporter: Chris A. Mattmann
• Created: 09/Mar/13 18:54
• Updated: 08/Jun/13 00:06
• Resolved: 08/Jun/13 00:06

Description

From Albert Y Chang at JPL:

We have been seeing intermittent (non-repeatable) ingest errors (Destination … directory cannot be created) from LocalDataTransferrer which we believe occurs when multiple ingest processes are copying files to the same not-yet existent repo directory; there's a race condition to make the same parent dirs, and all but the first fails.