[SLIDER-1241] ApplicationWithAddonPackagesIT tests fail in WASB due to HDFS mkdirs API not adhering to "mkdir -p" semantics

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Slider 0.92
• Fix Version/s: Slider 1.0.0
• Component/s: test
• Assignee: Gour Saha
• Reporter: Gour Saha
• Created: 24/Aug/17 06:00
• Updated: 30/Aug/17 17:17
• Resolved: 24/Aug/17 06:51

Description

ApplicationWithAddonPackagesIT tests try to create /tmp/test_slider.txt, but ensures the parent dir exists by calling mkdirs API. In cases when /tmp exists the tests fail. The HDFS mkdirs API says that it adheres to "mkdir -p" semantics and that the "Existence of the directory hierarchy is not an error" - https://hadoop.apache.org/docs/stable/api/org/apache/hadoop/fs/FileSystem.html#mkdirs-org.apache.hadoop.fs.Path-org.apache.hadoop.fs.permission.FsPermission-

Seems like WASB does not conform to this API definition.