[HADOOP-16963] HADOOP-16582 changed mkdirs() behavior

• Type: Bug
• Status: Open
• Priority: Critical
• Resolution: Unresolved
• Affects Version/s: 2.10.0, 3.3.0, 2.8.6, 2.9.3, 3.1.3, 3.2.2
• Target Version/s: 3.3.9
• Assignee: Unassigned
• Reporter: Wei-Chiu Chuang
• Created: 08/Apr/20 18:21
• Updated: 29/Nov/22 15:55

Description

HADOOP-16582 changed behavior of mkdirs()
Some Hive tests depend on the old behavior and they fail miserably.

earlier:

all plain mkdirs(somePath) were fast-tracked to FileSystem.mkdirs which have rerouted them to mkdirs(somePath, somePerm) method with some defaults (which were static)
an implementation of FileSystem have only needed implement "mkdirs(somePath, somePerm)" - because the other was not neccessarily called if it was always in a FilterFileSystem or something like that
now:

especially FilterFileSystem forwards the call of mkdirs(p) to the actual fs implementation...which may skip overriden mkdirs(somPath,somePerm) methods
...and could cause issues for existing FileSystem implementations

File this jira to address this problem.

kgyrtkirk [e-mail] kihwal

Issue Links

• is caused by: HADOOP-16582 LocalFileSystem's mkdirs() does not work as expected under viewfs.
• is related to: HIVE-23751 QTest: Override #mkdirs() method in ProxyFileSystem To Align After HADOOP-16582