[HDDS-2188] Implement LocatedFileStatus & getFileBlockLocations to provide node/localization information to Yarn/Mapreduce

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.5.0
• Fix Version/s: 0.5.0
• Component/s: Ozone Filesystem
• Labels: pull-request-available
• Target Version/s: 0.5.0
• Assignee: Aravindan Vijayan
• Reporter: Mukul Kumar Singh
• Created: 26/Sep/19 15:22
• Updated: 11/Feb/20 22:27
• Resolved: 11/Feb/20 22:27

Description

For applications like Hive/MapReduce to take advantage of the data locality in Ozone, Ozone should return the location of the Ozone blocks. This is needed for better read performance for Hadoop Applications.

        if (file instanceof LocatedFileStatus) {
          blkLocations = ((LocatedFileStatus) file).getBlockLocations();
        } else {
          blkLocations = fs.getFileBlockLocations(file, 0, length);
        }

Issue Links

• is related to: HDDS-2914 Certain Hive queries started to fail on generating splits
• links to: GitHub Pull Request #331
• links to: GitHub Pull Request #470
• links to: GitHub Pull Request #1631