[YARN-8106] Update LogAggregationIndexedFileController to use readFully instead read to avoid IOException while loading log meta

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 3.1.1
• Component/s: log-aggregation
• Target Version/s: 3.1.1
• Hadoop Flags: Reviewed
• Assignee: Prabhu Joseph
• Reporter: Prabhu Joseph
• Created: 02/Apr/18 13:13
• Updated: 17/Jun/20 09:20
• Resolved: 04/Apr/18 04:16

Description

yarn logs command fails with below error message. Found LogAggregationIndexedFileController uses read() to read the contents of remoteLog into byte array which sometimes does not read full contents and so actual bytes read is not same as offset leading to IOException. readFully() can be used.

WARN ifile.LogAggregationIndexedFileController: Can not get log meta from the log 
Error on loading log meta from 

 if (actual != offset) {
        throw new IOException("Error on loading log meta from "
            + remoteLogPath);
      }