Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-8106

Update LogAggregationIndexedFileController to use readFull instead read to avoid IOException while loading log meta

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.1.1
    • Component/s: log-aggregation
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      yarn logs command fails with below error message. Found LogAggregationIndexedFileController uses read() to read the contents of remoteLog into byte array which sometimes does not read full contents and so actual bytes read is not same as offset leading to IOException. readFully() can be used.

      WARN ifile.LogAggregationIndexedFileController: Can not get log meta from the log 
      Error on loading log meta from 
      
       if (actual != offset) {
              throw new IOException("Error on loading log meta from "
                  + remoteLogPath);
            }
      

        Attachments

          Activity

            People

            • Assignee:
              Prabhu Joseph Prabhu Joseph
              Reporter:
              Prabhu Joseph Prabhu Joseph
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: