Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-8106

Update LogAggregationIndexedFileController to use readFully instead read to avoid IOException while loading log meta

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.1.1
    • Component/s: log-aggregation
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      yarn logs command fails with below error message. Found LogAggregationIndexedFileController uses read() to read the contents of remoteLog into byte array which sometimes does not read full contents and so actual bytes read is not same as offset leading to IOException. readFully() can be used.

      WARN ifile.LogAggregationIndexedFileController: Can not get log meta from the log 
      Error on loading log meta from 
      
       if (actual != offset) {
              throw new IOException("Error on loading log meta from "
                  + remoteLogPath);
            }
      

        Attachments

        1. YARN-8106.1.patch
          1 kB
          Prabhu Joseph

          Activity

            People

            • Assignee:
              prabhujoseph Prabhu Joseph
              Reporter:
              prabhujoseph Prabhu Joseph
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: