Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-6315

Improve LocalResourcesTrackerImpl#isResourcePresent to return false for corrupted files

Add voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.7.3, 2.8.1
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Target Version/s:

      Description

      We currently check if a resource is present by making sure that the file exists locally. There can be a case where the LocalizationTracker thinks that it has the resource if the file exists but with size 0 or less than the "expected" size of the LocalResource. This JIRA tracks the change to harden the isResourcePresent call to address that case.

        Attachments

        1. YARN-6315.001.patch
          10 kB
          Kuhu Shukla
        2. YARN-6315.002.patch
          10 kB
          Kuhu Shukla
        3. YARN-6315.003.patch
          10 kB
          Kuhu Shukla
        4. YARN-6315.004.patch
          10 kB
          Kuhu Shukla
        5. YARN-6315.005.patch
          20 kB
          Kuhu Shukla
        6. YARN-6315.006.patch
          20 kB
          Kuhu Shukla

          Activity

            People

            • Assignee:
              kshukla Kuhu Shukla
              Reporter:
              kshukla Kuhu Shukla

              Dates

              • Created:
                Updated:

                Issue deployment