Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-6315

Improve LocalResourcesTrackerImpl#isResourcePresent to return false for corrupted files

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 2.7.3, 2.8.1
    • None
    • None
    • None

    Description

      We currently check if a resource is present by making sure that the file exists locally. There can be a case where the LocalizationTracker thinks that it has the resource if the file exists but with size 0 or less than the "expected" size of the LocalResource. This JIRA tracks the change to harden the isResourcePresent call to address that case.

      Attachments

        1. YARN-6315.001.patch
          10 kB
          Kuhu Shukla
        2. YARN-6315.002.patch
          10 kB
          Kuhu Shukla
        3. YARN-6315.003.patch
          10 kB
          Kuhu Shukla
        4. YARN-6315.004.patch
          10 kB
          Kuhu Shukla
        5. YARN-6315.005.patch
          20 kB
          Kuhu Shukla
        6. YARN-6315.006.patch
          20 kB
          Kuhu Shukla

        Activity

          People

            kshukla Kuhu Shukla
            kshukla Kuhu Shukla
            Votes:
            0 Vote for this issue
            Watchers:
            16 Start watching this issue

            Dates

              Created:
              Updated: