Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3310

MR-279: Log info about the location of dist cache

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      Currently, there is no log info available about the actual location of the file/archive in dist cache being used by the task except for the "ln" command in task.sh. We need to log this information to help in debugging esp in those cases where there are more than one archive with the same name.
      In 0.20.x, in task logs, one could find log info such as the following:
      INFO org.apache.hadoop.mapred.TaskRunner: Creating symlink: <distcache location>/archive <- <mapred.local.dir>/archive

      Attachments

        Activity

          People

            Unassigned Unassigned
            rramya Ramya Sunil
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: