Hadoop YARN
  1. Hadoop YARN
  2. YARN-3310

MR-279: Log info about the location of dist cache

    Details

    • Type: Improvement Improvement
    • Status: Open
    • Priority: Minor Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Currently, there is no log info available about the actual location of the file/archive in dist cache being used by the task except for the "ln" command in task.sh. We need to log this information to help in debugging esp in those cases where there are more than one archive with the same name.
      In 0.20.x, in task logs, one could find log info such as the following:
      INFO org.apache.hadoop.mapred.TaskRunner: Creating symlink: <distcache location>/archive <- <mapred.local.dir>/archive

        Activity

        Siddharth Seth made changes -
        Assignee Siddharth Seth [ sseth ]
        Allen Wittenauer made changes -
        Project Hadoop Map/Reduce [ 12310941 ] Hadoop YARN [ 12313722 ]
        Key MAPREDUCE-2758 YARN-3310
        Issue Type Bug [ 1 ] Improvement [ 4 ]
        Affects Version/s 0.23.0 [ 12315570 ]
        Component/s mrv2 [ 12314301 ]
        Allen Wittenauer made changes -
        Fix Version/s 0.24.0 [ 12317654 ]
        Arun C Murthy made changes -
        Fix Version/s 0.24.0 [ 12317654 ]
        Fix Version/s 0.23.1 [ 12318883 ]
        Arun C Murthy made changes -
        Fix Version/s 0.23.1 [ 12318883 ]
        Fix Version/s 0.23.0 [ 12315570 ]
        Siddharth Seth made changes -
        Field Original Value New Value
        Assignee Siddharth Seth [ sseth ]
        Ramya Sunil created issue -

          People

          • Assignee:
            Unassigned
            Reporter:
            Ramya Sunil
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:

              Development