Hadoop YARN
  1. Hadoop YARN
  2. YARN-3310

MR-279: Log info about the location of dist cache

    Details

    • Type: Improvement Improvement
    • Status: Open
    • Priority: Minor Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Currently, there is no log info available about the actual location of the file/archive in dist cache being used by the task except for the "ln" command in task.sh. We need to log this information to help in debugging esp in those cases where there are more than one archive with the same name.
      In 0.20.x, in task logs, one could find log info such as the following:
      INFO org.apache.hadoop.mapred.TaskRunner: Creating symlink: <distcache location>/archive <- <mapred.local.dir>/archive

        Activity

        Ramya Sunil created issue -
        Siddharth Seth made changes -
        Field Original Value New Value
        Assignee Siddharth Seth [ sseth ]
        Arun C Murthy made changes -
        Fix Version/s 0.23.1 [ 12318883 ]
        Fix Version/s 0.23.0 [ 12315570 ]
        Arun C Murthy made changes -
        Fix Version/s 0.24.0 [ 12317654 ]
        Fix Version/s 0.23.1 [ 12318883 ]
        Allen Wittenauer made changes -
        Fix Version/s 0.24.0 [ 12317654 ]
        Allen Wittenauer made changes -
        Project Hadoop Map/Reduce [ 12310941 ] Hadoop YARN [ 12313722 ]
        Key MAPREDUCE-2758 YARN-3310
        Issue Type Bug [ 1 ] Improvement [ 4 ]
        Affects Version/s 0.23.0 [ 12315570 ]
        Component/s mrv2 [ 12314301 ]
        Siddharth Seth made changes -
        Assignee Siddharth Seth [ sseth ]

          People

          • Assignee:
            Unassigned
            Reporter:
            Ramya Sunil
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:

              Development