Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-3970

Counters written to the job history cannot be recovered back

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.19.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Added getEscapedCompactString() and fromEscapedCompactString() to Counters.java to represent counters as Strings and to reconstruct the counters from the Strings.

      Description

      Counters that are written to the JobHistory are stringified using Counters.makeCompactString(). The format in which this api converts the counter into a string is groupname.countername:value. The problem is that groupname and countername can contain a '.' and hence recovering the counter becomes difficult. Since JobHistory can be used for various purposes, reconstructing the counter object back might be useful. One such usecase is HADOOP-3245. There should be some way to recover the counter object back from its string representation and also to keep the string version readable.

        Attachments

        1. HADOOP-3970-v1.patch
          4 kB
          Amar Kamat
        2. HADOOP-3970-v2.patch
          19 kB
          Amar Kamat
        3. HADOOP-3970-v3.patch
          20 kB
          Amar Kamat
        4. HADOOP-3970-v4.1.patch
          18 kB
          Amar Kamat
        5. HADOOP-3970-v4.patch
          20 kB
          Amar Kamat

          Issue Links

            Activity

              People

              • Assignee:
                amar_kamat Amar Kamat
                Reporter:
                amar_kamat Amar Kamat
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: