Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-3970

Counters written to the job history cannot be recovered back

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.19.0
    • None
    • None
    • Reviewed
    • Added getEscapedCompactString() and fromEscapedCompactString() to Counters.java to represent counters as Strings and to reconstruct the counters from the Strings.

    Description

      Counters that are written to the JobHistory are stringified using Counters.makeCompactString(). The format in which this api converts the counter into a string is groupname.countername:value. The problem is that groupname and countername can contain a '.' and hence recovering the counter becomes difficult. Since JobHistory can be used for various purposes, reconstructing the counter object back might be useful. One such usecase is HADOOP-3245. There should be some way to recover the counter object back from its string representation and also to keep the string version readable.

      Attachments

        1. HADOOP-3970-v1.patch
          4 kB
          Amar Kamat
        2. HADOOP-3970-v2.patch
          19 kB
          Amar Kamat
        3. HADOOP-3970-v3.patch
          20 kB
          Amar Kamat
        4. HADOOP-3970-v4.1.patch
          18 kB
          Amar Kamat
        5. HADOOP-3970-v4.patch
          20 kB
          Amar Kamat

        Issue Links

          Activity

            People

              amar_kamat Amar Kamat
              amar_kamat Amar Kamat
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: