Hadoop Common
  1. Hadoop Common
  2. HADOOP-1915

adding counters methods using String (as opposed to Enum)

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.18.0
    • Component/s: None
    • Labels:
      None
    • Environment:

      all

    • Hadoop Flags:
      Reviewed
    • Release Note:
      Provided a new method to update counters. "incrCounter(String group, String counter, long amount)"

      Description

      Currently to use the counters from within Map/Reduce code Enums have to be used, the Enum class defines the group and the Enum itself the counter. Internally they are converted to Strings (the class name and the enum toString) and you can retrieve them as strings from the client API.

      Using dynamic counters (driven by configuration of the map/reduce) is not easy with the counters Enum based API. For example, currently I have an Enum class with 50 enums and we have to map the cardinality to the counter name on the client. This is cumbersome.

      This could be easily improve by adding a String based counter method increment(String group, String counter, long count) to allow use of the counters without Enums.

      Internally this method already exists, so the changes are minimal.

      1. hadoop-1915.patch
        10 kB
        Tom White
      2. hadoop-1915-v2.patch
        10 kB
        Tom White
      3. hadoop-1915-v3.patch
        10 kB
        Tom White
      4. hadoop-1915-v4.patch
        13 kB
        Tom White
      5. hadoop-1915-v5.patch
        13 kB
        Tom White
      6. hadoop-1915-v6.patch
        13 kB
        Tom White
      7. hadoop-1915-v7.patch
        13 kB
        Owen O'Malley
      8. hadoop-1915-v8.patch
        13 kB
        Tom White
      9. hadoop-1915-v9.patch
        13 kB
        Tom White
      10. hadoop-1915-v10.patch
        17 kB
        Tom White

        Issue Links

          Activity

          Owen O'Malley made changes -
          Component/s mapred [ 12310690 ]
          Nigel Daley made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Robert Chansler made changes -
          Release Note Provides a way to update counters via String group and name. Provided a new method to update counters. "incrCounter(String group, String counter, long amount)"
          Amareshwari Sriramadasu made changes -
          Component/s mapred [ 12310690 ]
          Devaraj Das made changes -
          Release Note Provides a way to update counters via String group and name.
          Owen O'Malley made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Hadoop Flags [Reviewed]
          Tom White made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Tom White made changes -
          Attachment hadoop-1915-v10.patch [ 12381606 ]
          Owen O'Malley made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Tom White made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Tom White made changes -
          Attachment hadoop-1915-v9.patch [ 12380597 ]
          Tom White made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Tom White made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Tom White made changes -
          Fix Version/s 0.18.0 [ 12312972 ]
          Tom White made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Tom White made changes -
          Attachment hadoop-1915-v8.patch [ 12380282 ]
          Tom White made changes -
          Link This issue blocks HADOOP-3230 [ HADOOP-3230 ]
          Nigel Daley made changes -
          Fix Version/s 0.17.0 [ 12312913 ]
          Owen O'Malley made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Owen O'Malley made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Owen O'Malley made changes -
          Attachment hadoop-1915-v7.patch [ 12379451 ]
          Tom White made changes -
          Attachment hadoop-1915-v6.patch [ 12379375 ]
          Tom White made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Tom White made changes -
          Attachment hadoop-1915-v5.patch [ 12379374 ]
          Enis Soztutar made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Tom White made changes -
          Attachment hadoop-1915-v4.patch [ 12379187 ]
          Tom White made changes -
          Attachment hadoop-1915-v3.patch [ 12379015 ]
          Amareshwari Sriramadasu made changes -
          Link This issue is related to HADOOP-2818 [ HADOOP-2818 ]
          Tom White made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Tom White made changes -
          Attachment hadoop-1915-v2.patch [ 12378489 ]
          Owen O'Malley made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Owen O'Malley made changes -
          Assignee Christopher Zimmerman [ zim ] Tom White [ tomwhite ]
          Tom White made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Fix Version/s 0.17.0 [ 12312913 ]
          Tom White made changes -
          Attachment hadoop-1915.patch [ 12377780 ]
          Owen O'Malley made changes -
          Link This issue blocks HADOOP-1480 [ HADOOP-1480 ]
          Owen O'Malley made changes -
          Link This issue is blocked by HADOOP-2248 [ HADOOP-2248 ]
          Owen O'Malley made changes -
          Assignee Christopher Zimmerman [ zim ]
          FM FLOCH made changes -
          Link This issue blocks HADOOP-1328 [ HADOOP-1328 ]
          Doug Cutting made changes -
          Field Original Value New Value
          Fix Version/s 0.15.0 [ 12312565 ]
          Alejandro Abdelnur created issue -

            People

            • Assignee:
              Tom White
              Reporter:
              Alejandro Abdelnur
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development