Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-3772

Proposed hadoop instrumentation API

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Incomplete
    • None
    • None
    • metrics
    • None

    Description

      We want to evolve the Hadoop metrics subsystem into a more generic Instrumentation facility. The ultimate goal is to add structured logging to Hadoop, with causal tags, a la X-trace. The existing metrics framework is not quite suitable for our needs, since the implementation and interface are tightly coupled. There's no way to use the metrics instrumentation points for anything other than metricss, and there's no way for a metrics context to find out what event just happened.

      We want to tease apart the generic notion of hookable instrumentation points, from the specifics of the information recording. The latter ought to be pluggable at run-time.

      Attachments

        1. instrumentation.patch
          9 kB
          Ariel Shemaiah Rabkin
        2. instrumentation-2.patch
          30 kB
          Ariel Shemaiah Rabkin
        3. instrumentation-3.patch
          33 kB
          Ariel Shemaiah Rabkin
        4. instrumentation-4.patch
          33 kB
          Ariel Shemaiah Rabkin
        5. tweak_inst.patch
          0.6 kB
          Ariel Shemaiah Rabkin

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            asrabkin Ariel Shemaiah Rabkin
            asrabkin Ariel Shemaiah Rabkin
            Votes:
            1 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment