Uploaded image for project: 'Nutch'
  1. Nutch
  2. NUTCH-2838 Apache Tez integration
  3. NUTCH-2839

Implement Tez counters in Injector job

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.18
    • 1.21
    • injector, tez
    • None

    Description

      When running the Injector job on Tez, counters are not populated. This makes sense as all existing counters are created using MapReduce framework Context objects. This presents a major issue however. Counters are a requirement as they are key to regular inspections of ongoing crawls, finding errors and debugging. The org.apache.tez.common.counters package may offer a equivalent replacement. This issue will be investigated in this ticket.

      Attachments

        Issue Links

          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. TEZ-4371 Implement ClientServiceDelegate.getJobCounters

          • Major - Major loss of function.
          • Open

          Activity

            People

              lewismc Lewis John McGibbney
              lewismc Lewis John McGibbney
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: