Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-671

Mapreduce counters are not used in generated mapreduce jobs

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.0.0
    • 1.99.1
    • None
    • None

    Description

      As we're using threads to pass data instead of hadoop native way, we're loosing some counters (bytes written, number of entries) that might be interested for end user. We should propagate those counters ourselves.

      Attachments

        1. SQOOP-671-6.patch
          6 kB
          Hari Shreedharan
        2. SQOOP-671-5.patch
          15 kB
          Hari Shreedharan
        3. SQOOP-671-4.patch
          14 kB
          Hari Shreedharan
        4. SQOOP-671-3.patch
          12 kB
          Hari Shreedharan
        5. SQOOP-671-2.patch
          12 kB
          Hari Shreedharan
        6. SQOOP-671-1.patch
          10 kB
          Hari Shreedharan

        Issue Links

          blocks

          Improvement - An improvement or enhancement to an existing feature or task. SQOOP-678 Sqoop2: Add counters handling to map reduce submission engine

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link Reviewboard

          Activity

            People

              hshreedharan Hari Shreedharan
              jarcec Jarek Jarcec Cecho
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: