Sqoop
  1. Sqoop
  2. SQOOP-671

Mapreduce counters are not used in generated mapreduce jobs

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.0
    • Fix Version/s: 1.99.1
    • Component/s: None
    • Labels:
      None

      Description

      As we're using threads to pass data instead of hadoop native way, we're loosing some counters (bytes written, number of entries) that might be interested for end user. We should propagate those counters ourselves.

      1. SQOOP-671-1.patch
        10 kB
        Hari Shreedharan
      2. SQOOP-671-2.patch
        12 kB
        Hari Shreedharan
      3. SQOOP-671-3.patch
        12 kB
        Hari Shreedharan
      4. SQOOP-671-4.patch
        14 kB
        Hari Shreedharan
      5. SQOOP-671-5.patch
        15 kB
        Hari Shreedharan
      6. SQOOP-671-6.patch
        6 kB
        Hari Shreedharan

        Issue Links

          Activity

          Jarek Jarcec Cecho created issue -
          Jarek Jarcec Cecho made changes -
          Field Original Value New Value
          Link This issue blocks SQOOP-678 [ SQOOP-678 ]
          Hari Shreedharan made changes -
          Attachment SQOOP-671-1.patch [ 12552729 ]
          Hari Shreedharan made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Assignee Hari Shreedharan [ hshreedharan ]
          Hari Shreedharan made changes -
          Remote Link This issue links to "Reviewboard (Web Link)" [ 11423 ]
          Hari Shreedharan made changes -
          Attachment SQOOP-671-2.patch [ 12552731 ]
          Hari Shreedharan made changes -
          Attachment SQOOP-671-3.patch [ 12552767 ]
          Hari Shreedharan made changes -
          Attachment SQOOP-671-4.patch [ 12552889 ]
          Hari Shreedharan made changes -
          Attachment SQOOP-671-5.patch [ 12552996 ]
          Hari Shreedharan made changes -
          Attachment SQOOP-671-6.patch [ 12553521 ]
          Jarek Jarcec Cecho made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Jarek Jarcec Cecho made changes -
          Fix Version/s 1.99.1 [ 12323641 ]
          Fix Version/s 2.0.0 [ 12319272 ]

            People

            • Assignee:
              Hari Shreedharan
              Reporter:
              Jarek Jarcec Cecho
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development