Hive
  1. Hive
  2. HIVE-1991

Hive Shell to output number of mappers and number of reducers

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Trivial Trivial
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.8.0
    • Component/s: CLI
    • Labels:
      None

      Description

      Number of mappers and number of reducers are nice information to be outputted for users to know.

      1. HIVE-1991.2.patch
        3 kB
        Siying Dong
      2. HIVE-1991.1.patch
        3 kB
        Siying Dong

        Activity

        Siying Dong created issue -
        Siying Dong made changes -
        Field Original Value New Value
        Attachment HIVE-1991.1.patch [ 12471021 ]
        Siying Dong made changes -
        Attachment HIVE-1991.1.patch [ 12471021 ]
        Siying Dong made changes -
        Attachment HIVE-1991.1.patch [ 12471023 ]
        Siying Dong made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Hide
        Ning Zhang added a comment -

        I will take a look

        Show
        Ning Zhang added a comment - I will take a look
        Hide
        Ning Zhang added a comment -

        ExecDriver.java:

        • line 371: getMapTaskReports -> getReduceTaskReports
        • ss.getHiveHistory is keeping a map for # of mappers/reducers, but they are not used anywhere else. Is it needed at all?

        Otherwise it looks good

        Show
        Ning Zhang added a comment - ExecDriver.java: line 371: getMapTaskReports -> getReduceTaskReports ss.getHiveHistory is keeping a map for # of mappers/reducers, but they are not used anywhere else. Is it needed at all? Otherwise it looks good
        Hide
        Siying Dong added a comment -

        Thanks Ning for the comment.
        Changed getMapTaskReports -> getReduceTaskReports.

        HiveHistory is dumped to history .txt file. It already dumps information like hadoop ID, job progress, rows inserted, etc. I think it's straight-forward to also put this information there.

        Show
        Siying Dong added a comment - Thanks Ning for the comment. Changed getMapTaskReports -> getReduceTaskReports. HiveHistory is dumped to history .txt file. It already dumps information like hadoop ID, job progress, rows inserted, etc. I think it's straight-forward to also put this information there.
        Siying Dong made changes -
        Attachment HIVE-1991.2.patch [ 12471040 ]
        Hide
        Ning Zhang added a comment -

        +1. will commit if tests pass.

        Show
        Ning Zhang added a comment - +1. will commit if tests pass.
        Hide
        Ning Zhang added a comment -

        Committed. Thanks Siying!

        Show
        Ning Zhang added a comment - Committed. Thanks Siying!
        Ning Zhang made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Fix Version/s 0.8.0 [ 12316178 ]
        Resolution Fixed [ 1 ]
        Hide
        Siying Dong added a comment -

        This change was overriden by HIVE-1950.

        Show
        Siying Dong added a comment - This change was overriden by HIVE-1950 .
        Carl Steinbach made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Patch Available Patch Available
        18m 56s 1 Siying Dong 14/Feb/11 21:54
        Patch Available Patch Available Resolved Resolved
        17h 52m 1 Ning Zhang 15/Feb/11 15:46
        Resolved Resolved Closed Closed
        304d 8h 10m 1 Carl Steinbach 16/Dec/11 23:57

          People

          • Assignee:
            Siying Dong
            Reporter:
            Siying Dong
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development