Hive
  1. Hive
  2. HIVE-2425

Print the counters SLOTS_MILLIS_MAPS and SLOTS_MILLIS_REDUCES to the Hive CLI output.

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Not A Problem
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Activity

      Hide
      Kevin Wilfong added a comment -

      This is no longer necessary given the restructuring of MapRedStats.java

      Show
      Kevin Wilfong added a comment - This is no longer necessary given the restructuring of MapRedStats.java
      Hide
      jiraposter@reviews.apache.org added a comment -

      -----------------------------------------------------------
      This is an automatically generated e-mail. To reply, visit:
      https://reviews.apache.org/r/1697/
      -----------------------------------------------------------

      Review request for hive and Siying Dong.

      Summary
      -------

      I print the new stats out where we are already printing out the other map reduce stats for each job.

      This addresses bug HIVE-2425.
      https://issues.apache.org/jira/browse/HIVE-2425

      Diffs


      trunk/ql/src/java/org/apache/hadoop/hive/ql/MapRedStats.java 1164320
      trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/HadoopJobExecHelper.java 1164320

      Diff: https://reviews.apache.org/r/1697/diff

      Testing
      -------

      I ran a query in local mode and verified the stats were not printed.
      I ran a map only query and verified only the map time was printed.
      I ran a query involving multiple jobs involving both map only and map and reduce, and verified that the appropriate stats were printed for each.

      In all cases, I verified the query completed successfully.

      Thanks,

      Kevin

      Show
      jiraposter@reviews.apache.org added a comment - ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/1697/ ----------------------------------------------------------- Review request for hive and Siying Dong. Summary ------- I print the new stats out where we are already printing out the other map reduce stats for each job. This addresses bug HIVE-2425 . https://issues.apache.org/jira/browse/HIVE-2425 Diffs trunk/ql/src/java/org/apache/hadoop/hive/ql/MapRedStats.java 1164320 trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/HadoopJobExecHelper.java 1164320 Diff: https://reviews.apache.org/r/1697/diff Testing ------- I ran a query in local mode and verified the stats were not printed. I ran a map only query and verified only the map time was printed. I ran a query involving multiple jobs involving both map only and map and reduce, and verified that the appropriate stats were printed for each. In all cases, I verified the query completed successfully. Thanks, Kevin

        People

        • Assignee:
          Kevin Wilfong
          Reporter:
          Kevin Wilfong
        • Votes:
          0 Vote for this issue
          Watchers:
          0 Start watching this issue

          Dates

          • Created:
            Updated:
            Resolved:

            Development