Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-13925 ETL optimizations
  3. HIVE-14070

hive.tez.exec.print.summary=true returns wrong performance numbers on HS2

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersConvert to IssueMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.0.0
    • 2.3.0
    • None
    • None

    Description

      On master, we have

      Query Execution Summary
      ----------------------------------------------------------------------------------------------
      OPERATION                            DURATION
      ----------------------------------------------------------------------------------------------
      Compile Query                       -1466208820.74s
      Prepare Plan                            0.00s
      Submit Plan                         1466208825.50s
      Start DAG                               0.26s
      Run DAG                                 4.39s
      ----------------------------------------------------------------------------------------------
      
      Task Execution Summary
      ----------------------------------------------------------------------------------------------
        VERTICES   DURATION(ms)  CPU_TIME(ms)  GC_TIME(ms)  INPUT_RECORDS  OUTPUT_RECORDS
      ----------------------------------------------------------------------------------------------
           Map 1        1014.00         1,534           11          1,500               1
       Reducer 2          96.00           541            0              1               0
      ----------------------------------------------------------------------------------------------
      
      

      sounds like a real issue.

      Attachments

        1. HIVE-14070.03.patch
          6 kB
          Pengcheng Xiong
        2. HIVE-14070.02.patch
          6 kB
          Pengcheng Xiong
        3. HIVE-14070.01.patch
          6 kB
          Pengcheng Xiong

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            pxiong Pengcheng Xiong Assign to me
            pxiong Pengcheng Xiong
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment