Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17066

Query78 filter wrong estimatation is generating bad plan

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 3.0.0
    • None
    • None

    Description

      Filter operator is estimating 1 row following a left outer join causing bad estimates

      Reducer 12 
                  Execution mode: vectorized, llap
                  Reduce Operator Tree:
                    Map Join Operator
                      condition map:
                           Left Outer Join0 to 1
                      keys:
                        0 KEY.reducesinkkey0 (type: bigint), KEY.reducesinkkey1 (type: bigint)
                        1 KEY.reducesinkkey0 (type: bigint), KEY.reducesinkkey1 (type: bigint)
                      outputColumnNames: _col0, _col1, _col3, _col4, _col5, _col6, _col8
                      input vertices:
                        1 Map 14
                      Statistics: Num rows: 71676270660 Data size: 3727166074320 Basic stats: COMPLETE Column stats: COMPLETE
                      Filter Operator
                        predicate: _col8 is null (type: boolean)
                        Statistics: Num rows: 1 Data size: 52 Basic stats: COMPLETE Column stats: COMPLETE
                        Select Operator
                          expressions: _col0 (type: bigint), _col1 (type: bigint), _col3 (type: int), _col4 (type: double), _col5 (type: double), _col6 (type: bigint)
                          outputColumnNames: _col0, _col1, _col3, _col4, _col5, _col6
                          Statistics: Num rows: 1 Data size: 52 Basic stats: COMPLETE Column stats: COMPLETE
      

      Attachments

        1. HIVE-17066.1.patch
          10 kB
          Vineet Garg
        2. HIVE-17066.2.patch
          140 kB
          Vineet Garg
        3. HIVE-17066.3.patch
          172 kB
          Vineet Garg
        4. HIVE-17066.4.patch
          169 kB
          Vineet Garg
        5. HIVE-17066.5.patch
          168 kB
          Vineet Garg

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            vgarg Vineet Garg Assign to me
            vgarg Vineet Garg
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment