Hive
  1. Hive
  2. HIVE-2083

Bug: RowContainer was set to 1 in JoinUtils.

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.8.0
    • Component/s: Query Processor
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      This cause the skew join super slow because the row container dump every record to disk before using them.

        Activity

        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Patch Available Patch Available
        3m 33s 1 He Yongqiang 30/Mar/11 01:57
        Patch Available Patch Available Resolved Resolved
        1d 1m 1 Namit Jain 31/Mar/11 01:58
        Resolved Resolved Closed Closed
        260d 22h 57m 1 Carl Steinbach 16/Dec/11 23:56
        Carl Steinbach made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Carl Steinbach made changes -
        Fix Version/s 0.8.0 [ 12316178 ]
        Component/s Query Processor [ 12312586 ]
        Namit Jain made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Resolution Fixed [ 1 ]
        Hide
        Namit Jain added a comment -

        Committed. Thanks Yongqiang

        Show
        Namit Jain added a comment - Committed. Thanks Yongqiang
        Hide
        Namit Jain added a comment -

        +1

        Show
        Namit Jain added a comment - +1
        He Yongqiang made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        He Yongqiang made changes -
        Attachment HIVE-2083.1.patch [ 12474945 ]
        Hide
        He Yongqiang added a comment -

        And also in our internal env, the FS.listStatus can return NULL instead of zero length array. Added a fix for this also.

        Show
        He Yongqiang added a comment - And also in our internal env, the FS.listStatus can return NULL instead of zero length array. Added a fix for this also.
        He Yongqiang made changes -
        Field Original Value New Value
        Description This cause the skew join super slow because the row container dump every record to disk before using them.
        He Yongqiang created issue -

          People

          • Assignee:
            He Yongqiang
            Reporter:
            He Yongqiang
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development