Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-20491

Fix mapjoin size estimations for Fast implementation

    XMLWordPrintableJSON

Details

    Description

      HIVE-19824 have fixed the estimations; but it calculated for the "optimized" impl; the "fast" one has a little bit bigger footprint.

      It also seems like fast is a bit overestimated at runtime...that should be also taken care of.

      numkeys implementation compiler estimation runtime estimation runtime measurement ce / rm re / rm
      25M FAST 1168435456 2189433712 1513584984 .77 1.44
      25M OPTIMIZED 1168435456 1191203764 1168439664 100% 1.01

      Attachments

        1. HIVE-20491.01.patch
          10 kB
          Zoltan Haindrich
        2. HIVE-20491.01wip02.patch
          10 kB
          Zoltan Haindrich
        3. HIVE-20491.02.patch
          16 kB
          Zoltan Haindrich

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-19824 Improve online datasize estimations for MapJoins

          • Major - Major loss of function.
          • Closed

          Activity

            People

              kgyrtkirk Zoltan Haindrich
              kgyrtkirk Zoltan Haindrich
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: