Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-3667 Umbrella jira for Correlation Optimizer
  3. HIVE-3668

Merge MapReduce jobs which share input tables and the same partitioning keys into a single MapReduce job

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Query Processor
    • None

    Description

      In the plan of a query, if there exists MapReduce jobs created for aggregation operators or join operators which share one or more input tables and use the same partitioning keys to shuffle the data, these jobs can be merged into a single MapReduce job. Shared tables will be only scanned once.

      Attachments

        Issue Links

          is blocked by

          New Feature - A new feature of the product, which has yet to be developed. HIVE-2206 add a new optimizer for query correlation discovery and optimization

          • Major - Major loss of function.
          • Closed

          Activity

            People

              yhuai Yin Huai
              yhuai Yin Huai
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: