Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-12470

Allow splits to provide custom consistent locations, instead of being tied to data locality

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0
    • llap
    • None

    Description

      LLAP instances may not run on the same nodes as HDFS, or may run on a subset of the cluster.
      Using split locations based on FileSystem locality is not very useful in such cases - since that guarantees not getting any locality.
      Allow a split to map to a specific location - so that there's a chance of getting cache locality across different queries.

      Attachments

        1. HIVE-12470.1.txt
          37 kB
          Siddharth Seth
        2. HIVE-12470.1.wip.txt
          27 kB
          Siddharth Seth
        3. HIVE-12470.2.txt
          37 kB
          Siddharth Seth

        Issue Links

          is blocked by

          Task - A task that needs to be done. HIVE-12446 Tracking jira for changes required for move to Tez 0.8.2

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue HIVE-11358 LLAP: move LlapConfiguration into HiveConf and document the settings

          • Major - Major loss of function.
          • Closed
          links to

          Web Link RB

          Activity

            People

              sseth Siddharth Seth
              sseth Siddharth Seth
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: