Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-12470

Allow splits to provide custom consistent locations, instead of being tied to data locality

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0
    • llap
    • None

    Description

      LLAP instances may not run on the same nodes as HDFS, or may run on a subset of the cluster.
      Using split locations based on FileSystem locality is not very useful in such cases - since that guarantees not getting any locality.
      Allow a split to map to a specific location - so that there's a chance of getting cache locality across different queries.

      Attachments

        1. HIVE-12470.2.txt
          37 kB
          Siddharth Seth
        2. HIVE-12470.1.txt
          37 kB
          Siddharth Seth
        3. HIVE-12470.1.wip.txt
          27 kB
          Siddharth Seth

        Issue Links

          Activity

            People

              sseth Siddharth Seth
              sseth Siddharth Seth
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: