Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7926 long-lived daemons for query fragment execution, I/O and caching
  3. HIVE-10104

LLAP: Generate consistent splits and locations for the same split across jobs

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • llap
    • None
    • None

    Description

      Locations for splits are currently randomized. Also, the order of splits is random - depending on how threads end up generating the splits.
      Add an option to sort the splits, and generate repeatable locations - assuming all other factors are the same.

      Attachments

        1. HIVE-10104.2.txt
          10 kB
          Siddharth Seth
        2. HIVE-10104.1.txt
          9 kB
          Siddharth Seth

        Issue Links

          Activity

            People

              sseth Siddharth Seth
              sseth Siddharth Seth
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: