Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-11689

minor flow changes to ORC split generation

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0
    • None
    • None

    Description

      There are two changes that would help future work on split PPD into HBase metastore.
      1) Move non-HDFS split strategy determination logic into main thread from threadpool.
      2) Instead of iterating thru the futures and waiting, use CompletionService to get futures in order of completion. That might be useful by itself.

      Attachments

        1. HIVE-11689.patch
          14 kB
          Sergey Shelukhin
        2. HIVE-11689.01.patch
          14 kB
          Sergey Shelukhin
        3. HIVE-11689.01.patch
          13 kB
          Sergey Shelukhin

        Issue Links

          is part of

          Sub-task - The sub-task of the issue HIVE-11500 implement file footer / splits cache in HBase metastore

          • Major - Major loss of function.
          • Open

          Activity

            People

              sershe Sergey Shelukhin
              sershe Sergey Shelukhin
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: