Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-14516

OrcInputFormat.SplitGenerator.callInternal() can be optimized

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.2.0
    • 4.0.0-alpha-1
    • Transactions
    • None

    Description

      callIntenal() has
      // We can't eliminate stripes if there are deltas because the
      // deltas may change the rows making them match the predicate.

      but in Acid 2.0, the deltas only have delete events thus eliminating stripes from "base" of split should be safe.

      cc gopalv

      Attachments

        1. HIVE-14516.01.patch
          2 kB
          Igor Kryvenko

        Issue Links

          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. HIVE-14607 ORC split generation failed with exception: java.lang.ArrayIndexOutOfBoundsException: 1

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          requires

          New Feature - A new feature of the product, which has yet to be developed. HIVE-14035 Enable predicate pushdown to delta files created by ACID Transactions

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. HIVE-17089 make acid 2.0 the default

          • Major - Major loss of function.
          • Closed

          Activity

            People

              ikryvenko Igor Kryvenko
              ekoifman Eugene Koifman
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: