Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-20738 Enable Delete Event filtering in VectorizedOrcAcidRowBatchReader
  3. HIVE-20730

Do delete event filtering even if hive.acid.index is not there

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 4.0.0
    • 4.0.0-alpha-1
    • Transactions
    • None
    • n/a

    Description

      since HIVE-16812 VectorizedOrcAcidRowBatchReader filters delete events based on min/max ROW__ID in the split which relies on hive.acid.index to be in the ORC footer.

      There is no way to generate hive.acid.index from a plain query as in HIVE-20699 and so we need to make sure that we generate a SARG into delete_delta/bucket_x based on stripe stats even the index is missing

      Attachments

        1. HIVE-20730.patch
          5 kB
          Saurabh Seth
        2. HIVE-20730.3.patch
          10 kB
          Saurabh Seth
        3. HIVE-20730.2.patch
          10 kB
          Saurabh Seth

        Activity

          People

            saurabhseth Saurabh Seth
            ekoifman Eugene Koifman
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: