Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-20738 Enable Delete Event filtering in VectorizedOrcAcidRowBatchReader
  3. HIVE-20730

Do delete event filtering even if hive.acid.index is not there

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 4.0.0
    • Fix Version/s: 4.0.0
    • Component/s: Transactions
    • Labels:
      None
    • Target Version/s:
    • Release Note:
      n/a

      Description

      since HIVE-16812 VectorizedOrcAcidRowBatchReader filters delete events based on min/max ROW__ID in the split which relies on hive.acid.index to be in the ORC footer.

      There is no way to generate hive.acid.index from a plain query as in HIVE-20699 and so we need to make sure that we generate a SARG into delete_delta/bucket_x based on stripe stats even the index is missing

        Attachments

        1. HIVE-20730.patch
          5 kB
          Saurabh Seth
        2. HIVE-20730.3.patch
          10 kB
          Saurabh Seth
        3. HIVE-20730.2.patch
          10 kB
          Saurabh Seth

          Activity

            People

            • Assignee:
              saurabhseth Saurabh Seth
              Reporter:
              ekoifman Eugene Koifman
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: