Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17320

OrcRawRecordMerger.discoverKeyBounds logic can be simplified

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: 3.2.0
    • Component/s: Transactions
    • Labels:
      None

      Description

      with HIVE-17089 we never have any insert events in the deltas
      so if for every split of the base we know min/max key, we can use them to filter delete events since all files are sorted by RecordIdentifier
      So we should be able to create SARG for all delete deltas

      the code can be simplified since now min/max key doesn't ever have to be null

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ekoifman Eugene Koifman
                Reporter:
                ekoifman Eugene Koifman
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: