Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-5317 Implement insert, update, and delete in Hive with full ACID support
  3. HIVE-7078

Need file sink operators that work with ACID

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.14.0
    • Query Processor, Transactions
    • None

    Description

      When writing records to tables that use an OutputFormat that implements AcidOutputFormat, records will need to be written via a RecordUpdater instead of RecordWriter.

      Rather than add this functionality to FileSinkOperator and VectorizedFileSinkOperator I propose to add a new AcidFileSinkOperator that extends FileSinkOperator and a new AcidVectorizedFileSinkOperator that extends VectorizedFileSinkOperator.

      Attachments

        1. HIVE-7078.WIP.patch
          85 kB
          Alan Gates
        2. HIVE-7078.patch
          49 kB
          Alan Gates
        3. HIVE-7078.2.patch
          49 kB
          Alan Gates

        Issue Links

          depends upon

          Sub-task - The sub-task of the issue HIVE-7571 RecordUpdater should read virtual columns from row

          • Major - Major loss of function.
          • Closed

          Sub-task - The sub-task of the issue HIVE-7663 OrcRecordUpdater needs to implement getStats

          • Major - Major loss of function.
          • Closed
          is depended upon by

          Sub-task - The sub-task of the issue HIVE-7788 Generate plans for insert, update, and delete

          • Major - Major loss of function.
          • Closed

          Activity

            People

              gates Alan Gates
              gates Alan Gates
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: