Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-18352

introduce a METADATAONLY option while doing REPL DUMP to allow integrations of other tools

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.0.0
    • 3.0.0
    • None

    Description

      • Introduce a METADATAONLY option as part of the REPL DUMP command which will only try and dump out events for DDL changes, this will be faster as we wont need scan of files on HDFS for DML changes.
      • Additionally since we are only going to dump metadata operations, it might be useful to include acid tables as well via an option as well. This option can be removed when ACID support is complete via HIVE-18320

      it will be good to support the "WITH" clause as part of REPL DUMP command as well (repl dump already supports it viaHIVE-17757) to achieve the above as that will prevent less changes to the syntax of the statement and provide more flexibility in future to include additional options as well.

      REPL DUMP [db_name] {FROM [event_id]} {TO [event_id]} {WITH (['key'='value'],.....)}
      

      This will enable other tools like security / schema registry / metadata discovery to use replication related subsystem for their needs as well.

      Attachments

        1. HIVE-18352.0.patch
          37 kB
          Anishek Agarwal
        2. HIVE-18352.1.patch
          49 kB
          Anishek Agarwal
        3. HIVE-18352.2.patch
          154 kB
          Anishek Agarwal

        Issue Links

          Activity

            People

              anishek Anishek Agarwal
              anishek Anishek Agarwal
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: