Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-20882 Support Hive replication to a target cluster with hive.strict.managed.tables enabled.
  3. HIVE-20966

Support bootstrap and incremental replication to a target with hive.strict.managed.tables enabled.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 4.0.0
    • None
    • repl

    Description

      Requirements:
      Hive2 supports replication of managed tables. But in Hive3 with hive.strict.managed.tables=true, some of these managed tables are converted to ACID or MM tables. Also, some of them are converted to external tables based on below rules.

      • Avro format with external schema, Storage handlers, List bucketed tabled are converted to external tables.
      • Location not owned by "hive" user are converted to external table.
      • Hive owned ORC format are converted to full ACID transactional table.
      • Hive owned Non-ORC format are converted to MM transactional table.

      REPL LOAD should apply these rules during bootstrap and incremental phases and convert the tables accordingly.

      Attachments

        1. HIVE-20966.08.patch
          945 kB
          mahesh kumar behera
        2. HIVE-20966.07.patch
          945 kB
          mahesh kumar behera
        3. HIVE-20966.06.patch
          950 kB
          mahesh kumar behera
        4. HIVE-20966.05.patch
          951 kB
          Sankar Hariappan
        5. HIVE-20966.04.patch
          956 kB
          mahesh kumar behera
        6. HIVE-20966.03.patch
          955 kB
          mahesh kumar behera
        7. HIVE-20966.02.patch
          956 kB
          mahesh kumar behera
        8. HIVE-20966.01.patch
          952 kB
          mahesh kumar behera

        Issue Links

          Activity

            People

              maheshk114 mahesh kumar behera
              maheshk114 mahesh kumar behera
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: