Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-19435

Incremental replication cause data loss if a table is dropped followed by create and insert-into with different partition type.

    XMLWordPrintableJSON

Details

    Description

      If the incremental dump have drop of partitioned table followed by create/insert on non-partitioned table with same name, doesn't replicate the data. Explained below.

      Let's say we have a partitioned table T1 which was already replicated to target.

      DROP_TABLE(T1)->CREATE_TABLE(T1) (Non-partitioned) -> INSERT(T1)(10) 

      After REPL LOAD, T1 doesn't have any data.

      Same is valid for non-partitioned to partitioned and partition spec mismatch case as well.

       

      Attachments

        1. HIVE-19435.01-branch-3.patch
          7 kB
          Sankar Hariappan
        2. HIVE-19435.03.patch
          7 kB
          Sankar Hariappan
        3. HIVE-19435.02.patch
          7 kB
          Sankar Hariappan
        4. HIVE-19435.01.patch
          7 kB
          Sankar Hariappan

        Issue Links

          Activity

            People

              sankarh Sankar Hariappan
              sankarh Sankar Hariappan
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: