Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-19219

Incremental REPL DUMP should throw error if requested events are cleaned-up.

Log workAgile BoardRank to TopRank to BottomVotersStop watchingWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      This is the case where the events were deleted on source because of old event purging and hence min(source event id) > target event id (last replicated event id).

      Repl dump should fail in this case so that user can drop the database and bootstrap again.

      Cleaner thread is concurrently removing the expired events from NOTIFICATION_LOG table. So, it is necessary to check if the current dump missed any event while dumping. After fetching events in batches, we shall check if it is fetched in contiguous sequence of event id. If it is not in contiguous sequence, then likely some events missed in the dump and hence throw error.

      Attachments

        1. HIVE-19219.01-branch-3.patch
          13 kB
          Sankar Hariappan
        2. HIVE-19219.05.patch
          13 kB
          Sankar Hariappan
        3. HIVE-19219.04.patch
          13 kB
          Sankar Hariappan
        4. HIVE-19219.03.patch
          15 kB
          Sankar Hariappan
        5. HIVE-19219.02.patch
          8 kB
          Sankar Hariappan
        6. HIVE-19219.01.patch
          12 kB
          Sankar Hariappan

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            sankarh Sankar Hariappan Assign to me
            sankarh Sankar Hariappan
            Votes:
            0 Vote for this issue
            Watchers:
            4 Stop watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Issue deployment