Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-12634

Change Lazy Rename Pending Operation Completion of WASB to address case of potential data loss due to partial copy

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      HADOOP-12334 changed mode of Copy Operation of HBase WAL Archiving to bypass Azure Storage Throttling after retries. This was via client side copy. However a process crash when the copy is partially done would result in a scenario where the source and destination blobs will have different contents and lazy rename pending operation will not handle this thus causing data loss. We need to fix the lazy rename pending operation to address this issue

        Attachments

        1. HADOOP-12634.02.patch
          4 kB
          Gaurav Kanade
        2. HADOOP-12634.01.patch
          4 kB
          Gaurav Kanade

          Issue Links

            Activity

              People

              • Assignee:
                gouravk Gaurav Kanade
                Reporter:
                gouravk Gaurav Kanade
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Due:
                  Created:
                  Updated:
                  Resolved: