Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-12484

Single File Rename Throws Incorrectly In Potential Race Condition Scenarios

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: tools
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      FinishSingleFileRename function - in the case where src and dst both exist gets a lease on src blob to block write access and then deletes the file. However in the time between checking existence of source file and acquiring lease the file may be deleted by another process (race condition). Presently the function simply throws in this scenario. In this case the function should treat this as a case where rename is complete; i.e. catch the exception and if this is the cause exit gracefully with the result that the rename is complete

        Attachments

        1. HADOOP-12484.06.patch
          2 kB
          Chris Nauroth
        2. HADOOP-12484.05.patch
          2 kB
          Gaurav Kanade
        3. HADOOP-12484.04.patch
          2 kB
          Gaurav Kanade
        4. HADOOP-12484.03.patch
          2 kB
          Chris Nauroth
        5. HADOOP-12484.02.patch
          4 kB
          Gaurav Kanade
        6. HADOOP-12484.01.patch
          2 kB
          Gaurav Kanade

          Activity

            People

            • Assignee:
              gouravk Gaurav Kanade
              Reporter:
              gouravk Gaurav Kanade
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Due:
                Created:
                Updated:
                Resolved: