Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-2759

Pre-allocate HDFS edit log files after writing version number

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.0-alpha
    • Fix Version/s: 2.0.2-alpha
    • Component/s: ha, namenode
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      In HDFS-2709 it was discovered that there's a potential race wherein edits log files are pre-allocated before the version number is written into the header of the file. This can cause the NameNode to read an invalid HDFS layout version, and hence fail to read the edit log file. We should write the header, then pre-allocate the rest of the file after this point.

        Attachments

        1. HDFS-2759.patch
          3 kB
          Aaron Myers
        2. HDFS-2759.patch
          3 kB
          Aaron Myers
        3. HDFS-2759.patch
          0.9 kB
          Aaron Myers

        Issue Links

          Activity

            People

            • Assignee:
              atm Aaron Myers
              Reporter:
              atm Aaron Myers

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment