Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-6327 Clean up FSDirectory
  3. HDFS-6315

Decouple recording edit logs from FSDirectory

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.5.0
    • None
    • None
    • Reviewed

    Description

      Currently both FSNamesystem and FSDirectory record edit logs. This design requires both FSNamesystem and FSDirectory to be tightly coupled together to implement a durable namespace.

      This jira proposes to separate the responsibility of implementing the namespace and providing durability with edit logs. Specifically, FSDirectory implements the namespace (which should have no edit log operations), and FSNamesystem implement durability by recording the edit logs.

      Attachments

        1. HDFS-6315.000.patch
          45 kB
          Haohui Mai
        2. HDFS-6315.001.patch
          46 kB
          Haohui Mai
        3. HDFS-6315.002.patch
          21 kB
          Haohui Mai
        4. HDFS-6315.003.patch
          29 kB
          Haohui Mai
        5. HDFS-6315.004.patch
          30 kB
          Haohui Mai
        6. HDFS-6315.005.patch
          31 kB
          Haohui Mai

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            wheat9 Haohui Mai
            wheat9 Haohui Mai
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment