Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1073 Simpler model for Namenode's fs Image and edit Logs
  3. HDFS-1799

Refactor log rolling and filename management out of FSEditLog

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • Edit log branch (HDFS-1073)
    • None
    • None
    • Reviewed

    Description

      This is somewhat similar to HDFS-1580, but less ambitious. While that JIRA focuses on pluggability, this task is simply the minimum needed for HDFS-1073:

      • Refactor the filename-specific code for rolling, diverting, and reverting log streams out of FSEditLog into a new class
      • Clean up the related code in FSEditLog a bit

      Notably, this JIRA is going to temporarily break the BackupNode. I plan to circle back on the BackupNode later on this branch.

      Attachments

        1. hdfs-1799-alternate-design.txt
          53 kB
          Todd Lipcon
        2. HDFS-1799-all.diff
          35 kB
          Ivan Kelly
        3. hdfs-1799.txt
          44 kB
          Todd Lipcon
        4. hdfs-1799.txt
          44 kB
          Todd Lipcon
        5. hdfs-1799.txt
          44 kB
          Todd Lipcon
        6. hdfs-1799.txt
          45 kB
          Todd Lipcon
        7. hdfs-1799.txt
          54 kB
          Todd Lipcon
        8. 0003-Add-JournalFactory-and-move-divert-revert-out-of-FSE.patch
          28 kB
          Ivan Kelly
        9. 0002-Standardised-error-pattern.patch
          6 kB
          Ivan Kelly
        10. 0001-Added-state-management-to-FSEditLog.patch
          8 kB
          Ivan Kelly

        Issue Links

          Activity

            People

              tlipcon Todd Lipcon
              tlipcon Todd Lipcon
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: