Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-2003

Separate FSEditLog reading logic from editLog memory state building logic

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: Edit log branch (HDFS-1073), 0.23.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently FSEditLogLoader has code for reading from an InputStream interleaved with code which updates the FSNameSystem and FSDirectory. This makes it difficult to read an edit log without having a whole load of other object initialised, which is problematic if you want to do things like count how many transactions are in a file etc.

      This patch separates the reading of the stream and the building of the memory state.

        Attachments

        1. HDFS-2003.diff
          54 kB
          Ivan Kelly
        2. HDFS-2003.diff
          54 kB
          Ivan Kelly
        3. HDFS-2003.diff
          54 kB
          Ivan Kelly
        4. HDFS-2003-replicationfix-delta.diff
          3 kB
          Ivan Kelly
        5. hdfs-2003.txt
          54 kB
          Todd Lipcon
        6. HDFS-2003.diff
          51 kB
          Ivan Kelly
        7. hdfs-2003.txt
          51 kB
          Todd Lipcon
        8. hdfs-2003.txt
          50 kB
          Todd Lipcon
        9. 2003-delta.txt
          6 kB
          Todd Lipcon
        10. HDFS-2003.diff
          54 kB
          Ivan Kelly
        11. HDFS-2003.diff
          79 kB
          Ivan Kelly
        12. HDFS-2003.diff
          78 kB
          Ivan Kelly
        13. HDFS-2003.diff
          76 kB
          Ivan Kelly

          Issue Links

            Activity

              People

              • Assignee:
                ikelly Ivan Kelly
                Reporter:
                ikelly Ivan Kelly
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: