Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-2003

Separate FSEditLog reading logic from editLog memory state building logic

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: Edit log branch (HDFS-1073), 0.23.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently FSEditLogLoader has code for reading from an InputStream interleaved with code which updates the FSNameSystem and FSDirectory. This makes it difficult to read an edit log without having a whole load of other object initialised, which is problematic if you want to do things like count how many transactions are in a file etc.

      This patch separates the reading of the stream and the building of the memory state.

      1. HDFS-2003.diff
        54 kB
        Ivan Kelly
      2. HDFS-2003.diff
        54 kB
        Ivan Kelly
      3. HDFS-2003.diff
        54 kB
        Ivan Kelly
      4. HDFS-2003-replicationfix-delta.diff
        3 kB
        Ivan Kelly
      5. hdfs-2003.txt
        54 kB
        Todd Lipcon
      6. HDFS-2003.diff
        51 kB
        Ivan Kelly
      7. hdfs-2003.txt
        51 kB
        Todd Lipcon
      8. hdfs-2003.txt
        50 kB
        Todd Lipcon
      9. 2003-delta.txt
        6 kB
        Todd Lipcon
      10. HDFS-2003.diff
        54 kB
        Ivan Kelly
      11. HDFS-2003.diff
        79 kB
        Ivan Kelly
      12. HDFS-2003.diff
        78 kB
        Ivan Kelly
      13. HDFS-2003.diff
        76 kB
        Ivan Kelly

        Issue Links

          Activity

          Ivan Kelly created issue -
          Ivan Kelly made changes -
          Field Original Value New Value
          Attachment HDFS-2003.diff [ 12480553 ]
          Ivan Kelly made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Ivan Kelly made changes -
          Link This issue blocks HDFS-1580 [ HDFS-1580 ]
          Ivan Kelly made changes -
          Attachment HDFS-2003.diff [ 12480926 ]
          Ivan Kelly made changes -
          Attachment HDFS-2003.diff [ 12481369 ]
          Ivan Kelly made changes -
          Attachment HDFS-2003.diff [ 12481572 ]
          Todd Lipcon made changes -
          Attachment 2003-delta.txt [ 12481618 ]
          Todd Lipcon made changes -
          Attachment hdfs-2003.txt [ 12481622 ]
          Todd Lipcon made changes -
          Attachment hdfs-2003.txt [ 12481642 ]
          Todd Lipcon made changes -
          Link This issue is related to HDFS-2041 [ HDFS-2041 ]
          Ivan Kelly made changes -
          Attachment HDFS-2003.diff [ 12481701 ]
          Todd Lipcon made changes -
          Attachment hdfs-2003.txt [ 12481764 ]
          Ivan Kelly made changes -
          Attachment HDFS-2003-replicationfix-delta.diff [ 12481811 ]
          Ivan Kelly made changes -
          Attachment HDFS-2003.diff [ 12481812 ]
          Ivan Kelly made changes -
          Attachment HDFS-2003.diff [ 12481829 ]
          Ivan Kelly made changes -
          Attachment HDFS-2003.diff [ 12481897 ]
          Todd Lipcon made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags [Reviewed]
          Resolution Fixed [ 1 ]
          Todd Lipcon made changes -
          Fix Version/s 0.23.0 [ 12315571 ]
          Affects Version/s 0.23.0 [ 12315571 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Ivan Kelly
              Reporter:
              Ivan Kelly
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development