Details

    • Type: Sub-task Sub-task
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      This is necessary for QJM to work with HA. When the NNs start up, they start in standby state and try to read from the JournalNodes. So they call getEditLogManifest(). But they don't call getJournalInfo so the httpPort field doesn't get filled in. This means that when they try to actually fetch the remote edits, they fail since they don't know the JN's HTTP port.

      1. hdfs-3694.txt
        14 kB
        Todd Lipcon

        Activity

        Todd Lipcon created issue -
        Hide
        Todd Lipcon added a comment -

        Attached patch fixes getEditLogManifest to assign the http port member from the response. I also cleaned up the internal APIs to not pass the protobuf all the way through.

        The patch includes a new unit test where one QuorumJournalManager reads while another writes. This simulates the workload of HA.

        Show
        Todd Lipcon added a comment - Attached patch fixes getEditLogManifest to assign the http port member from the response. I also cleaned up the internal APIs to not pass the protobuf all the way through. The patch includes a new unit test where one QuorumJournalManager reads while another writes. This simulates the workload of HA.
        Todd Lipcon made changes -
        Field Original Value New Value
        Attachment hdfs-3694.txt [ 12537280 ]
        Todd Lipcon made changes -
        Assignee Todd Lipcon [ tlipcon ]
        Hide
        Aaron T. Myers added a comment -

        +1, the patch looks good to me.

        Show
        Aaron T. Myers added a comment - +1, the patch looks good to me.
        Hide
        Todd Lipcon added a comment -

        Committed to branch, thanks Aaron.

        Show
        Todd Lipcon added a comment - Committed to branch, thanks Aaron.
        Todd Lipcon made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Fix Version/s QuorumJournalManager (HDFS-3077) [ 12322478 ]
        Resolution Fixed [ 1 ]
        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Resolved Resolved
        5d 20h 40m 1 Todd Lipcon 25/Jul/12 21:40

          People

          • Assignee:
            Todd Lipcon
            Reporter:
            Todd Lipcon
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development