Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2707

ProtoOverHadoopRpcEngine without using TunnelProtocol over WritableRpc

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.23.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      ProtoOverHadoopRpcEngine is introduced in MR-279, which uses TunnelProtocol over WritableRpcEngine. This jira removes the tunnel protocol and lets ProtoOverHadoopRpcEngine directly interact with ipc.Client and ipc.Server.

      1. MAPREDUCE-2707.2.patch
        21 kB
        Jitendra Nath Pandey
      2. MAPREDUCE-2707.3.patch
        34 kB
        Jitendra Nath Pandey

        Issue Links

          Activity

          Hide
          Jitendra Nath Pandey added a comment -

          This jira doesn't intend to remove writable from ipc.Client/Server. That is proposed in a different jira (HADOOP-7399). This will just remove TunnelProtocol but the protocol buffer messages will still be wrapped in a generic Writable and passed to ipc Client.
          When HADOOP-7399 is ready to go, ProtoOverHadoopRpcEngine will be modified not to wrap request/response into Writable.

          Show
          Jitendra Nath Pandey added a comment - This jira doesn't intend to remove writable from ipc.Client/Server. That is proposed in a different jira ( HADOOP-7399 ). This will just remove TunnelProtocol but the protocol buffer messages will still be wrapped in a generic Writable and passed to ipc Client. When HADOOP-7399 is ready to go, ProtoOverHadoopRpcEngine will be modified not to wrap request/response into Writable.
          Hide
          Jitendra Nath Pandey added a comment -

          The patch uploaded is for MR-279 branch only.

          Show
          Jitendra Nath Pandey added a comment - The patch uploaded is for MR-279 branch only.
          Hide
          Jitendra Nath Pandey added a comment -

          New patch, takes care of SecurityInfo implementations.

          Show
          Jitendra Nath Pandey added a comment - New patch, takes care of SecurityInfo implementations.
          Hide
          Mahadev konar added a comment -

          I just committed this to MR-279 branch. Thanks a lot Jitendra!

          Show
          Mahadev konar added a comment - I just committed this to MR-279 branch. Thanks a lot Jitendra!

            People

            • Assignee:
              Jitendra Nath Pandey
              Reporter:
              Jitendra Nath Pandey
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development