Details

    • Type: Sub-task Sub-task
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      The Data transfer between client and datanode and between datanode and datanode is a streaming
      protocol where messages and data is sent across a tcp connection.
      The messages are not concrete data types (ie they are not classes or interfaces), instead the fields are marshalled and unmarshalled in in various classes.
      The message exchange could be made concrete by declaring message data types and/or interfaces.
      This will help future automated versioning via protocol-buffers style approach. It will also help document the interface and can simplify the code.

        Issue Links

          Activity

          Sanjay Radia created issue -
          George Porter made changes -
          Field Original Value New Value
          Link This issue is related to HADOOP-4096 [ HADOOP-4096 ]
          Robert Chansler made changes -
          Component/s dfs [ 12310710 ]
          Sanjay Radia made changes -
          Description The Client-Datanode streaming protocol is a set of message exchanges.
          The messages are not concrete data type s(ie it is not classes or interfaces).
          The message exchange could be made concrete by declaring message data types and/or interfaces.
          This will help future automated versioning via protocol-buffers style approach. It will also help document the interface and can simplify the code.
            


          The Data transfer between client and datanode and between datanode and datanode is a streaming
          protocol where messages and data is sent across a tcp connection.
          The messages are not concrete data types (ie they are not classes or interfaces), instead the fields are marshalled and unmarshalled in in various classes.
          The message exchange could be made concrete by declaring message data types and/or interfaces.
          This will help future automated versioning via protocol-buffers style approach. It will also help document the interface and can simplify the code.
            


          Summary Make the Client-Datanode streaming protocol concrete Make the Data transfer streaming protocol concrete
          Tsz Wo Nicholas Sze made changes -
          Link This issue relates to HADOOP-4538 [ HADOOP-4538 ]
          Hide
          Tsz Wo Nicholas Sze added a comment -

          We may also fix HADOOP-4538 as a part on this.

          Show
          Tsz Wo Nicholas Sze added a comment - We may also fix HADOOP-4538 as a part on this.
          Owen O'Malley made changes -
          Project Hadoop Common [ 12310240 ] HDFS [ 12310942 ]
          Key HADOOP-4008 HDFS-400
          Component/s dfs [ 12310710 ]
          Tsz Wo Nicholas Sze made changes -
          Link This issue relates to HDFS-377 [ HDFS-377 ]
          Hide
          Tsz Wo Nicholas Sze added a comment -

          HDFS-377 made some progress on this.

          Show
          Tsz Wo Nicholas Sze added a comment - HDFS-377 made some progress on this.
          Allen Wittenauer made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]

            People

            • Assignee:
              Unassigned
              Reporter:
              Sanjay Radia
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development