Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11026

Convert BlockTokenIdentifier to use Protobuf

    Details

    • Type: Task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.9.0, 3.0.0-alpha1
    • Fix Version/s: 3.0.0-alpha4
    • Component/s: hdfs, hdfs-client
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Changed the serialized format of BlockTokenIdentifier to protocol buffers. Includes logic to decode both the old Writable format and the new PB format to support existing clients. Client implementations in other languages will require similar functionality.
      Show
      Changed the serialized format of BlockTokenIdentifier to protocol buffers. Includes logic to decode both the old Writable format and the new PB format to support existing clients. Client implementations in other languages will require similar functionality.

      Description

      BlockTokenIdentifier currently uses a DataInput/DataOutput (basically a byte[]) and manual serialization to get data into and out of the encrypted buffer (in BlockKeyProto). Other TokenIdentifiers (e.g. ContainerTokenIdentifier, AMRMTokenIdentifier) use Protobuf. The BlockTokenIdenfitier should use Protobuf as well so it can be expanded more easily and will be consistent with the rest of the system.

        Attachments

        1. blocktokenidentifier-protobuf.patch
          7 kB
          Ewan Higgs
        2. HDFS-11026.002.patch
          27 kB
          Ewan Higgs
        3. HDFS-11026.003.patch
          27 kB
          Ewan Higgs
        4. HDFS-11026.004.patch
          31 kB
          Ewan Higgs
        5. HDFS-11026.005.patch
          31 kB
          Ewan Higgs
        6. HDFS-11026.006.patch
          34 kB
          Ewan Higgs
        7. HDFS-11026.007.patch
          37 kB
          Ewan Higgs

          Issue Links

            Activity

              People

              • Assignee:
                ehiggs Ewan Higgs
                Reporter:
                ehiggs Ewan Higgs
              • Votes:
                0 Vote for this issue
                Watchers:
                13 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: