Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11026

Convert BlockTokenIdentifier to use Protobuf

    XMLWordPrintableJSON

Details

    • Task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.9.0, 3.0.0-alpha1
    • 3.0.0-alpha4
    • hdfs, hdfs-client
    • None
    • Reviewed
    • Hide
      Changed the serialized format of BlockTokenIdentifier to protocol buffers. Includes logic to decode both the old Writable format and the new PB format to support existing clients. Client implementations in other languages will require similar functionality.
      Show
      Changed the serialized format of BlockTokenIdentifier to protocol buffers. Includes logic to decode both the old Writable format and the new PB format to support existing clients. Client implementations in other languages will require similar functionality.

    Description

      BlockTokenIdentifier currently uses a DataInput/DataOutput (basically a byte[]) and manual serialization to get data into and out of the encrypted buffer (in BlockKeyProto). Other TokenIdentifiers (e.g. ContainerTokenIdentifier, AMRMTokenIdentifier) use Protobuf. The BlockTokenIdenfitier should use Protobuf as well so it can be expanded more easily and will be consistent with the rest of the system.

      Attachments

        1. blocktokenidentifier-protobuf.patch
          7 kB
          Ewan Higgs
        2. HDFS-11026.002.patch
          27 kB
          Ewan Higgs
        3. HDFS-11026.003.patch
          27 kB
          Ewan Higgs
        4. HDFS-11026.004.patch
          31 kB
          Ewan Higgs
        5. HDFS-11026.005.patch
          31 kB
          Ewan Higgs
        6. HDFS-11026.006.patch
          34 kB
          Ewan Higgs
        7. HDFS-11026.007.patch
          37 kB
          Ewan Higgs

        Issue Links

          Activity

            People

              ehiggs Ewan Higgs
              ehiggs Ewan Higgs
              Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: