Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-2274

Avoid buffer copying in Codec

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • db
    • None

    Description

      Codec declares byte[] as a parameter in fromPersistedFormat(..) and a return type in toPersistedFormat(..). It leads to buffer copying when using it with ByteString.

      Attachments

        1.
        		 CodecRegistry is not thread safe Sub-task Resolved Tsz-wo Sze
        2.
        		 Fix the generic type of CodecRegistry.getCodec Sub-task Resolved Tsz-wo Sze
        3.
        		 In RDBTable, add a put method using RocksDB ByteBuffer APIs Sub-task Resolved Tsz-wo Sze
        4.
        		 Support putWithBatch with ByteBuffer. Sub-task Resolved Tsz-wo Sze
        5.
        		 Support CodecBuffer for protobuf v3 codecs Sub-task Resolved Tsz-wo Sze
        6.
        		 Support CodecBuffer for PipelineID codec Sub-task Resolved Tsz-wo Sze
        7.
        		 Support CodecBuffer for protobuf v2 codecs Sub-task Resolved Tsz-wo Sze
        8.
        		 Support CodecBuffer for some of the remaining protobuf v2 codecs in hadoop-ozone Sub-task Resolved Tsz-wo Sze
        9.
        		 Support CodecBuffer for the remaining protobuf v2 codecs in hadoop-ozone Sub-task Resolved Tsz-wo Sze
        10.
        		 Support CodecBuffer for CertInfo and CRLInfo and code cleanup Sub-task Resolved Tsz-wo Sze
        11.
        		 Support CodecBuffer for the remaining protobuf v2 codecs in hadoop-hdds Sub-task Resolved Tsz-wo Sze
        12.
        		 Codec implementations should be singleton Sub-task Resolved Attila Doroszlai
        13.
        		 TypedTable should store key/value codecs in its fields Sub-task Resolved Tsz-wo Sze
        14.
        		 Support get using RocksDB ByteBuffer APIs Sub-task Resolved Tsz-wo Sze
        15.
        		 Support CodecBuffer for ShortCodec Sub-task Resolved Tsz-wo Sze
        16.
        		 Support keyMayExist with ByteBuffer. Sub-task Resolved Tsz-wo Sze
        17.
        		 Avoid linear search in DBDefinition implementations Sub-task Resolved Tsz-wo Sze
        18.
        		 Use adjustable capacity CodecBuffer to get from DB Sub-task Resolved Tsz-wo Sze
        19.
        		 FixedLengthStringCodec may silently replace unsupported characters Sub-task Resolved Tsz-wo Sze
        20.
        		 Support CodecBuffer for X509CertificateCodec Sub-task Resolved Tsz-wo Sze
        21.
        		 Support RocksDB delete with ByteBuffer Sub-task Resolved Tsz-wo Sze
        22.
        		 Log allocation stack trace for leaked CodecBuffer Sub-task Resolved Attila Doroszlai
        23.
        		 Release CodecBuffers when batch operation is closed Sub-task Resolved Attila Doroszlai
        24.
        		 Refactor RDBStoreIterator and TypedTableIterator Sub-task Resolved Tsz-wo Sze
        25.
        		 Support RocksDB iterator with ByteBuffer Sub-task Resolved Tsz-wo Sze
        26.
        		 Avoid overriding finalize() in CodecBuffer Sub-task Resolved Tsz-wo Sze
        27.
        		 Avoid copying ByteString in ByteStringCodec Sub-task Resolved Tsz-wo Sze
        28.
        		 TypedTable prefix iterator may leak CodecBuffer Sub-task Resolved Tsz-wo Sze
        29.
        		 Pass defaultInstance instead of a class in Proto2/3Codec Sub-task Resolved Tsz-wo Sze
        30.
        		 OmBucketInfo/OmMultipartKeyInfo/OmPrefixInfo should implement CopyObject Sub-task Resolved Tsz-wo Sze
        31.
        		 In ContainerKeyPrefixCodec, toPersistedFormat(..) and fromPersistedFormat(..) are not consistent. Sub-task Open Tsz-wo Sze

        Activity

          People

            szetszwo Tsz-wo Sze
            szetszwo Tsz-wo Sze
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated: