[THRIFT-484] Ability to use a slice of a buffer instead of a direct byte[] for binary fields

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Fix Version/s: 0.4
• Component/s: Java - Compiler, Java - Library
• Assignee: Bryan Duxbury
• Reporter: Bryan Duxbury
• Created: 05/May/09 17:04
• Updated: 28/Jul/10 20:25
• Resolved: 28/Jul/10 20:25

Description

The HBase folks who are considering using Thrift for their internal and external RPC have suggested that it would be a useful performance enhancement to be able to use a subslice of a byte array as the value of a binary field, without first doing a new byte array copy. Done correctly, this would mean that the data could be copied once from when it is read in from the socket to when it is written out as part of HBase's internal datastructures.

This enhancement seems like it could boost the performance of things in Hadoop, as well, so it could be a really nice option to investigate.

Issue Links

• relates to: HBASE-794 Language neutral IPC as a first class component of HBase architecture