[THRIFT-110] A more compact format

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Assignee: Bryan Duxbury
• Reporter: Noble Paul
• Created: 16/Aug/08 07:25
• Updated: 01/Nov/11 02:52
• Resolved: 10/Feb/09 04:50

Description

Thrift is not very compact in writing out data as (say protobuf) . It does not have the concept of variable length integers and various other optimizations possible . In Solr we use a lot of such optimizations to make a very compact payload. Thrift has a lot common with that format.

It is all done in a single class

http://svn.apache.org/viewvc/lucene/solr/trunk/src/java/org/apache/solr/common/util/NamedListCodec.java?revision=685640&view=markup

The other optimizations include writing type/value in same byte, very fast writes of Strings, externalizable strings etc

We could use a thrift format for non-java clients and I would like to see it as compact as the current java version

Issue Links

• incorporates: THRIFT-122 Allow heterogeneous collections
• is related to: THRIFT-167 Improve the TProtocol interface to facilitate more complex protocols
• relates to: THRIFT-121 Add support for type modifiers