Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Thrift is not very compact in writing out data as (say protobuf) . It does not have the concept of variable length integers and various other optimizations possible . In Solr we use a lot of such optimizations to make a very compact payload. Thrift has a lot common with that format.

      It is all done in a single class

      http://svn.apache.org/viewvc/lucene/solr/trunk/src/java/org/apache/solr/common/util/NamedListCodec.java?revision=685640&view=markup

      The other optimizations include writing type/value in same byte, very fast writes of Strings, externalizable strings etc

      We could use a thrift format for non-java clients and I would like to see it as compact as the current java version

        Attachments

        1. compact_proto_spec.txt
          3 kB
          Bryan Duxbury
        2. compact_proto_spec.txt
          3 kB
          Bryan Duxbury
        3. compact-proto-spec-2.txt
          2 kB
          Bryan Duxbury
        4. compact-proto-spec-2.txt
          2 kB
          Bryan Duxbury
        5. compact-proto-spec-2.txt
          2 kB
          Bryan Duxbury
        6. compact-proto-spec-2.txt
          2 kB
          Bryan Duxbury
        7. irclog.txt
          30 kB
          David Reiss
        8. thrift-110.patch
          38 kB
          Bryan Duxbury
        9. thrift-110-v10.patch
          48 kB
          Bryan Duxbury
        10. thrift-110-v11.patch
          49 kB
          Bryan Duxbury
        11. thrift-110-v12.patch
          49 kB
          Bryan Duxbury
        12. thrift-110-v2.patch
          80 kB
          Bryan Duxbury
        13. thrift-110-v3.patch
          85 kB
          Bryan Duxbury
        14. thrift-110-v4.patch
          87 kB
          Bryan Duxbury
        15. thrift-110-v5.patch
          97 kB
          Bryan Duxbury
        16. thrift-110-v6.patch
          80 kB
          Bryan Duxbury
        17. thrift-110-v7.patch
          83 kB
          Bryan Duxbury
        18. thrift-110-v8.patch
          83 kB
          Bryan Duxbury
        19. thrift-110-v9.patch
          82 kB
          Bryan Duxbury

          Issue Links

            Activity

              People

              • Assignee:
                bryanduxbury Bryan Duxbury
                Reporter:
                noble.paul Noble Paul
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: