Uploaded image for project: 'Calcite'
  1. Calcite
  2. CALCITE-5054

Avatica Jdbc layer: Json vs ProtoBuf performance

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • avatica, jdbc-driver
    • None

    Description

      We have run some benchmarks and also observed the similar behavior with our usecase testing, it looks like Protobuf serialization seems to be slower than JSON serialization at avatical layer.

       

      We have used a simple query like this:

      select Field1, Field2, Field3, Field4, Field5, Field6 from T3

      Field1 to Field 3 are of SqlTypeName.BIGINT type

      Field4 to Field6 are of SqlTypeName.DECIMAL type

      We had case where we project more than 500K rows so we tried some variations on benchmarking but we see that protobuf is slower than json.

      We are wondering why protobuf is slower? does anyone know if there is anything we might be missing?

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            ShivenDvrk Shiven Dvrk
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated: