Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-160

Simplify CapacityByteArrayOutputStream

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 1.6.0
    • None
    • None

    Description

      There's a lot of complicated logic around trying to re-use byte buffers as well as allocating slabs before they are needed as well as shrinking / consolidating.

      After discussing with julienledem we should simplify and not bother reusing the byte buffers, and not allocate buffers until they are needed. The hope is this will reduce the memory overhead and that the number of byte buffers should be small so they should not cause trouble for GC.

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. PARQUET-1006 ColumnChunkPageWriter uses only heap memory.

          • Major - Major loss of function.
          • Open

          Activity

            People

              Unassigned Unassigned
              alexlevenson Alex Levenson
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: