Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsAdd voteVotersWatch issueWatchersConvert to IssueMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • llap
    • None

    Description

      We don't know decompressed size of a compression buffer in ORC, all we know is the file-level compression buffer size. For many files, compression buffers can be smaller than that because of compact encoding, or because compression block ends for other reasons (different streams, etc. - "present" streams for example are very small).
      BuddyAllocator should be able to accept back parts of the allocated memory (e.g. allocate 256Kb with minimum allocation of 32Kb, decompress 45Kb, return the last 192Kb as 64+128Kb). For generality (this depends on implementation), we can make an API like "offer", and allocator can decide to take back however much it can.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned Assign to me
            sershe Sergey Shelukhin

            Dates

              Created:
              Updated:

              Slack

                Issue deployment