Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-2953

[Plasma] Store memory usage

    XMLWordPrintableJSON

    Details

      Description

      While doing some memory profiling on the store, it became clear that at the moment the metadata of the objects takes up much more space than it should. In particular, for each object:

      • The object id (20 bytes) is stored three times
      • The object¬†checksum (8 bytes) is stored twice

      We can therefore significantly reduce the metadata overhead with some refactoring.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                pcmoritz Philipp Moritz
                Reporter:
                pcmoritz Philipp Moritz
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 0.5h
                  0.5h