Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-3548

Speed up storing small objects in the object store.

    XMLWordPrintableJSON

    Details

      Description

      Currently, to store an object in the plasma object store, there are a lot of IPCs. We first call "Create", which does an IPC round trip. Then we call "Seal", which is one IPC. Then we call "Release", which is another IPC.

      For small objects, we can just inline the object and metadata directly into the message to the store, and wait for the response (the response tells us if the object was successfully created). This is just a single IPC round trip, which can be much faster.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                robertnishihara Robert Nishihara
                Reporter:
                robertnishihara Robert Nishihara
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 2h
                  2h