Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-1123

C++: Make jemalloc the default allocator

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.5.0
    • Component/s: C++
    • Labels:
      None

      Description

      While one of the advertised point of Arrow Java is that it comes with an efficient allocator that is based on jemalloc, we only provide jemalloc as an alternative allocator in C++. I would propose to switch to it as the default allocator on all platforms jemalloc is available (i.e. MacOS and Linux) as it provides the following benefits:

      Especially for the builders, simply changing the allocator shows speedups between 2x and 10x. In the optimal case, this puts builders nearly on the same level as if one would have pre-allocated the final size.

      This change should also include a blog post that outlines the benefits.

        Attachments

          Activity

            People

            • Assignee:
              xhochy Uwe L. Korn
              Reporter:
              xhochy Uwe L. Korn
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: