Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-5077

Add NUMA info and the current CPU to CpuInfo

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: Impala 2.9.0
    • Fix Version/s: Impala 2.9.0
    • Component/s: Backend
    • Labels:
      None

      Description

      We should add support to CpuInfo for the following things, to enable various optimisations for memory allocation:

      • The mapping of cores to NUMA nodes
      • The current CPU that a thread is running on

        Issue Links

          Activity

          Hide
          tarmstrong Tim Armstrong added a comment -

          IMPALA-5077: add NUMA and current cpu to CpuInfo

          NUMA info is found using the /sys filesystem.

          The current CPU can be found using sched_getcpu(), which is supported
          on all recent Linux kernels (unfortunately CentOS 5 shipped with an
          older kernel, so we need a fallback).

          Testing:
          Confirmed that this built on a range of different Linux distros,
          including CentOS 5, which is missing support for features like
          sched_getcpu().

          Change-Id: I0525228a56bcf20c45f78ee1ba1d300c74cf4d05
          Reviewed-on: http://gerrit.cloudera.org:8080/6402
          Reviewed-by: Tim Armstrong <tarmstrong@cloudera.com>
          Tested-by: Impala Public Jenkins

          Show
          tarmstrong Tim Armstrong added a comment - IMPALA-5077 : add NUMA and current cpu to CpuInfo NUMA info is found using the /sys filesystem. The current CPU can be found using sched_getcpu(), which is supported on all recent Linux kernels (unfortunately CentOS 5 shipped with an older kernel, so we need a fallback). Testing: Confirmed that this built on a range of different Linux distros, including CentOS 5, which is missing support for features like sched_getcpu(). Change-Id: I0525228a56bcf20c45f78ee1ba1d300c74cf4d05 Reviewed-on: http://gerrit.cloudera.org:8080/6402 Reviewed-by: Tim Armstrong <tarmstrong@cloudera.com> Tested-by: Impala Public Jenkins

            People

            • Assignee:
              tarmstrong Tim Armstrong
              Reporter:
              tarmstrong Tim Armstrong
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development