Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-12118

Consider using pytorch cpuinfo library for CPU detection / logging

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • Impala 4.3.0
    • None
    • Backend
    • ghx-label-11

    Description

      The code in be/src/util/cpu-info.h/.cc provides information about the CPU that we run on, along with NUMA configurations, cache sizes, etc. 

      Pytorch's cpuinfo package seems to cover most of what we want to do across a much broader set of processors / architectures. It has a compatible license. See https://github.com/pytorch/cpuinfo

      We should see if this is useful for our cpu detection code.

      Attachments

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. IMPALA-12191 Add hardware and OS details to runtime profile

          • Major - Major loss of function.
          • Open
          relates to

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. IMPALA-12353 Support Impala on ARM

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              MikaelSmith Michael Smith
              joemcdonnell Joe McDonnell
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: