Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-12118

Consider using pytorch cpuinfo library for CPU detection / logging

Attach filesAttach ScreenshotAdd voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • Impala 4.3.0
    • None
    • Backend
    • ghx-label-11

    Description

      The code in be/src/util/cpu-info.h/.cc provides information about the CPU that we run on, along with NUMA configurations, cache sizes, etc. 

      Pytorch's cpuinfo package seems to cover most of what we want to do across a much broader set of processors / architectures. It has a compatible license. See https://github.com/pytorch/cpuinfo

      We should see if this is useful for our cpu detection code.

      Attachments

        Issue Links

        is related to

        Improvement - An improvement or enhancement to an existing feature or task. IMPALA-12191 Add hardware and OS details to runtime profile

        • Major - Major loss of function.
        • Open
        relates to

        Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. IMPALA-12353 Support Impala on ARM

        • Major - Major loss of function.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            MikaelSmith Michael Smith
            joemcdonnell Joe McDonnell
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:

              Slack

                Issue deployment