Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-8313

Implement a more generic means of detecting disk properties

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: Impala 3.2.0
    • Fix Version/s: None
    • Component/s: Backend
    • Labels:
      None

      Description

      The Disk IO Manager relies on detecting the number of disks and information such as whether each disk is rotational. This logic worked correctly for traditional hard drives of the form /dev/sda1 or similar. In IMPALA-8188, this logic was extended to support the device names associated with NVME SSDs. However, both of these are relying on specific layouts of the device names.

      As Philip Martin noted in IMPALA-8188, there is a more generic method for detecting these device properties. A more generic method of detecting these devices could help when new devices (or devices we haven't seen before) show up. This provides some options for generically detecting the drives: https://unix.stackexchange.com/posts/308724/revisions

      This would need to be tested across a variety of platforms, and it would need to degrade gracefully to the old behavior.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              joemcdonnell Joe McDonnell
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: