Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-2372

Don't let kudu start up if any disks are mounted read-only

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: fs
    • Labels:
      None

      Description

      Today, if a Kudu tserver runs into EROFS (read-only mount error), it treats the error as it would a complete disk failure (EIO), allowing successful startup of the server, but failing the tablets that are configured to use the "failed" disk.

      If something is wrong with the mounting of a disk, it might be helpful to bring immediate attention to it, and have operators deal with it, rather than handling it automatically. As such, it might be helpful to prevent Kudu from starting up if errors are detected with the mount configurations.

      There are tradeoffs here to be considered:

      • The current behavior, as it is today, will evict and delete the data from the failed tablets, as it is treated as an unrecoverable failure. The user can ignore such failures and handle it at their leisure, since Kudu will re-replicate the tablets lost in this way
      • If we were to instead crash, this gives operators some immediate feedback and a time limit to use `kudu fs update_dirs` to remove the read only drive, or maybe fix the mountpoint itself

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                andrew.wong Andrew Wong
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated: