Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-2117

Spread metadata across multiple data directories

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.6.0
    • Fix Version/s: None
    • Component/s: fs, tablet, tserver
    • Labels:
      None

      Description

      Tablet metadata and consensus metadata are placed in the first configured data directory. This is an issue, as every write to these metadata incurs an fsync and this stresses the first disk considerably more than the others

      One way around this is to spread metadata across multiple data directories. A natural choice would be to place them in a directory within the tablet's disk group. In this way, the data/metadata can be completely localized to the disk group, which has the added benefit of making the risk of disk failures easier to assess per tablet.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                andrew.wong Andrew Wong
                Reporter:
                andrew.wong Andrew Wong
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: