Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-2519

Tool to overwrite corrupted cblocks in a CFile

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • cfile
    • None

    Description

      In cases where a cblock* is corrupted in a CFile and other replicas are not available to copy from, what's left is a tablet that will truncate scans with a corruption error. Such scans are stopped when the scan hits the bad cblock, even if most of the data is healthy. One of the few if not only options that exists to work around this is to use the `kudu tablet unsafe_replace_replica` tool to drop the affected tablet completely, allowing users to still run queries against the remainder of the table.

      To minimize data loss, it'd be nice if there existed a tool that fills in corrupted cblocks with dummy/default data, with the understanding that existing data for that cblock has been lost forever. That way, users would at least be able to operate on their tables (albeit with some missing data).

      *cblock refers to a block internal to each CFile to avoid confusion with fs::Block

       

       

      Attachments

        Activity

          People

            awong Andrew Wong
            awong Andrew Wong
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: