Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-22340

Corrupt KeyValue is silently ignored

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 3.0.0, 2.2.0, 2.1.2, 2.0.4
    • Fix Version/s: 3.0.0, 2.2.0, 2.0.6, 2.1.5
    • Component/s: wal
    • Labels:
      None

      Description

      When a KeyValue is constructed from a corrupt byte array then IllegalArgumentException is thrown with a detailed message where the issue is in the array. This is part of a sanity check introduced in HBASE-21401.
      However, this is not logged at this time and the exception goes up to ProtobufLogReader.readNext where it is caught, wrapped into EOFException and the processing of the current WAL file is stopped.
      There is only a TRACE level log message that could indicate if something went wrong.

      This will cause data loss without log message not just for the single corrupted KV but for the rest of the WAL file.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                psomogyi Peter Somogyi
                Reporter:
                psomogyi Peter Somogyi
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: