Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-21365

Throw exception when user put data with skip wal to a table which may be replicated

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.0.0-alpha-1
    • 3.0.0-alpha-1
    • Client
    • None
    • Incompatible change
    • Hide
      If a table's column family's replication scope is not REPLICATION_SCOPE_LOCAL, this table may be replicated to peer cluster. As hbase's replication rely on WAL, if put data with Durability.SKIP_WAL to this table, the regionserver will throw a new InvalidMutationDurabilityException to client.
      Show
      If a table's column family's replication scope is not REPLICATION_SCOPE_LOCAL, this table may be replicated to peer cluster. As hbase's replication rely on WAL, if put data with Durability.SKIP_WAL to this table, the regionserver will throw a new InvalidMutationDurabilityException to client.

    Description

      A real problem in our production cluster. A user point that his table's data can't be replicate to the peer cluster. Then we start to debug the reason. We checked the replication scope, checked the replication wal entry filter, and check the namespace,tablecfs config. But didn't found any problem. We enabled the RS's debug log to find the reason. Finally, we found use use put with skip wal to write data. But it taked a long time... Our replication use wal to replicate data. So the data can't be replicated to peer cluster. I thought throw a exception may be better for user if the table's replication scope is not 0. (as 0 means not replicated).

      Attachments

        1. HBASE-21365.master.001.patch
          12 kB
          Guanghao Zhang
        2. HBASE-21365.master.002.patch
          12 kB
          Guanghao Zhang
        3. HBASE-21365.master.003.patch
          12 kB
          Guanghao Zhang

        Issue Links

          Activity

            People

              zghao Guanghao Zhang
              zghao Guanghao Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: