[HBASE-23931] CatalogJanitor consistency check adds merging regions to orphan list (tooo)

• Type: Bug
• Status: Reopened
• Priority: Major
• Resolution: Unresolved
• Component/s: hbck2
• Assignee: Unassigned
• Reporter: Michael Stack
• Created: 04/Mar/20 23:47
• Updated: 05/Mar/20 15:27

Description

When the CJ runs, it does its consistency checking first before figuring if the current row is that of a splitting or merging region. Down in the guts of consistency we will check if its a splitting region and then cater appropriately accommodating daughters, etc. For merge we don't do the same. We'll actually add merge children parents as orphans. Its transitory but confusing.

 

Here is an (ugly) example. Here is how the merge shows in orphans section of HBCK Report

{ENCODED => 8d4e9d9dbae0a90d47b9f72c89973693, NAME => 'scooter_analytics_segment,\x01\x03\x04\x01\x02\x03,1583362144713.8d4e9d9dbae0a90d47b9f72c89973693.', STARTKEY => '\x01\x03\x04\x01\x02\x03', ENDKEY => '\x01\x03\x04\x02\x02\x03'}{ENCODED => 62dbb839b3a70d5b670b9a30b0a05648, NAME => 'scooter_analytics_segment,\x01\x03\x04\x01\x02\x03\x02\x01\x01\x02201904090000\x00\x00qwest\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x0DW:S:P:D\x03\x00\x00\x03,1554833869031.62dbb839b3a70d5b670b9a30b0a05648.', STARTKEY => '\x01\x03\x04\x01\x02\x03\x02\x01\x01\x02201904090000\x00\x00qwest\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x0DW:S:P:D\x03\x00\x00\x03', ENDKEY => '\x01\x03\x04\x02\x01\x01'}{ENCODED => 8d4e9d9dbae0a90d47b9f72c89973693, NAME => 'scooter_analytics_segment,\x01\x03\x04\x01\x02\x03,1583362144713.8d4e9d9dbae0a90d47b9f72c89973693.', STARTKEY => '\x01\x03\x04\x01\x02\x03', ENDKEY => '\x01\x03\x04\x02\x02\x03'}{ENCODED => 2666b87ae4b58b05e815a3f14cc33215, NAME => 'scooter_analytics_segment,\x01\x03\x04\x02\x01\x01,1583365243857.2666b87ae4b58b05e815a3f14cc33215.', STARTKEY => '\x01\x03\x04\x02\x01\x01', ENDKEY => '\x01\x03\x04\x02\x02\x03'}

Then... here is the row in meta...

 

  scooter_analytics_segment,\x01\x03\x04\x01\x02\x03,1583362144713.8d4e9d9dbae0a90d47b9f72c89973693. column=info:merge0000, timestamp=1583364483794, value=PBUF\x08\xE6\xE8\xFC\x9C\xA0-\x12$\x0A\x07default\x12\x19scooter_analytics_segment\x1A\x06\x01\x03\x04\x01\x02\x03"\x06\x01\x03\x04\x02\x02\x03(\x000\x008\x00B d097cacbd74c36e84a599926547e3249
  scooter_analytics_segment,\x01\x03\x04\x01\x02\x03,1583362144713.8d4e9d9dbae0a90d47b9f72c89973693. column=info:merge0001, timestamp=1583364483794, value=PBUF\x08\xC8\xF3\xF3\xBD\x8A.\x12$\x0A\x07default\x12\x19scooter_analytics_segment\x1A\x06\x01\x03\x04\x02\x01\x01"\x06\x01\x03\x04\x02\x02\x03(\x000\x008\x00B 6b2ac2d1878e688da50483014fc5ab58
  scooter_analytics_segment,\x01\x03\x04\x01\x02\x03,1583362144713.8d4e9d9dbae0a90d47b9f72c89973693. column=info:regioninfo, timestamp=1583364484283, value={ENCODED => 8d4e9d9dbae0a90d47b9f72c89973693, NAME => 'scooter_analytics_segment,\x01\x03\x04\x01\x02\x03,1583362144713.8d4e9d9dbae0a90d47b9f72c89973693.', STARTKEY => '\x01\x03\x04\x01\x02\x03',      ENDKEY => '\x01\x03\x04\x02\x02\x03'}
  scooter_analytics_segment,\x01\x03\x04\x01\x02\x03,1583362144713.8d4e9d9dbae0a90d47b9f72c89973693. column=info:seqnumDuringOpen, timestamp=1583364484283, value=\x00\x00\x00\x00\x00\x00\x010
  scooter_analytics_segment,\x01\x03\x04\x01\x02\x03,1583362144713.8d4e9d9dbae0a90d47b9f72c89973693. column=info:server, timestamp=1583364484283, value=a.example.com:16020
  scooter_analytics_segment,\x01\x03\x04\x01\x02\x03,1583362144713.8d4e9d9dbae0a90d47b9f72c89973693. column=info:serverstartcode, timestamp=1583364484283, value=1583349446638
  scooter_analytics_segment,\x01\x03\x04\x01\x02\x03,1583362144713.8d4e9d9dbae0a90d47b9f72c89973693. column=info:sn, timestamp=1583364483948, value=a.example.com,16020,1583349446638
  scooter_analytics_segment,\x01\x03\x04\x01\x02\x03,1583362144713.8d4e9d9dbae0a90d47b9f72c89973693. column=info:state, timestamp=1583364484283, value=OPEN