[PHOENIX-4703] Provide an option to fully rebuild indexes asynchronously through SQL

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.15.0, 5.1.0
• Assignee: Gokcen Iskender
• Reporter: Vincent Poon
• Created: 24/Apr/18 00:40
• Updated: 31/May/19 01:01
• Resolved: 06/May/19 21:36

Description

Currently if we run "ALTER INDEX ... REBUILD" , all the rows in the index are deleted and the index is rebuilt synchronously.

"ALTER INEX ... REBUILD ASYNC" seems to be used for the IndexTool's partial rebuild option, rebuilding from ASYNC_REBUILD_TIMESTAMP (PHOENIX-2890)

So it seems currently the only way to fully rebuild is the drop the index, and recreate it.  This is burdensome as it requires have the schema DDL.

We should have an option to fully rebuild asynchronously, that has the same semantics as dropping and recreating the index.  A further advantage of this is we can maintain the splits of the index table while dropping its data.  We are currently seeing issues where rebuilding a large table via a MR job results in hotspotting due to all data regions writing to the same index region at the start.

 

Issue Links

• is cloned by: PHOENIX-5263 Provide an option to fully rebuild LOCAL indexes asynchronously through SQL
• is cloned by: PHOENIX-5272 Support ALTER INDEX REBUILD ALL ASYNC to fully rebuild global indexes async
• links to: GitHub Pull Request #495