[HIVE-17482] External LLAP client: acquire locks for tables queried directly by LLAP

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.0.0
• Component/s: llap, Transactions
• Assignee: Jason Dere
• Reporter: Jason Dere
• Created: 07/Sep/17 23:16
• Updated: 22/May/18 23:14
• Resolved: 29/Sep/17 18:09

Description

When using the LLAP external client with simple queries (filter/project of single table), the appropriate locks should be taken on the table being read like they are for normal Hive queries. This is important in the case of transactional tables being queried, since the compactor relies on the presence of table locks to determine whether it can safely delete old versions of compacted files without affecting currently running queries.

This does not have to happen in the complex query case, since a query is used (with the appropriate locking mechanisms) to create/populate the temp table holding the results to the complex query.

Issue Links

• is related to: HIVE-17645 MM tables patch conflicts with HIVE-17482 (Spark/Acid integration)
• links to: https://reviews.apache.org/r/62316/