Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-12991 LLAP: Add interface to allow other applications to retrieve data
  3. HIVE-17482

External LLAP client: acquire locks for tables queried directly by LLAP

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.0.0
    • Component/s: llap, Transactions
    • Labels:
      None

      Description

      When using the LLAP external client with simple queries (filter/project of single table), the appropriate locks should be taken on the table being read like they are for normal Hive queries. This is important in the case of transactional tables being queried, since the compactor relies on the presence of table locks to determine whether it can safely delete old versions of compacted files without affecting currently running queries.

      This does not have to happen in the complex query case, since a query is used (with the appropriate locking mechanisms) to create/populate the temp table holding the results to the complex query.

        Attachments

        1. HIVE-17482.1.patch
          10 kB
          Jason Dere
        2. HIVE-17482.2.patch
          18 kB
          Jason Dere
        3. HIVE-17482.3.patch
          18 kB
          Jason Dere
        4. HIVE-17482.4.patch
          26 kB
          Jason Dere
        5. HIVE-17482.5.patch
          30 kB
          Jason Dere
        6. HIVE-17482.6.patch
          31 kB
          Jason Dere

          Issue Links

            Activity

              People

              • Assignee:
                jdere Jason Dere
                Reporter:
                jdere Jason Dere
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: