Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-20436

Lock Manager scalability - linear

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.0.0
    • None
    • Transactions
    • None

    Description

      Hive TransactionManager currently has a mix of lock based and optimistic concurrency management techniques (which at times overlap).
      For inserts with Dynamic Partitions that represents update/merge it acquires locks on each existing partition which can flood the metastore DB.
      Need to clean up the logical model and the implementation.

      This will be an umbrella Jira for this

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-19961 Add partition if exists on transactional CRUD table acquires X lock

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. HIVE-20435 Failed Dynamic Partition Insert into insert only table may loose transaction metadata

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-18772 Make Acid Cleaner use MIN_HISTORY_LEVEL

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. HIVE-16139 Clarify Acid concurrency model

          • Major - Major loss of function.
          • Open

          Activity

            People

              Unassigned Unassigned
              ekoifman Eugene Koifman
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: