Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-23093

Create new metastore config value for jdbc max batch size

Log workAgile BoardRank to TopRank to BottomVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 4.0.0
    • None
    • None

    Description

      In order to reduce the number of network calls to the metastore DB, there is an effort to batch acid/locking DB calls where it makes sense. Existing metastore config params do not provide a suitable, generic option to control the jdbc statement max batch size. Solution is to create a new config param, and use that in the appropriate batching calls in TxnHandler.

      Attachments

        1. HIVE-23093.1.patch
          8 kB
          Marton Bod
        2. HIVE-23093.2.patch
          8 kB
          Marton Bod
        3. HIVE-23093.2.patch
          8 kB
          Marton Bod
        4. HIVE-23093.3.patch
          11 kB
          Marton Bod
        5. HIVE-23093.4.patch
          11 kB
          Marton Bod

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Marton Bod Marton Bod Assign to me
            Marton Bod Marton Bod
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Issue deployment