Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-18752

HiveEndPoint, HiveStreamingConnection: Optimise metastore calls to open transactions batch and allocate write Ids.

    XMLWordPrintableJSON

Details

    Description

      Per table write ID implementation (HIVE-18192) have introduced write ID and maps it against the txn.

      Now, for streaming ingest, we need to open txns batch and then allocate write id for each txn in the batch which is 2 metastore calls.

      This can be optimised to use only one metastore api.

      Attachments

        Issue Links

          is related to

          Sub-task - The sub-task of the issue HIVE-18192 Introduce WriteID per table rather than using global transaction ID

          • Major - Major loss of function.
          • Closed

          Activity

            People

              gupta.nikhil0007 Nikhil Gupta
              sankarh Sankar Hariappan
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: