Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-20621

GetOperationStatus called in resultset.next causing incremental slowness

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.2.0, 4.0.0
    • 3.2.0, 4.0.0-alpha-1
    • JDBC
    • None

    Description

      Fetching result set for a result cache hit query gets slower as more rows are fetched. For fetching 10 row result set it took about 900ms but fetching 200 row result set took 8 seconds. 

      Reason for this slowness is GetOperationStatus is invoked inside resultset.next() and it happens for every row even after operation has completed. This is one RPC call per row fetched (there is also connection overhead without keepalive). 

      Attachments

        1. HIVE-20621.1.patch
          2 kB
          Prasanth Jayachandran
        2. HIVE-20621.2.patch
          2 kB
          Prasanth Jayachandran

        Issue Links

          Activity

            People

              prasanth_j Prasanth Jayachandran
              prasanth_j Prasanth Jayachandran
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: