Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-20621

GetOperationStatus called in resultset.next causing incremental slowness

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 4.0.0, 3.2.0
    • Fix Version/s: 4.0.0, 3.2.0
    • Component/s: JDBC
    • Labels:
      None

      Description

      Fetching result set for a result cache hit query gets slower as more rows are fetched. For fetching 10 row result set it took about 900ms but fetching 200 row result set took 8 seconds. 

      Reason for this slowness is GetOperationStatus is invoked inside resultset.next() and it happens for every row even after operation has completed. This is one RPC call per row fetched (there is also connection overhead without keepalive). 

        Attachments

        1. HIVE-20621.1.patch
          2 kB
          Prasanth Jayachandran
        2. HIVE-20621.2.patch
          2 kB
          Prasanth Jayachandran

          Issue Links

            Activity

              People

              • Assignee:
                prasanth_j Prasanth Jayachandran
                Reporter:
                prasanth_j Prasanth Jayachandran
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: