Hive
  1. Hive
  2. HIVE-5519

Use paging mechanism for templeton get requests.

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.13.0
    • Component/s: WebHCat
    • Labels:
      None

      Description

      Issuing a command to retrieve the jobs field using

      "https://mwinkledemo.azurehdinsight.net:563/templeton/v1/queue/<job_id>?user.name=admin&fields=*" --user u
      will result in timeout in windows machine. The issue happens because of the amount of data that needs to be fetched. The proposal is to use paging based encoding scheme so that we flush the contents regularly and the client does not time out.

      1. HIVE-5519.3.patch.txt
        8 kB
        Hari Sankar Sivarama Subramaniyan
      2. HIVE-5519.2.patch.txt
        7 kB
        Hari Sankar Sivarama Subramaniyan
      3. HIVE-5519.1.patch.txt
        4 kB
        Hari Sankar Sivarama Subramaniyan

        Activity

        Hari Sankar Sivarama Subramaniyan created issue -
        Hari Sankar Sivarama Subramaniyan made changes -
        Field Original Value New Value
        Summary Support ranges of job ids for templeton Use paging mechanism for templeton get requests.
        Description Issuing a command to retrieve the jobs field using

        "https://mwinkledemo.azurehdinsight.net:563/templeton/v1/queue/&lt;job_id&gt;?user.name=admin&fields=*" --user u:p
        will result in timeout in windows machine. The issue happens because of the amount of data that needs to be fetched. The proposal is to introduce a new api to retrieve a list of job details rather than retrieve all the information using a single command.
        Issuing a command to retrieve the jobs field using

        "https://mwinkledemo.azurehdinsight.net:563/templeton/v1/queue/&lt;job_id&gt;?user.name=admin&fields=*" --user u:p
        will result in timeout in windows machine. The issue happens because of the amount of data that needs to be fetched. The proposal is to use paging based encoding scheme so that we flush the contents regularly and the client does not time out.
        Hari Sankar Sivarama Subramaniyan made changes -
        Attachment HIVE-5519.1.patch.txt [ 12610183 ]
        Hari Sankar Sivarama Subramaniyan made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Hari Sankar Sivarama Subramaniyan made changes -
        Attachment HIVE-5519.2.patch.txt [ 12610401 ]
        Hari Sankar Sivarama Subramaniyan made changes -
        Attachment HIVE-5519.2.patch.txt [ 12610401 ]
        Hari Sankar Sivarama Subramaniyan made changes -
        Attachment HIVE-5519.2.patch.txt [ 12610402 ]
        Hari Sankar Sivarama Subramaniyan made changes -
        Attachment HIVE-5519.3.patch.txt [ 12610700 ]
        Hari Sankar Sivarama Subramaniyan made changes -
        Attachment HIVE-5519.3.patch.txt [ 12610700 ]
        Hari Sankar Sivarama Subramaniyan made changes -
        Attachment HIVE-5519.3.patch.txt [ 12610725 ]
        Hari Sankar Sivarama Subramaniyan made changes -
        Attachment HIVE-5519.3.patch.txt [ 12610725 ]
        Hari Sankar Sivarama Subramaniyan made changes -
        Attachment HIVE-5519.3.patch.txt [ 12610726 ]
        Hari Sankar Sivarama Subramaniyan made changes -
        Attachment HIVE-5519.3.patch.txt [ 12610726 ]
        Hari Sankar Sivarama Subramaniyan made changes -
        Attachment HIVE-5519.3.patch.txt [ 12610734 ]
        Hari Sankar Sivarama Subramaniyan made changes -
        Fix Version/s 0.13.0 [ 12324986 ]
        Thejas M Nair made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]

          People

          • Assignee:
            Hari Sankar Sivarama Subramaniyan
            Reporter:
            Hari Sankar Sivarama Subramaniyan
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development