Uploaded image for project: 'Livy'
  1. Livy
  2. LIVY-545

Eldest Statement will be discarded even if user never get its result

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.5.0
    • Fix Version/s: None
    • Component/s: REPL
    • Labels:
    • Flags:
      Patch

      Description

      1. when repl.session's statement num has reach threshold which is configured by livy.rsc.retained-statements, default as 100. The submit of 101th statement will lead to the discard of the eldest statement (should be No.1).

      2. The discard means this statement is not attainable anymore. And if user forget to get the result of this discarded statement before or didn't  request the result in time, he must resubmit same statement again hoping server won't discard again.

      3. In above workflow, cluster do some unnecessary effort. If the discarded statement need hours of time to execute, this serve mode will waste a lot of  money.

      4. maybe resolve this problem by allow persist statement or discard statement that have be read in priority.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                994184916@qq.com weiwenda
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 10m
                  10m