Uploaded image for project: 'Livy'
  1. Livy
  2. LIVY-355

Refactor StatementProgressListener to fix binary compatibility broken issue

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.4.0
    • Fix Version/s: 0.4.0
    • Component/s: REPL
    • Labels:
      None

      Description

      Current Livy's StatementProgressListener is an implementation based on SparkListener, whereas the signature of SparkListener was changed in Spark2.0+, which means if Livy code is built against Spark 1.6, then it cannot be run on Spark2, vice versa.

      So we have to avoid directly using SparkListener, here propose to use a new way to calculate the progress of statement.

        Attachments

          Activity

            People

            • Assignee:
              jerryshao Saisai Shao
              Reporter:
              jerryshao Saisai Shao
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: