Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-4078

Ipython improvement

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.8.1
    • Fix Version/s: None
    • Component/s: python-interpreter
    • Labels:
      None
    • Environment:

      tested in linux / macos. Tested the ipython server directly.

      Description

      Ipython / ipython server has currently mutliple problem. 

      • Concurrent execution and auto complete can make a paragraph hang forever (until restart of the ipython server). Maybe related to https://github.com/jupyter/jupyter_client/issues/429
      • Out of memory for ipython will make a paragraph hang instead of throw one error.
      • High cpu usage. The loop that read from the pub/sub should not try to read everytimes the pub sub. Need to be debounce.

      Overall most of those bug might be related also to some jupyter_client bug or wrong usage.
      However, those are the action item:

      • synchronize auto complete / paragraph execution for now
      • check the kernel status when we are checking for the thread
      • sleep time to time when there is no message in pub/sub
      • Use only one queue instead of 3 ?

        Attachments

        There are no Sub-Tasks for this issue.

          Activity

            People

            • Assignee:
              aywa marc hurabielle
              Reporter:
              aywa marc hurabielle
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:

                Time Tracking

                Estimated:
                Original Estimate - 48h Original Estimate - 48h
                48h
                Remaining:
                Time Spent - 12.5h Remaining Estimate - 42h 40m
                42h 40m
                Logged:
                Time Spent - 12.5h Remaining Estimate - 42h 40m
                12.5h