Uploaded image for project: 'REEF'
  1. REEF
  2. REEF-1850

IMRU test fails on Yarn with 800+ nodes

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: IMRU
    • Labels:
      None

      Description

      Julia Wang found that IMRU test fails on Yarn with 800+ nodes.

      With 500 nodes, test pass.
      With 1000 nodes, test fails. Received 1000 completed tasks but only 998 completed evaluators. Drive doesn’t shut down until it is killed.
      With 800 nodes, test fails. Received 800 completed tasks but only 799 completed evaluators. Drive doesn’t shut down until it is killed.

      We need to investigate this scalability issue and find a root cause.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                taegeonum Tae-Geon Um
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: