Uploaded image for project: 'Giraph'
  1. Giraph
  2. GIRAPH-1036

Allow mappers to fail early on exceptions

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.2.0
    • Component/s: None
    • Labels:
      None

      Description

      Often when something fails in a mapper we see it stuck until its timeout passes. Digging through this issue I found two root causes:

      • Many threads we are creating were not daemon, preventing process to exit, only main thread should be daemon
      • When calling submit on ExecutorService, exceptions are not propagated back to the caller, unless get is called on the future. In ProgressableUtils.getResultsWithNCallables we were calling get on one by one future, causing us to have to wait for previous futures to finish before getting exception which happened in later one.

        Attachments

          Activity

            People

            • Assignee:
              majakabiljo Maja Kabiljo
              Reporter:
              majakabiljo Maja Kabiljo
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: