Hadoop Common
  1. Hadoop Common
  2. HADOOP-540

Streaming should send keep-alive signals to Reporter

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.7.0
    • Component/s: None
    • Labels:
      None

      Description

      The goal is to avoid the 10-minutes Task timeout with certain usages of hadoopStreaming.

      This proposal does not introduce an artificial keep-alive heartbeat:
      it still requires the external Application to have activity.

      Streaming should set Reporter status in more places:

      1. output to side-effect files should (periodically) set reporter status.

      2. Application's stderr data should (periodically) set reporter status.

        Activity

        Hide
        Doug Cutting added a comment -

        This should have been fixed by HADOOP-542.

        Show
        Doug Cutting added a comment - This should have been fixed by HADOOP-542 .

          People

          • Assignee:
            Unassigned
            Reporter:
            Michel Tourn
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development