Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-540

Streaming should send keep-alive signals to Reporter

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.7.0
    • None
    • None

    Description

      The goal is to avoid the 10-minutes Task timeout with certain usages of hadoopStreaming.

      This proposal does not introduce an artificial keep-alive heartbeat:
      it still requires the external Application to have activity.

      Streaming should set Reporter status in more places:

      1. output to side-effect files should (periodically) set reporter status.

      2. Application's stderr data should (periodically) set reporter status.

      Attachments

        Activity

          People

            Unassigned Unassigned
            michel_tourn Michel Tourn
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: