Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-4164

After Pig job finish, Pig client spend too much time retry to connect to AM

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.14.0
    • impl
    • None
    • Reviewed

    Description

      For some script, after job finish, Pig spend a lot time try to connect AM before get redirect to JobHistoryServer. Here is the message we saw:

      2014-09-10 15:13:55,370 [main] INFO  org.apache.hadoop.ipc.Client - Retrying connect to server: daijymacpro-2.local/10.11.2.30:55223. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1000 MILLISECONDS)
      2014-09-10 15:13:56,371 [main] INFO  org.apache.hadoop.ipc.Client - Retrying connect to server: daijymacpro-2.local/10.11.2.30:55223. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1000 MILLISECONDS)
      2014-09-10 15:13:57,372 [main] INFO  org.apache.hadoop.ipc.Client - Retrying connect to server: daijymacpro-2.local/10.11.2.30:55223. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1000 MILLISECONDS)
      2014-09-10 15:13:57,476 [main] INFO  org.apache.hadoop.mapred.ClientServiceDelegate - Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
      

      Attachments

        1. PIG-4164-0.patch
          2 kB
          Daniel Dai
        2. PIG-4164-1.patch
          2 kB
          Daniel Dai

        Activity

          People

            daijy Daniel Dai
            daijy Daniel Dai
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: