Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1950

Jetty Acceptor can stuck TaskTracker forever

    Details

    • Type: Bug Bug
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 0.20.1
    • Fix Version/s: None
    • Component/s: tasktracker
    • Labels:
      None

      Description

      We have observed some TaskTrackers keep getting blacklisted because of "Too many fetch-failure" and the logs are full of the following exception.
      There can be lots of these exceptions in one millisecond.

      2010-07-19 15:00:00,146 ERROR org.mortbay.log: EXCEPTION
      java.nio.channels.ClosedSelectorException
              at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:66)
              at sun.nio.ch.SelectorImpl.selectNow(SelectorImpl.java:88)
              at org.mortbay.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:630)
              at org.mortbay.io.nio.SelectorManager.doSelect(SelectorManager.java:191)
              at org.mortbay.jetty.nio.SelectChannelConnector.accept(SelectChannelConnector.java:124)
              at org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:708)
              at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
      

        Issue Links

          Activity

          Hide
          Devaraj K added a comment -

          As per jetty defect JETTY-1251, it is fixed in 6.1.25 version.

          Can we upgrade to Jetty 6.1.25 or later version?

          Show
          Devaraj K added a comment - As per jetty defect JETTY-1251 , it is fixed in 6.1.25 version. Can we upgrade to Jetty 6.1.25 or later version?
          Hide
          Todd Lipcon added a comment -

          This smells like MAPREDUCE-2386, but a little different stacj

          Show
          Todd Lipcon added a comment - This smells like MAPREDUCE-2386 , but a little different stacj
          Todd Lipcon made changes -
          Link This issue relates to MAPREDUCE-2386 [ MAPREDUCE-2386 ]
          Hide
          Scott Chen added a comment -

          This is the related JETTY jira

          http://jira.codehaus.org/browse/JETTY-1251

          Show
          Scott Chen added a comment - This is the related JETTY jira http://jira.codehaus.org/browse/JETTY-1251
          Scott Chen made changes -
          Field Original Value New Value
          Assignee Scott Chen [ schen ]
          Scott Chen created issue -

            People

            • Assignee:
              Scott Chen
              Reporter:
              Scott Chen
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:

                Development