Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2980

Fetch failures and other related issues in Jetty 6.1.26

    Details

    • Type: Bug Bug
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 0.20.205.0, 0.23.0
    • Fix Version/s: None
    • Component/s: tasktracker
    • Labels:
      None

      Description

      Since upgrading Jetty from 6.1.14 to 6.1.26 we've had a ton of HTTP-related issues, including:

      • Much higher incidence of fetch failures
      • A few strange file-descriptor related bugs (eg MAPREDUCE-2389)
      • A few unexplained issues where long "fsck"s on the NameNode drop out halfway through with a ClosedChannelException

      Stress tests with 10000Map x 10000Reduce sleep jobs reliably reproduce fetch failures at a rate of about 1 per million on a 25 node test cluster. These problems are all new since the upgrade from 6.1.14.

        Issue Links

          Activity

          Chris Nauroth made changes -
          Link This issue is duplicated by MAPREDUCE-5588 [ MAPREDUCE-5588 ]
          Arun C Murthy made changes -
          Priority Critical [ 2 ] Major [ 3 ]
          Mubarak Seyed made changes -
          Link This issue relates to HBASE-5089 [ HBASE-5089 ]
          Todd Lipcon made changes -
          Link This issue is related to HADOOP-6882 [ HADOOP-6882 ]
          Todd Lipcon made changes -
          Field Original Value New Value
          Link This issue relates to MAPREDUCE-2389 [ MAPREDUCE-2389 ]
          Todd Lipcon created issue -

            People

            • Assignee:
              Unassigned
              Reporter:
              Todd Lipcon
            • Votes:
              4 Vote for this issue
              Watchers:
              35 Start watching this issue

              Dates

              • Created:
                Updated:

                Development