Hadoop Common
  1. Hadoop Common
  2. HADOOP-10532

Jenkins test-patch timed out on a large patch touching files in multiple modules.

    Details

    • Type: Test Test
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 3.0.0
    • Fix Version/s: None
    • Component/s: build
    • Labels:
      None
    • Target Version/s:

      Description

      On HADOOP-10503, I had posted a consolidated patch touching multiple files across all sub-modules: Hadoop, HDFS, YARN and MapReduce. The Jenkins test-patch runs for these consolidated patches timed out. I also experimented with a dummy patch that simply added one-line comment changes to files. This patch also timed out, which seems to indicate a bug in our automation rather than a problem with any patch in particular.

        Issue Links

          Activity

          Hide
          Allen Wittenauer added a comment -

          This is pretty much Working As Designed. Jenkins has a setting for how long a given patch run should be. If it goes over that value, it thinks the job is hung and kills it.

          The problem we've got is that hadoop-hdfs unit tests runs for an extremely long time. It would probably be well worth the effort to break it up from a single module to multiple modules, similarly to how yarn is currently designed. This would limit the possibility of running over that time for the vast majority of patches. We probably still couldn't run ALL of the unit tests, but those types of patches are extremely rare and/or can be broken up into multiple patches.

          Show
          Allen Wittenauer added a comment - This is pretty much Working As Designed. Jenkins has a setting for how long a given patch run should be. If it goes over that value, it thinks the job is hung and kills it. The problem we've got is that hadoop-hdfs unit tests runs for an extremely long time. It would probably be well worth the effort to break it up from a single module to multiple modules, similarly to how yarn is currently designed. This would limit the possibility of running over that time for the vast majority of patches. We probably still couldn't run ALL of the unit tests, but those types of patches are extremely rare and/or can be broken up into multiple patches.
          Hide
          Chris Nauroth added a comment -

          I'm attaching the full console log from one of the Jenkins runs that timed out.

          Show
          Chris Nauroth added a comment - I'm attaching the full console log from one of the Jenkins runs that timed out.

            People

            • Assignee:
              Jean-Pierre Matsumoto
              Reporter:
              Chris Nauroth
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:

                Development