Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-2342

TestSleepJob and TestHdfsProxy broken after HDFS-2284

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.20.205.0
    • Fix Version/s: 0.20.205.0
    • Component/s: build
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      After HDFS-2284, TestSleepJob and TestHdfsProxy are failing.
      The both work in rev 1167444 and fail in rev 1167663.
      It will be great if they can be fixed for 205.

      1. h2342_20110922_0.20s.patch
        8 kB
        Tsz Wo Nicholas Sze

        Issue Links

          Activity

          Kihwal Lee created issue -
          Kihwal Lee made changes -
          Field Original Value New Value
          Fix Version/s 0.20.206.0 [ 12317959 ]
          Kihwal Lee made changes -
          Priority Major [ 3 ] Blocker [ 1 ]
          Hide
          Kihwal Lee added a comment -

          In r1171892, after Devaraj's merge (HADOOP-7637), TestHdfsProxy started working again. But TestSleepJob is still failing, probably due to a different reason. Previously, they were failing because they couldn't find the jersy sevelet container class added by the webhdfs (HDFS-2284).

          Show
          Kihwal Lee added a comment - In r1171892, after Devaraj's merge ( HADOOP-7637 ), TestHdfsProxy started working again. But TestSleepJob is still failing, probably due to a different reason. Previously, they were failing because they couldn't find the jersy sevelet container class added by the webhdfs ( HDFS-2284 ).
          Kihwal Lee made changes -
          Link This issue is broken by HDFS-2284 [ HDFS-2284 ]
          Hide
          Tsz Wo Nicholas Sze added a comment -

          Hi Kihwal, there are two classes, org.apache.hadoop.mapreduce.TestSleepJob and org.apache.hadoop.mapred.gridmix.TestSleepJob, which TestSleepJob are you referring to?

          For org.apache.hadoop.mapreduce.TestSleepJob, it was not committed to 0.20s until rev 1169585 according to the svn log. It was neither in rev 1167444 nor rev 1167663. So it could not be failed in these revisions. BTW, it is a mapreduce test program but not a unit test.

          For org.apache.hadoop.mapred.gridmix.TestSleepJob, I ran it and it did not fail.

          Show
          Tsz Wo Nicholas Sze added a comment - Hi Kihwal, there are two classes, org.apache.hadoop.mapreduce.TestSleepJob and org.apache.hadoop.mapred.gridmix.TestSleepJob, which TestSleepJob are you referring to? For org.apache.hadoop.mapreduce.TestSleepJob, it was not committed to 0.20s until rev 1169585 according to the svn log . It was neither in rev 1167444 nor rev 1167663. So it could not be failed in these revisions. BTW, it is a mapreduce test program but not a unit test. For org.apache.hadoop.mapred.gridmix.TestSleepJob, I ran it and it did not fail.
          Hide
          Tsz Wo Nicholas Sze added a comment -

          From build #16, I believe you are referring to org.apache.hadoop.mapreduce.TestSleepJob. It is not a unit test so that it cannot be initialized by the junit framework.

          Show
          Tsz Wo Nicholas Sze added a comment - From build #16 , I believe you are referring to org.apache.hadoop.mapreduce.TestSleepJob. It is not a unit test so that it cannot be initialized by the junit framework.
          Tsz Wo Nicholas Sze made changes -
          Link This issue relates to MAPREDUCE-2981 [ MAPREDUCE-2981 ]
          Hide
          Tsz Wo Nicholas Sze added a comment -

          > For org.apache.hadoop.mapred.gridmix.TestSleepJob, I ran it and it did not fail.

          It actually failed. The required Jersey libraries were missing.

          Show
          Tsz Wo Nicholas Sze added a comment - > For org.apache.hadoop.mapred.gridmix.TestSleepJob, I ran it and it did not fail. It actually failed. The required Jersey libraries were missing.
          Tsz Wo Nicholas Sze made changes -
          Assignee Tsz Wo (Nicholas), SZE [ szetszwo ]
          Hide
          Tsz Wo Nicholas Sze added a comment -

          h2342_20110922_0.20s.patch: add Jersey libraries to ivy.xml files in contrib.

          Show
          Tsz Wo Nicholas Sze added a comment - h2342_20110922_0.20s.patch: add Jersey libraries to ivy.xml files in contrib.
          Tsz Wo Nicholas Sze made changes -
          Attachment h2342_20110922_0.20s.patch [ 12496206 ]
          Hide
          Kihwal Lee added a comment -

          Thanks, Nicholas. The patch looks good. Do we have a similar issue in trunk?
          +1 for this patch going to 0.20-security and 0.20.205.

          Show
          Kihwal Lee added a comment - Thanks, Nicholas. The patch looks good. Do we have a similar issue in trunk? +1 for this patch going to 0.20-security and 0.20.205.
          Hide
          Matt Foley added a comment -

          Committed to 0.20-security and 0.20.205. Thanks, Nicholas!

          Leaving Jira open for possible 0.23 patch.

          Show
          Matt Foley added a comment - Committed to 0.20-security and 0.20.205. Thanks, Nicholas! Leaving Jira open for possible 0.23 patch.
          Hide
          Tsz Wo Nicholas Sze added a comment -

          Matt, thanks for committing the patch. Trunk does not have such problem. I think the rpm work has improved the ivy dependency so that we don't have to change contrib ivy.xml files for the libraries used in HDFS.

          Closing this.

          Show
          Tsz Wo Nicholas Sze added a comment - Matt, thanks for committing the patch. Trunk does not have such problem. I think the rpm work has improved the ivy dependency so that we don't have to change contrib ivy.xml files for the libraries used in HDFS. Closing this.
          Tsz Wo Nicholas Sze made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Hadoop Flags [Reviewed]
          Resolution Fixed [ 1 ]
          Tsz Wo Nicholas Sze made changes -
          Component/s build [ 12312925 ]
          Component/s contrib/hdfsproxy [ 12312915 ]
          Component/s test [ 12312916 ]
          Matt Foley made changes -
          Fix Version/s 0.20.206.0 [ 12317959 ]
          Hide
          Suresh Srinivas added a comment -

          This issue is related to ivy and is not applicable to trunk.

          Show
          Suresh Srinivas added a comment - This issue is related to ivy and is not applicable to trunk.
          Hide
          Matt Foley added a comment -

          Closed upon release of 0.20.205.0

          Show
          Matt Foley added a comment - Closed upon release of 0.20.205.0
          Matt Foley made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Tsz Wo Nicholas Sze
              Reporter:
              Kihwal Lee
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development