Hadoop Common
  1. Hadoop Common
  2. HADOOP-7784

secure datanodes fail to come up stating jsvc not found

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.0.0
    • Fix Version/s: 1.0.0
    • Component/s: None
    • Labels:
      None
    • Target Version/s:

      Description

      building 205.1 and trying to startup a secure dn leads to the following

      /usr/libexec/../bin/hadoop: line 386: /usr/libexec/../libexec/jsvc.amd64: No such file or directory
      /usr/libexec/../bin/hadoop: line 386: exec: /usr/libexec/../libexec/jsvc.amd64: cannot execute: No such file or directory

        Activity

        Hide
        Eric Yang added a comment -

        Rearrange build target for jsvc and task-controller to be invoked by "package" and "bin-package" target instead of dependent target.

        Show
        Eric Yang added a comment - Rearrange build target for jsvc and task-controller to be invoked by "package" and "bin-package" target instead of dependent target.
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12501681/HADOOP-7784-branch-20-security.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        -1 patch. The patch command could not apply the patch.

        Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/345//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12501681/HADOOP-7784-branch-20-security.patch against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. -1 patch. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/345//console This message is automatically generated.
        Hide
        Arpit Gupta added a comment -

        build and deployed a secure and a non secure cluster with the patch applied and all datanodes came up as expected.

        Show
        Arpit Gupta added a comment - build and deployed a secure and a non secure cluster with the patch applied and all datanodes came up as expected.
        Hide
        Giridharan Kesavan added a comment -

        I see the following error after applying the patch on 0.20 security branch.

        ant -Dcompile.c++=true -Dcompile.native=true clean rpm 
              [rpm] error: Installed (but unpackaged) file(s) found:
              [rpm]    /hadoop-0.20.206.0-SNAPSHOT/.eclipse.templates/.launches/AllTests.launch
              [rpm]    /hadoop-0.20.206.0-SNAPSHOT/.eclipse.templates/.launches/DataNode.launch
              [rpm]    /hadoop-0.20.206.0-SNAPSHOT/.eclipse.templates/.launches/JobTracker.launch
              [rpm]    /hadoop-0.20.206.0-SNAPSHOT/.eclipse.templates/.launches/NameNode.launch
              [rpm]    /hadoop-0.20.206.0-SNAPSHOT/.eclipse.templates/.launches/SpecificTestTemplate.launch
              [rpm]    /hadoop-0.20.206.0-SNAPSHOT/.eclipse.templates/.launches/TaskTracker.launch
              [rpm]    /hadoop-0.20.206.0-SNAPSHOT/.eclipse.templates/README.txt
              [rpm]     File listed twice: /usr/libexec
              [rpm]     File listed twice: /usr/libexec/hadoop-config.sh
              [rpm]     File listed twice: /usr/libexec/jsvc.amd64
        

        We should not be packaging eclipse templates as part of the rpm.

        Adding eclipse.templates to the hadoop package was introduced by HADOOP-7653 [this patch is committed only to the security branch and not to the 205 branch].

        Show
        Giridharan Kesavan added a comment - I see the following error after applying the patch on 0.20 security branch. ant -Dcompile.c++=true -Dcompile.native=true clean rpm [rpm] error: Installed (but unpackaged) file(s) found: [rpm] /hadoop-0.20.206.0-SNAPSHOT/.eclipse.templates/.launches/AllTests.launch [rpm] /hadoop-0.20.206.0-SNAPSHOT/.eclipse.templates/.launches/DataNode.launch [rpm] /hadoop-0.20.206.0-SNAPSHOT/.eclipse.templates/.launches/JobTracker.launch [rpm] /hadoop-0.20.206.0-SNAPSHOT/.eclipse.templates/.launches/NameNode.launch [rpm] /hadoop-0.20.206.0-SNAPSHOT/.eclipse.templates/.launches/SpecificTestTemplate.launch [rpm] /hadoop-0.20.206.0-SNAPSHOT/.eclipse.templates/.launches/TaskTracker.launch [rpm] /hadoop-0.20.206.0-SNAPSHOT/.eclipse.templates/README.txt [rpm] File listed twice: /usr/libexec [rpm] File listed twice: /usr/libexec/hadoop-config.sh [rpm] File listed twice: /usr/libexec/jsvc.amd64 We should not be packaging eclipse templates as part of the rpm. Adding eclipse.templates to the hadoop package was introduced by HADOOP-7653 [this patch is committed only to the security branch and not to the 205 branch] .
        Hide
        Eric Yang added a comment -

        Update patches to reflect difference in 20 security branch and 20.205 security branch.

        Show
        Eric Yang added a comment - Update patches to reflect difference in 20 security branch and 20.205 security branch.
        Hide
        Giridharan Kesavan added a comment -

        +1 looks good.

        with this patch we no more have to call the task-controller target explicitly while building rpm or deb package.

        Show
        Giridharan Kesavan added a comment - +1 looks good. with this patch we no more have to call the task-controller target explicitly while building rpm or deb package.
        Hide
        Eric Yang added a comment -

        I just committed this to 0.20 security branch and 0.20.205 security branch, thanks Arpit and Giri.

        Show
        Eric Yang added a comment - I just committed this to 0.20 security branch and 0.20.205 security branch, thanks Arpit and Giri.
        Hide
        Eric Yang added a comment -

        I just committed this to 0.20.205.1. Thanks Arpit for spotting the uncommitted change.

        Show
        Eric Yang added a comment - I just committed this to 0.20.205.1. Thanks Arpit for spotting the uncommitted change.
        Hide
        Matt Foley added a comment -

        Closed upon release of version 1.0.0.

        Show
        Matt Foley added a comment - Closed upon release of version 1.0.0.

          People

          • Assignee:
            Eric Yang
            Reporter:
            Arpit Gupta
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development