Hadoop Common
  1. Hadoop Common
  2. HADOOP-7655

provide a small validation script that smoke tests the installed cluster

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.20.205.0, 0.23.0
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Release Note:
      Committed to trunk and v23, since code reviewed by Eric.

      Description

      currently we have scripts that will setup a hadoop cluster, create users etc. We should add a script that will smoke test the installed cluster. The script could run 3 small mr jobs teragen, terasort and teravalidate and cleanup once its done.

      1. HADOOP-7655-branch-0.20-security.patch
        5 kB
        Arpit Gupta
      2. HADOOP-7655.txt
        5 kB
        Arpit Gupta

        Activity

        Hide
        Arpit Gupta added a comment -

        patch for trunk

        Show
        Arpit Gupta added a comment - patch for trunk
        Hide
        Eric Yang added a comment -

        +1 looks good.

        Show
        Eric Yang added a comment - +1 looks good.
        Hide
        Arpit Gupta added a comment -

        this patch should work on both 20 security and the 205 branch

        Show
        Arpit Gupta added a comment - this patch should work on both 20 security and the 205 branch
        Hide
        Eric Yang added a comment -

        +1 looks good for 20 security branch.

        Show
        Eric Yang added a comment - +1 looks good for 20 security branch.
        Hide
        Matt Foley added a comment -

        Committed to 0.20-security and 0.20.205.

        If this is needed in trunk, please port the patch.

        Won't close bug until see if needed in trunk.

        Show
        Matt Foley added a comment - Committed to 0.20-security and 0.20.205. If this is needed in trunk, please port the patch. Won't close bug until see if needed in trunk.
        Hide
        Matt Foley added a comment -

        Almost forgot: Thanks, Arpit!

        Show
        Matt Foley added a comment - Almost forgot: Thanks, Arpit!
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-trunk-Commit #1085 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1085/)
        HADOOP-7655. Provide a small validation script that smoke tests the installed cluster. Contributed by Arpit Gupta.

        mattf : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183539
        Files :

        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/hadoop-validate-setup.sh
        Show
        Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #1085 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1085/ ) HADOOP-7655 . Provide a small validation script that smoke tests the installed cluster. Contributed by Arpit Gupta. mattf : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183539 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/hadoop-validate-setup.sh
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk-Commit #1163 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1163/)
        HADOOP-7655. Provide a small validation script that smoke tests the installed cluster. Contributed by Arpit Gupta.

        mattf : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183539
        Files :

        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/hadoop-validate-setup.sh
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #1163 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1163/ ) HADOOP-7655 . Provide a small validation script that smoke tests the installed cluster. Contributed by Arpit Gupta. mattf : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183539 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/hadoop-validate-setup.sh
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-0.23-Commit #2 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/2/)
        HADOOP-7655. Provide a small validation script that smoke tests the installed cluster. Contributed by Arpit Gupta.

        mattf : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183544
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/packages/hadoop-validate-setup.sh
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Commit #2 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/2/ ) HADOOP-7655 . Provide a small validation script that smoke tests the installed cluster. Contributed by Arpit Gupta. mattf : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183544 Files : /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/packages/hadoop-validate-setup.sh
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-0.23-Commit #2 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/2/)
        HADOOP-7655. Provide a small validation script that smoke tests the installed cluster. Contributed by Arpit Gupta.

        mattf : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183544
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/packages/hadoop-validate-setup.sh
        Show
        Hudson added a comment - Integrated in Hadoop-Common-0.23-Commit #2 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/2/ ) HADOOP-7655 . Provide a small validation script that smoke tests the installed cluster. Contributed by Arpit Gupta. mattf : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183544 Files : /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/packages/hadoop-validate-setup.sh
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk-Commit #1104 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1104/)
        HADOOP-7655. Provide a small validation script that smoke tests the installed cluster. Contributed by Arpit Gupta.

        mattf : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183539
        Files :

        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/hadoop-validate-setup.sh
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #1104 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1104/ ) HADOOP-7655 . Provide a small validation script that smoke tests the installed cluster. Contributed by Arpit Gupta. mattf : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183539 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/hadoop-validate-setup.sh
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-0.23-Commit #3 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/3/)
        HADOOP-7655. Provide a small validation script that smoke tests the installed cluster. Contributed by Arpit Gupta.

        mattf : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183544
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/packages/hadoop-validate-setup.sh
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Commit #3 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/3/ ) HADOOP-7655 . Provide a small validation script that smoke tests the installed cluster. Contributed by Arpit Gupta. mattf : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183544 Files : /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/packages/hadoop-validate-setup.sh
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-0.23-Build #40 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/40/)
        HADOOP-7655. Provide a small validation script that smoke tests the installed cluster. Contributed by Arpit Gupta.

        mattf : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183544
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/packages/hadoop-validate-setup.sh
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #40 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/40/ ) HADOOP-7655 . Provide a small validation script that smoke tests the installed cluster. Contributed by Arpit Gupta. mattf : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183544 Files : /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/packages/hadoop-validate-setup.sh
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk #861 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/861/)
        HADOOP-7655. Provide a small validation script that smoke tests the installed cluster. Contributed by Arpit Gupta.

        mattf : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183539
        Files :

        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/hadoop-validate-setup.sh
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #861 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/861/ ) HADOOP-7655 . Provide a small validation script that smoke tests the installed cluster. Contributed by Arpit Gupta. mattf : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183539 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/hadoop-validate-setup.sh
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-0.23-Build #52 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/52/)
        HADOOP-7655. Provide a small validation script that smoke tests the installed cluster. Contributed by Arpit Gupta.

        mattf : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183544
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/packages/hadoop-validate-setup.sh
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Build #52 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/52/ ) HADOOP-7655 . Provide a small validation script that smoke tests the installed cluster. Contributed by Arpit Gupta. mattf : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183544 Files : /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/packages/hadoop-validate-setup.sh
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk #831 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/831/)
        HADOOP-7655. Provide a small validation script that smoke tests the installed cluster. Contributed by Arpit Gupta.

        mattf : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183539
        Files :

        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/hadoop-validate-setup.sh
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #831 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/831/ ) HADOOP-7655 . Provide a small validation script that smoke tests the installed cluster. Contributed by Arpit Gupta. mattf : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1183539 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/hadoop-validate-setup.sh
        Hide
        Matt Foley added a comment -

        Closed upon release of 0.20.205.0

        Show
        Matt Foley added a comment - Closed upon release of 0.20.205.0

          People

          • Assignee:
            Arpit Gupta
            Reporter:
            Arpit Gupta
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development