Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.0.0-alpha1
    • Component/s: scripts
    • Labels:

      Description

      It would make adding common options to hadoop_usage output easier if some entries were auto-populated. This is similar to what happens in FsShell and other parts of the Java code.

      1. HADOOP-10978.00.patch
        20 kB
        Allen Wittenauer
      2. HADOOP-10978.01.patch
        20 kB
        Allen Wittenauer
      3. HADOOP-10979.02.patch
        20 kB
        Allen Wittenauer

        Issue Links

          Activity

          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk #2205 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2205/)
          HADOOP-10979. Auto-entries in hadoop_usage (aw) (aw: rev ee36f4f9b87b194c965a2c5ace0244ab11e1d2d6)

          • hadoop-common-project/hadoop-common/src/main/bin/hadoop
          • hadoop-yarn-project/hadoop-yarn/bin/yarn
          • hadoop-mapreduce-project/bin/mapred
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-functions.sh
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2205 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2205/ ) HADOOP-10979 . Auto-entries in hadoop_usage (aw) (aw: rev ee36f4f9b87b194c965a2c5ace0244ab11e1d2d6) hadoop-common-project/hadoop-common/src/main/bin/hadoop hadoop-yarn-project/hadoop-yarn/bin/yarn hadoop-mapreduce-project/bin/mapred hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/main/bin/hadoop-functions.sh
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #248 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/248/)
          HADOOP-10979. Auto-entries in hadoop_usage (aw) (aw: rev ee36f4f9b87b194c965a2c5ace0244ab11e1d2d6)

          • hadoop-mapreduce-project/bin/mapred
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-functions.sh
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop
          • hadoop-yarn-project/hadoop-yarn/bin/yarn
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #248 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/248/ ) HADOOP-10979 . Auto-entries in hadoop_usage (aw) (aw: rev ee36f4f9b87b194c965a2c5ace0244ab11e1d2d6) hadoop-mapreduce-project/bin/mapred hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/main/bin/hadoop-functions.sh hadoop-common-project/hadoop-common/src/main/bin/hadoop hadoop-yarn-project/hadoop-yarn/bin/yarn
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk #2186 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2186/)
          HADOOP-10979. Auto-entries in hadoop_usage (aw) (aw: rev ee36f4f9b87b194c965a2c5ace0244ab11e1d2d6)

          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs
          • hadoop-mapreduce-project/bin/mapred
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-functions.sh
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop
          • hadoop-yarn-project/hadoop-yarn/bin/yarn
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2186 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2186/ ) HADOOP-10979 . Auto-entries in hadoop_usage (aw) (aw: rev ee36f4f9b87b194c965a2c5ace0244ab11e1d2d6) hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs hadoop-mapreduce-project/bin/mapred hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/main/bin/hadoop-functions.sh hadoop-common-project/hadoop-common/src/main/bin/hadoop hadoop-yarn-project/hadoop-yarn/bin/yarn
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #256 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/256/)
          HADOOP-10979. Auto-entries in hadoop_usage (aw) (aw: rev ee36f4f9b87b194c965a2c5ace0244ab11e1d2d6)

          • hadoop-mapreduce-project/bin/mapred
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-functions.sh
          • hadoop-yarn-project/hadoop-yarn/bin/yarn
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #256 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/256/ ) HADOOP-10979 . Auto-entries in hadoop_usage (aw) (aw: rev ee36f4f9b87b194c965a2c5ace0244ab11e1d2d6) hadoop-mapreduce-project/bin/mapred hadoop-common-project/hadoop-common/src/main/bin/hadoop-functions.sh hadoop-yarn-project/hadoop-yarn/bin/yarn hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/main/bin/hadoop hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Yarn-trunk #989 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/989/)
          HADOOP-10979. Auto-entries in hadoop_usage (aw) (aw: rev ee36f4f9b87b194c965a2c5ace0244ab11e1d2d6)

          • hadoop-yarn-project/hadoop-yarn/bin/yarn
          • hadoop-mapreduce-project/bin/mapred
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-functions.sh
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk #989 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/989/ ) HADOOP-10979 . Auto-entries in hadoop_usage (aw) (aw: rev ee36f4f9b87b194c965a2c5ace0244ab11e1d2d6) hadoop-yarn-project/hadoop-yarn/bin/yarn hadoop-mapreduce-project/bin/mapred hadoop-common-project/hadoop-common/src/main/bin/hadoop hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/main/bin/hadoop-functions.sh
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #259 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/259/)
          HADOOP-10979. Auto-entries in hadoop_usage (aw) (aw: rev ee36f4f9b87b194c965a2c5ace0244ab11e1d2d6)

          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-functions.sh
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop
          • hadoop-yarn-project/hadoop-yarn/bin/yarn
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-mapreduce-project/bin/mapred
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #259 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/259/ ) HADOOP-10979 . Auto-entries in hadoop_usage (aw) (aw: rev ee36f4f9b87b194c965a2c5ace0244ab11e1d2d6) hadoop-common-project/hadoop-common/src/main/bin/hadoop-functions.sh hadoop-common-project/hadoop-common/src/main/bin/hadoop hadoop-yarn-project/hadoop-yarn/bin/yarn hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs hadoop-common-project/hadoop-common/CHANGES.txt hadoop-mapreduce-project/bin/mapred
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 14m 34s Pre-patch trunk compilation is healthy.
          +1 @author 0m 1s The patch does not contain any @author tags.
          -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
          +1 javac 7m 33s There were no new javac warning messages.
          +1 javadoc 9m 37s There were no new javadoc warning messages.
          +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings.
          +1 shellcheck 0m 5s There were no new shellcheck (v0.3.3) issues.
          +1 whitespace 0m 0s The patch has no lines that end in whitespace.
          +1 install 1m 22s mvn install still works.
          +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse.
          +1 common tests 22m 12s Tests passed in hadoop-common.
          -1 hdfs tests 161m 29s Tests failed in hadoop-hdfs.
              217m 51s  



          Reason Tests
          Failed unit tests hadoop.hdfs.TestDistributedFileSystem
            hadoop.hdfs.TestAppendSnapshotTruncate
            hadoop.hdfs.server.namenode.ha.TestStandbyIsHot



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12745709/HADOOP-10979.02.patch
          Optional Tests javadoc javac unit shellcheck
          git revision trunk / 0bda84f
          hadoop-common test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7294/artifact/patchprocess/testrun_hadoop-common.txt
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7294/artifact/patchprocess/testrun_hadoop-hdfs.txt
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7294/testReport/
          Java 1.7.0_55
          uname Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7294/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 14m 34s Pre-patch trunk compilation is healthy. +1 @author 0m 1s The patch does not contain any @author tags. -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac 7m 33s There were no new javac warning messages. +1 javadoc 9m 37s There were no new javadoc warning messages. +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings. +1 shellcheck 0m 5s There were no new shellcheck (v0.3.3) issues. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 22s mvn install still works. +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse. +1 common tests 22m 12s Tests passed in hadoop-common. -1 hdfs tests 161m 29s Tests failed in hadoop-hdfs.     217m 51s   Reason Tests Failed unit tests hadoop.hdfs.TestDistributedFileSystem   hadoop.hdfs.TestAppendSnapshotTruncate   hadoop.hdfs.server.namenode.ha.TestStandbyIsHot Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12745709/HADOOP-10979.02.patch Optional Tests javadoc javac unit shellcheck git revision trunk / 0bda84f hadoop-common test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7294/artifact/patchprocess/testrun_hadoop-common.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7294/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7294/testReport/ Java 1.7.0_55 uname Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7294/console This message was automatically generated.
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #8178 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8178/)
          HADOOP-10979. Auto-entries in hadoop_usage (aw) (aw: rev ee36f4f9b87b194c965a2c5ace0244ab11e1d2d6)

          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs
          • hadoop-yarn-project/hadoop-yarn/bin/yarn
          • hadoop-mapreduce-project/bin/mapred
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-functions.sh
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #8178 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8178/ ) HADOOP-10979 . Auto-entries in hadoop_usage (aw) (aw: rev ee36f4f9b87b194c965a2c5ace0244ab11e1d2d6) hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs hadoop-yarn-project/hadoop-yarn/bin/yarn hadoop-mapreduce-project/bin/mapred hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/main/bin/hadoop-functions.sh hadoop-common-project/hadoop-common/src/main/bin/hadoop
          Hide
          aw Allen Wittenauer added a comment -

          Thanks!

          Committed to trunk.

          Show
          aw Allen Wittenauer added a comment - Thanks! Committed to trunk.
          Hide
          chris.douglas Chris Douglas added a comment -

          +1 lgtm

          Show
          chris.douglas Chris Douglas added a comment - +1 lgtm
          Hide
          aw Allen Wittenauer added a comment -

          -02:

          • correct patch file?
          Show
          aw Allen Wittenauer added a comment - -02: correct patch file?
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 14m 43s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
          +1 javac 7m 36s There were no new javac warning messages.
          +1 javadoc 9m 43s There were no new javadoc warning messages.
          +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings.
          -1 shellcheck 0m 6s The applied patch generated 5 new shellcheck (v0.3.3) issues (total was 25, now 30).
          +1 whitespace 0m 0s The patch has no lines that end in whitespace.
          +1 install 1m 33s mvn install still works.
          +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse.
          +1 common tests 22m 20s Tests passed in hadoop-common.
          -1 hdfs tests 159m 34s Tests failed in hadoop-hdfs.
              216m 33s  



          Reason Tests
          Failed unit tests hadoop.hdfs.server.namenode.ha.TestStandbyIsHot



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12743779/HADOOP-10978.00.patch
          Optional Tests javadoc javac unit shellcheck
          git revision trunk / fc92d3e
          shellcheck https://builds.apache.org/job/PreCommit-HADOOP-Build/7165/artifact/patchprocess/diffpatchshellcheck.txt
          hadoop-common test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7165/artifact/patchprocess/testrun_hadoop-common.txt
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7165/artifact/patchprocess/testrun_hadoop-hdfs.txt
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7165/testReport/
          Java 1.7.0_55
          uname Linux asf900.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7165/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 14m 43s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac 7m 36s There were no new javac warning messages. +1 javadoc 9m 43s There were no new javadoc warning messages. +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings. -1 shellcheck 0m 6s The applied patch generated 5 new shellcheck (v0.3.3) issues (total was 25, now 30). +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 33s mvn install still works. +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse. +1 common tests 22m 20s Tests passed in hadoop-common. -1 hdfs tests 159m 34s Tests failed in hadoop-hdfs.     216m 33s   Reason Tests Failed unit tests hadoop.hdfs.server.namenode.ha.TestStandbyIsHot Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12743779/HADOOP-10978.00.patch Optional Tests javadoc javac unit shellcheck git revision trunk / fc92d3e shellcheck https://builds.apache.org/job/PreCommit-HADOOP-Build/7165/artifact/patchprocess/diffpatchshellcheck.txt hadoop-common test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7165/artifact/patchprocess/testrun_hadoop-common.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7165/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7165/testReport/ Java 1.7.0_55 uname Linux asf900.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7165/console This message was automatically generated.
          Hide
          aw Allen Wittenauer added a comment -

          -01:

          • fix new shellcheck errors
          Show
          aw Allen Wittenauer added a comment - -01: fix new shellcheck errors
          Hide
          aw Allen Wittenauer added a comment -

          The new output:

          hadoop:

          aw-mbp-work:hadoop-3.0.0-SNAPSHOT aw$ bin/hadoop
          Usage: hadoop [OPTIONS] SUBCOMMAND [SUBCOMMAND OPTIONS]
           or    hadoop [OPTIONS] CLASSNAME [CLASSNAME OPTIONS]
            where CLASSNAME is a user-provided Java class
          
            OPTIONS is none or any of:
               --config confdir
               --daemon (start|stop|status)
               --debug
               --hostnames list[,of,host,names]
               --hosts filename
               --loglevel loglevel
               --slaves
          
            SUBCOMMAND is one of:
          archive       create a Hadoop archive
          checknative   check native Hadoop and compression libraries availability
          classpath     prints the class path needed to get the Hadoop jar and the
                        required libraries
          conftest      validate configuration XML files
          credential    interact with credential providers
          daemonlog     get/set the log level for each daemon
          distch        distributed metadata changer
          distcp        copy file or directories recursively
          fs            run a generic filesystem user client
          jar <jar>     run a jar file. NOTE: please use "yarn jar" to launch YARN
                        applications, not this command.
          jnipath       prints the java.library.path
          kerbname      show auth_to_local principal conversion
          key           manage keys via the KeyProvider
          trace         view and modify Hadoop tracing settings
          version       print the version
          
          Most subcommands print help when invoked w/o parameters or with -h.
          

          hdfs:

          aw-mbp-work:hadoop-3.0.0-SNAPSHOT aw$ bin/hdfs
          Usage: hdfs [OPTIONS] SUBCOMMAND [SUBCOMMAND OPTIONS]
          
            OPTIONS is none or any of:
               --config confdir
               --daemon (start|stop|status)
               --debug
               --hostnames list[,of,host,names]
               --hosts filename
               --loglevel loglevel
               --slaves
          
            SUBCOMMAND is one of:
          balancer             run a cluster balancing utility
          cacheadmin           configure the HDFS cache
          classpath            prints the class path needed to get the hadoop jar and
                               the required libraries
          crypto               configure HDFS encryption zones
          datanode             run a DFS datanode
          debug                run a Debug Admin to execute HDFS debug commands
          dfs                  run a filesystem command on the file system
          dfsadmin             run a DFS admin client
          fetchdt              fetch a delegation token from the NameNode
          fsck                 run a DFS filesystem checking utility
          getconf              get config values from configuration
          groups               get the groups which users belong to
          haadmin              run a DFS HA admin client
          jmxget               get JMX exported values from NameNode or DataNode.
          journalnode          run the DFS journalnode
          lsSnapshottableDir   list all snapshottable dirs owned by the current user
          mover                run a utility to move block replicas across storage types
          namenode             run the DFS namenode
          nfs3                 run an NFS version 3 gateway
          oev                  apply the offline edits viewer to an edits file
          oiv                  apply the offline fsimage viewer to an fsimage
          oiv_legacy           apply the offline fsimage viewer to a legacy fsimage
          portmap              run a portmap service
          secondarynamenode    run the DFS secondary namenode
          snapshotDiff         diff two snapshots of a directory or diff the current
                               directory contents with a snapshot
          storagepolicies      list/get/set block storage policies
          version              print the version
          zkfc                 run the ZK Failover Controller daemon
          
          Most subcommands print help when invoked w/o parameters or with -h.
          

          mapred:

          aw-mbp-work:hadoop-3.0.0-SNAPSHOT aw$ bin/mapred
          Usage: mapred [OPTIONS] SUBCOMMAND [SUBCOMMAND OPTIONS]
          
            OPTIONS is none or any of:
               --config confdir
               --daemon (start|stop|status)
               --debug
               --hostnames list[,of,host,names]
               --hosts filename
               --loglevel loglevel
               --slaves
          
            SUBCOMMAND is one of:
          archive         create a hadoop archive
          classpath       prints the class path needed for running mapreduce subcommands
          distcp          copy file or directories recursively
          historyserver   run job history servers as a standalone daemon
          hsadmin         job history server admin interface
          job             manipulate MapReduce jobs
          pipes           run a Pipes job
          queue           get information regarding JobQueues
          sampler         sampler
          version         print the version
          
          Most subcommands print help when invoked w/o parameters or with -h.
          

          yarn:

          aw-mbp-work:hadoop-3.0.0-SNAPSHOT aw$ bin/yarn
          Usage: yarn [OPTIONS] SUBCOMMAND [SUBCOMMAND OPTIONS]
           or    yarn [OPTIONS] CLASSNAME [CLASSNAME OPTIONS]
            where CLASSNAME is a user-provided Java class
          
            OPTIONS is none or any of:
               --config confdir
               --daemon (start|stop|status)
               --debug
               --hostnames list[,of,host,names]
               --hosts filename
               --loglevel loglevel
               --slaves
          
            SUBCOMMAND is one of:
          application          prints application(s) report/kill application
          applicationattempt   prints applicationattempt(s) report
          classpath            prints the class path needed to get the hadoop jar and
                               the required libraries
          cluster              prints cluster information
          container            prints container(s) report
          daemonlog            get/set the log level for each daemon
          jar <jar>            run a jar file
          logs                 dump container logs
          node                 prints node report(s)
          nodemanager          run a nodemanager on each slave
          proxyserver          run the web app proxy server
          queue                prints queue information
          resourcemanager      run the ResourceManager
          rmadmin              admin tools
          scmadmin             SharedCacheManager admin tools
          sharedcachemanager   run the SharedCacheManager daemon
          timelineserver       run the timeline server
          top                  view cluster information
          version              print the version
          
          Most subcommands print help when invoked w/o parameters or with -h.
          
          Show
          aw Allen Wittenauer added a comment - The new output: hadoop: aw-mbp-work:hadoop-3.0.0-SNAPSHOT aw$ bin/hadoop Usage: hadoop [OPTIONS] SUBCOMMAND [SUBCOMMAND OPTIONS] or hadoop [OPTIONS] CLASSNAME [CLASSNAME OPTIONS] where CLASSNAME is a user-provided Java class OPTIONS is none or any of: --config confdir --daemon (start|stop|status) --debug --hostnames list[,of,host,names] --hosts filename --loglevel loglevel --slaves SUBCOMMAND is one of: archive create a Hadoop archive checknative check native Hadoop and compression libraries availability classpath prints the class path needed to get the Hadoop jar and the required libraries conftest validate configuration XML files credential interact with credential providers daemonlog get/set the log level for each daemon distch distributed metadata changer distcp copy file or directories recursively fs run a generic filesystem user client jar <jar> run a jar file. NOTE: please use "yarn jar" to launch YARN applications, not this command. jnipath prints the java.library.path kerbname show auth_to_local principal conversion key manage keys via the KeyProvider trace view and modify Hadoop tracing settings version print the version Most subcommands print help when invoked w/o parameters or with -h. hdfs: aw-mbp-work:hadoop-3.0.0-SNAPSHOT aw$ bin/hdfs Usage: hdfs [OPTIONS] SUBCOMMAND [SUBCOMMAND OPTIONS] OPTIONS is none or any of: --config confdir --daemon (start|stop|status) --debug --hostnames list[,of,host,names] --hosts filename --loglevel loglevel --slaves SUBCOMMAND is one of: balancer run a cluster balancing utility cacheadmin configure the HDFS cache classpath prints the class path needed to get the hadoop jar and the required libraries crypto configure HDFS encryption zones datanode run a DFS datanode debug run a Debug Admin to execute HDFS debug commands dfs run a filesystem command on the file system dfsadmin run a DFS admin client fetchdt fetch a delegation token from the NameNode fsck run a DFS filesystem checking utility getconf get config values from configuration groups get the groups which users belong to haadmin run a DFS HA admin client jmxget get JMX exported values from NameNode or DataNode. journalnode run the DFS journalnode lsSnapshottableDir list all snapshottable dirs owned by the current user mover run a utility to move block replicas across storage types namenode run the DFS namenode nfs3 run an NFS version 3 gateway oev apply the offline edits viewer to an edits file oiv apply the offline fsimage viewer to an fsimage oiv_legacy apply the offline fsimage viewer to a legacy fsimage portmap run a portmap service secondarynamenode run the DFS secondary namenode snapshotDiff diff two snapshots of a directory or diff the current directory contents with a snapshot storagepolicies list/get/set block storage policies version print the version zkfc run the ZK Failover Controller daemon Most subcommands print help when invoked w/o parameters or with -h. mapred: aw-mbp-work:hadoop-3.0.0-SNAPSHOT aw$ bin/mapred Usage: mapred [OPTIONS] SUBCOMMAND [SUBCOMMAND OPTIONS] OPTIONS is none or any of: --config confdir --daemon (start|stop|status) --debug --hostnames list[,of,host,names] --hosts filename --loglevel loglevel --slaves SUBCOMMAND is one of: archive create a hadoop archive classpath prints the class path needed for running mapreduce subcommands distcp copy file or directories recursively historyserver run job history servers as a standalone daemon hsadmin job history server admin interface job manipulate MapReduce jobs pipes run a Pipes job queue get information regarding JobQueues sampler sampler version print the version Most subcommands print help when invoked w/o parameters or with -h. yarn: aw-mbp-work:hadoop-3.0.0-SNAPSHOT aw$ bin/yarn Usage: yarn [OPTIONS] SUBCOMMAND [SUBCOMMAND OPTIONS] or yarn [OPTIONS] CLASSNAME [CLASSNAME OPTIONS] where CLASSNAME is a user-provided Java class OPTIONS is none or any of: --config confdir --daemon (start|stop|status) --debug --hostnames list[,of,host,names] --hosts filename --loglevel loglevel --slaves SUBCOMMAND is one of: application prints application(s) report/kill application applicationattempt prints applicationattempt(s) report classpath prints the class path needed to get the hadoop jar and the required libraries cluster prints cluster information container prints container(s) report daemonlog get/set the log level for each daemon jar <jar> run a jar file logs dump container logs node prints node report(s) nodemanager run a nodemanager on each slave proxyserver run the web app proxy server queue prints queue information resourcemanager run the ResourceManager rmadmin admin tools scmadmin SharedCacheManager admin tools sharedcachemanager run the SharedCacheManager daemon timelineserver run the timeline server top view cluster information version print the version Most subcommands print help when invoked w/o parameters or with -h.
          Hide
          aw Allen Wittenauer added a comment - - edited

          -00:

          • two new functions, one to generate usage and the other to add content to it
          • hadoop, mapred, hdfs, and yarn modified to use new functions

          subcommands options are now automatically sorted. All text is placed into appropriately sized columns based using spaces, not tabs, with a screen with of 80 chars.

          Show
          aw Allen Wittenauer added a comment - - edited -00: two new functions, one to generate usage and the other to add content to it hadoop, mapred, hdfs, and yarn modified to use new functions subcommands options are now automatically sorted. All text is placed into appropriately sized columns based using spaces, not tabs, with a screen with of 80 chars.
          Hide
          aw Allen Wittenauer added a comment -

          In particular:

          • --config
          • --daemon options are standardized across all of the subsystems
          • help
          • version?
          Show
          aw Allen Wittenauer added a comment - In particular: --config --daemon options are standardized across all of the subsystems help version?

            People

            • Assignee:
              aw Allen Wittenauer
              Reporter:
              aw Allen Wittenauer
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development