Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6495

Docs for archive-logs tool

        Details

        • Type: Bug
        • Status: Resolved
        • Priority: Major
        • Resolution: Fixed
        • Affects Version/s: 2.8.0
        • Fix Version/s: 2.8.0, 3.0.0-alpha1
        • Component/s: documentation
        • Labels:
          None
        • Target Version/s:
        • Hadoop Flags:
          Reviewed

          Description

          Write documentation for the 'mapred archive-logs' tool added in MAPREDUCE-6415.

          1. Text File
            MAPREDUCE-6495.001.patch
            8 kB
            Robert Kanter
          2. Text File
            MAPREDUCE-6495.002.patch
            8 kB
            Robert Kanter

            Issue Links

            is related to

            New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-6415 Create a tool to combine aggregated logs into HAR files

            • Major - Major loss of function.
            • Resolved

              Activity

              Ascending order - Click to sort in descending order
              Hide
              Permalink
              hadoopqa Hadoop QA added a comment -



              -1 overall



              Vote Subsystem Runtime Comment
              0 pre-patch 24m 41s Pre-patch trunk compilation is healthy.
              +1 @author 0m 0s The patch does not contain any @author tags.
              -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
              +1 javac 9m 23s There were no new javac warning messages.
              +1 javadoc 11m 21s There were no new javadoc warning messages.
              +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings.
              -1 site 0m 36s Site compilation is broken.
              +1 checkstyle 1m 12s There were no new checkstyle issues.
              +1 whitespace 0m 0s The patch has no lines that end in whitespace.
              +1 install 1m 30s mvn install still works.
              +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse.
              +1 findbugs 2m 5s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
              +1 mapreduce tests 1m 49s Tests passed in hadoop-mapreduce-client-core.
              +1 tools/hadoop tests 0m 33s Tests passed in hadoop-archive-logs.
                  54m 10s  



              Subsystem Report/Notes
              Patch URL http://issues.apache.org/jira/secure/attachment/12764350/MAPREDUCE-6495.001.patch
              Optional Tests site javadoc javac unit findbugs checkstyle
              git revision trunk / 39285e6
              site https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6038/artifact/patchprocess/patchSiteWarnings.txt
              hadoop-mapreduce-client-core test log https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6038/artifact/patchprocess/testrun_hadoop-mapreduce-client-core.txt
              hadoop-archive-logs test log https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6038/artifact/patchprocess/testrun_hadoop-archive-logs.txt
              Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6038/testReport/
              Java 1.7.0_55
              uname Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
              Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6038/console

              This message was automatically generated.

              Show
              hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 24m 41s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac 9m 23s There were no new javac warning messages. +1 javadoc 11m 21s There were no new javadoc warning messages. +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings. -1 site 0m 36s Site compilation is broken. +1 checkstyle 1m 12s There were no new checkstyle issues. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 30s mvn install still works. +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse. +1 findbugs 2m 5s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 mapreduce tests 1m 49s Tests passed in hadoop-mapreduce-client-core. +1 tools/hadoop tests 0m 33s Tests passed in hadoop-archive-logs.     54m 10s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12764350/MAPREDUCE-6495.001.patch Optional Tests site javadoc javac unit findbugs checkstyle git revision trunk / 39285e6 site https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6038/artifact/patchprocess/patchSiteWarnings.txt hadoop-mapreduce-client-core test log https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6038/artifact/patchprocess/testrun_hadoop-mapreduce-client-core.txt hadoop-archive-logs test log https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6038/artifact/patchprocess/testrun_hadoop-archive-logs.txt Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6038/testReport/ Java 1.7.0_55 uname Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6038/console This message was automatically generated.
              Hide
              Permalink
              adhoot Anubhav Dhoot added a comment -

              Looks good other than one reference in handleOpts still says "yarn archive-logs" instead of "mapred archive-logs".
              +1 pending that

              Show
              adhoot Anubhav Dhoot added a comment - Looks good other than one reference in handleOpts still says "yarn archive-logs" instead of "mapred archive-logs". +1 pending that
              Hide
              Permalink
              rkanter Robert Kanter added a comment -

              Thanks for the review Anubhav. I made the change to the committed patch. Comitted to trunk and branch-2!

              Show
              rkanter Robert Kanter added a comment - Thanks for the review Anubhav. I made the change to the committed patch. Comitted to trunk and branch-2!
              Hide
              Permalink
              rkanter Robert Kanter added a comment -

              The 002 patch has the super minor change, for reference.

              Show
              rkanter Robert Kanter added a comment - The 002 patch has the super minor change, for reference.
              Hide
              Permalink
              hudson Hudson added a comment -

              FAILURE: Integrated in Hadoop-trunk-Commit #8674 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8674/)
              MAPREDUCE-6495. Docs for archive-logs tool (rkanter) (rkanter: rev 0c4af0f99811a7138954391df3761aef9ff09155)

              • hadoop-tools/hadoop-archive-logs/src/site/markdown/HadoopArchiveLogs.md
              • hadoop-tools/hadoop-archive-logs/src/site/resources/css/site.css
              • hadoop-tools/hadoop-archive-logs/src/main/java/org/apache/hadoop/tools/HadoopArchiveLogs.java
              • hadoop-project/src/site/site.xml
              • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/markdown/MapredCommands.md
              • hadoop-mapreduce-project/CHANGES.txt
              Show
              hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #8674 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8674/ ) MAPREDUCE-6495 . Docs for archive-logs tool (rkanter) (rkanter: rev 0c4af0f99811a7138954391df3761aef9ff09155) hadoop-tools/hadoop-archive-logs/src/site/markdown/HadoopArchiveLogs.md hadoop-tools/hadoop-archive-logs/src/site/resources/css/site.css hadoop-tools/hadoop-archive-logs/src/main/java/org/apache/hadoop/tools/HadoopArchiveLogs.java hadoop-project/src/site/site.xml hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/markdown/MapredCommands.md hadoop-mapreduce-project/CHANGES.txt
              Hide
              Permalink
              hudson Hudson added a comment -

              SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #575 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/575/)
              MAPREDUCE-6495. Docs for archive-logs tool (rkanter) (rkanter: rev 0c4af0f99811a7138954391df3761aef9ff09155)

              • hadoop-tools/hadoop-archive-logs/src/site/resources/css/site.css
              • hadoop-tools/hadoop-archive-logs/src/main/java/org/apache/hadoop/tools/HadoopArchiveLogs.java
              • hadoop-tools/hadoop-archive-logs/src/site/markdown/HadoopArchiveLogs.md
              • hadoop-project/src/site/site.xml
              • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/markdown/MapredCommands.md
              • hadoop-mapreduce-project/CHANGES.txt
              Show
              hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #575 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/575/ ) MAPREDUCE-6495 . Docs for archive-logs tool (rkanter) (rkanter: rev 0c4af0f99811a7138954391df3761aef9ff09155) hadoop-tools/hadoop-archive-logs/src/site/resources/css/site.css hadoop-tools/hadoop-archive-logs/src/main/java/org/apache/hadoop/tools/HadoopArchiveLogs.java hadoop-tools/hadoop-archive-logs/src/site/markdown/HadoopArchiveLogs.md hadoop-project/src/site/site.xml hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/markdown/MapredCommands.md hadoop-mapreduce-project/CHANGES.txt
              Hide
              Permalink
              hudson Hudson added a comment -

              FAILURE: Integrated in Hadoop-Yarn-trunk #1296 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1296/)
              MAPREDUCE-6495. Docs for archive-logs tool (rkanter) (rkanter: rev 0c4af0f99811a7138954391df3761aef9ff09155)

              • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/markdown/MapredCommands.md
              • hadoop-mapreduce-project/CHANGES.txt
              • hadoop-tools/hadoop-archive-logs/src/site/markdown/HadoopArchiveLogs.md
              • hadoop-tools/hadoop-archive-logs/src/main/java/org/apache/hadoop/tools/HadoopArchiveLogs.java
              • hadoop-tools/hadoop-archive-logs/src/site/resources/css/site.css
              • hadoop-project/src/site/site.xml
              Show
              hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #1296 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1296/ ) MAPREDUCE-6495 . Docs for archive-logs tool (rkanter) (rkanter: rev 0c4af0f99811a7138954391df3761aef9ff09155) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/markdown/MapredCommands.md hadoop-mapreduce-project/CHANGES.txt hadoop-tools/hadoop-archive-logs/src/site/markdown/HadoopArchiveLogs.md hadoop-tools/hadoop-archive-logs/src/main/java/org/apache/hadoop/tools/HadoopArchiveLogs.java hadoop-tools/hadoop-archive-logs/src/site/resources/css/site.css hadoop-project/src/site/site.xml
              Hide
              Permalink
              hudson Hudson added a comment -

              FAILURE: Integrated in Hadoop-Mapreduce-trunk #2508 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2508/)
              MAPREDUCE-6495. Docs for archive-logs tool (rkanter) (rkanter: rev 0c4af0f99811a7138954391df3761aef9ff09155)

              • hadoop-tools/hadoop-archive-logs/src/site/markdown/HadoopArchiveLogs.md
              • hadoop-tools/hadoop-archive-logs/src/site/resources/css/site.css
              • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/markdown/MapredCommands.md
              • hadoop-tools/hadoop-archive-logs/src/main/java/org/apache/hadoop/tools/HadoopArchiveLogs.java
              • hadoop-project/src/site/site.xml
              • hadoop-mapreduce-project/CHANGES.txt
              Show
              hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2508 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2508/ ) MAPREDUCE-6495 . Docs for archive-logs tool (rkanter) (rkanter: rev 0c4af0f99811a7138954391df3761aef9ff09155) hadoop-tools/hadoop-archive-logs/src/site/markdown/HadoopArchiveLogs.md hadoop-tools/hadoop-archive-logs/src/site/resources/css/site.css hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/markdown/MapredCommands.md hadoop-tools/hadoop-archive-logs/src/main/java/org/apache/hadoop/tools/HadoopArchiveLogs.java hadoop-project/src/site/site.xml hadoop-mapreduce-project/CHANGES.txt
              Hide
              Permalink
              hudson Hudson added a comment -

              FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #561 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/561/)
              MAPREDUCE-6495. Docs for archive-logs tool (rkanter) (rkanter: rev 0c4af0f99811a7138954391df3761aef9ff09155)

              • hadoop-tools/hadoop-archive-logs/src/site/resources/css/site.css
              • hadoop-mapreduce-project/CHANGES.txt
              • hadoop-tools/hadoop-archive-logs/src/site/markdown/HadoopArchiveLogs.md
              • hadoop-project/src/site/site.xml
              • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/markdown/MapredCommands.md
              • hadoop-tools/hadoop-archive-logs/src/main/java/org/apache/hadoop/tools/HadoopArchiveLogs.java
              Show
              hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #561 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/561/ ) MAPREDUCE-6495 . Docs for archive-logs tool (rkanter) (rkanter: rev 0c4af0f99811a7138954391df3761aef9ff09155) hadoop-tools/hadoop-archive-logs/src/site/resources/css/site.css hadoop-mapreduce-project/CHANGES.txt hadoop-tools/hadoop-archive-logs/src/site/markdown/HadoopArchiveLogs.md hadoop-project/src/site/site.xml hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/markdown/MapredCommands.md hadoop-tools/hadoop-archive-logs/src/main/java/org/apache/hadoop/tools/HadoopArchiveLogs.java
              Hide
              Permalink
              hudson Hudson added a comment -

              FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #520 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/520/)
              MAPREDUCE-6495. Docs for archive-logs tool (rkanter) (rkanter: rev 0c4af0f99811a7138954391df3761aef9ff09155)

              • hadoop-tools/hadoop-archive-logs/src/main/java/org/apache/hadoop/tools/HadoopArchiveLogs.java
              • hadoop-mapreduce-project/CHANGES.txt
              • hadoop-tools/hadoop-archive-logs/src/site/markdown/HadoopArchiveLogs.md
              • hadoop-tools/hadoop-archive-logs/src/site/resources/css/site.css
              • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/markdown/MapredCommands.md
              • hadoop-project/src/site/site.xml
              Show
              hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #520 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/520/ ) MAPREDUCE-6495 . Docs for archive-logs tool (rkanter) (rkanter: rev 0c4af0f99811a7138954391df3761aef9ff09155) hadoop-tools/hadoop-archive-logs/src/main/java/org/apache/hadoop/tools/HadoopArchiveLogs.java hadoop-mapreduce-project/CHANGES.txt hadoop-tools/hadoop-archive-logs/src/site/markdown/HadoopArchiveLogs.md hadoop-tools/hadoop-archive-logs/src/site/resources/css/site.css hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/markdown/MapredCommands.md hadoop-project/src/site/site.xml
              Hide
              Permalink
              hudson Hudson added a comment -

              FAILURE: Integrated in Hadoop-Hdfs-trunk #2457 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2457/)
              MAPREDUCE-6495. Docs for archive-logs tool (rkanter) (rkanter: rev 0c4af0f99811a7138954391df3761aef9ff09155)

              • hadoop-tools/hadoop-archive-logs/src/main/java/org/apache/hadoop/tools/HadoopArchiveLogs.java
              • hadoop-project/src/site/site.xml
              • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/markdown/MapredCommands.md
              • hadoop-tools/hadoop-archive-logs/src/site/markdown/HadoopArchiveLogs.md
              • hadoop-tools/hadoop-archive-logs/src/site/resources/css/site.css
              • hadoop-mapreduce-project/CHANGES.txt
              Show
              hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2457 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2457/ ) MAPREDUCE-6495 . Docs for archive-logs tool (rkanter) (rkanter: rev 0c4af0f99811a7138954391df3761aef9ff09155) hadoop-tools/hadoop-archive-logs/src/main/java/org/apache/hadoop/tools/HadoopArchiveLogs.java hadoop-project/src/site/site.xml hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/markdown/MapredCommands.md hadoop-tools/hadoop-archive-logs/src/site/markdown/HadoopArchiveLogs.md hadoop-tools/hadoop-archive-logs/src/site/resources/css/site.css hadoop-mapreduce-project/CHANGES.txt

                People

                • Assignee:
                  rkanter Robert Kanter
                  Reporter:
                  rkanter Robert Kanter
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  4 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved:

                    Development