Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-11495

Convert site documentation from apt to markdown

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.7.0
    • Fix Version/s: 2.7.0
    • Component/s: documentation
    • Labels:
      None
    • Target Version/s:

      Description

      Almost Plain Text (aka APT) lost. Markdown won.

      As a result, there are a ton of tools and online resources for Markdown that would make editing and using our documentation much easier. It would be extremely beneficial for the community as a whole to move from apt to markdown.

      This JIRA proposes to do this migration for the common project.

      1. HADOOP-11496-01.patch
        478 kB
        Allen Wittenauer
      2. HADOOP-11496-00.patch
        478 kB
        Allen Wittenauer
      3. HADOOP-11495-b2.002.patch
        404 kB
        Masatake Iwasaki
      4. HADOOP-11495-b2.001.patch
        402 kB
        Colin P. McCabe
      5. HADOOP-11495-05.patch
        493 kB
        Masatake Iwasaki
      6. HADOOP-11495-04.patch
        488 kB
        Allen Wittenauer
      7. HADOOP-11495-03.patch
        477 kB
        Allen Wittenauer
      8. HADOOP-11495-02.patch
        481 kB
        Allen Wittenauer

        Issue Links

          Activity

          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk #2065 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2065/)
          move HADOOP-11495 to 2.7 (cmccabe: rev ac3468add4ec6fa3581536a9c55d422801a948bd)

          • hadoop-common-project/hadoop-common/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2065 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2065/ ) move HADOOP-11495 to 2.7 (cmccabe: rev ac3468add4ec6fa3581536a9c55d422801a948bd) hadoop-common-project/hadoop-common/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #115 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/115/)
          move HADOOP-11495 to 2.7 (cmccabe: rev ac3468add4ec6fa3581536a9c55d422801a948bd)

          • hadoop-common-project/hadoop-common/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #115 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/115/ ) move HADOOP-11495 to 2.7 (cmccabe: rev ac3468add4ec6fa3581536a9c55d422801a948bd) hadoop-common-project/hadoop-common/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #106 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/106/)
          move HADOOP-11495 to 2.7 (cmccabe: rev ac3468add4ec6fa3581536a9c55d422801a948bd)

          • hadoop-common-project/hadoop-common/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #106 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/106/ ) move HADOOP-11495 to 2.7 (cmccabe: rev ac3468add4ec6fa3581536a9c55d422801a948bd) hadoop-common-project/hadoop-common/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk #2047 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2047/)
          move HADOOP-11495 to 2.7 (cmccabe: rev ac3468add4ec6fa3581536a9c55d422801a948bd)

          • hadoop-common-project/hadoop-common/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2047 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2047/ ) move HADOOP-11495 to 2.7 (cmccabe: rev ac3468add4ec6fa3581536a9c55d422801a948bd) hadoop-common-project/hadoop-common/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Yarn-trunk #849 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/849/)
          move HADOOP-11495 to 2.7 (cmccabe: rev ac3468add4ec6fa3581536a9c55d422801a948bd)

          • hadoop-common-project/hadoop-common/CHANGES.txt
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk #849 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/849/ ) move HADOOP-11495 to 2.7 (cmccabe: rev ac3468add4ec6fa3581536a9c55d422801a948bd) hadoop-common-project/hadoop-common/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #115 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/115/)
          move HADOOP-11495 to 2.7 (cmccabe: rev ac3468add4ec6fa3581536a9c55d422801a948bd)

          • hadoop-common-project/hadoop-common/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #115 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/115/ ) move HADOOP-11495 to 2.7 (cmccabe: rev ac3468add4ec6fa3581536a9c55d422801a948bd) hadoop-common-project/hadoop-common/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #7194 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7194/)
          move HADOOP-11495 to 2.7 (cmccabe: rev ac3468add4ec6fa3581536a9c55d422801a948bd)

          • hadoop-common-project/hadoop-common/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #7194 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7194/ ) move HADOOP-11495 to 2.7 (cmccabe: rev ac3468add4ec6fa3581536a9c55d422801a948bd) hadoop-common-project/hadoop-common/CHANGES.txt
          Hide
          cmccabe Colin P. McCabe added a comment -

          I backported this to 2.7 as discussed. I'll open up a JIRA to convert the remaining apt.vm files 2.7 to Markdown.

          Show
          cmccabe Colin P. McCabe added a comment - I backported this to 2.7 as discussed. I'll open up a JIRA to convert the remaining apt.vm files 2.7 to Markdown.
          Hide
          cmccabe Colin P. McCabe added a comment -

          Allen Wittenauer, I understand your concerns about documentation changes from trunk getting into branch-2 accidentally through a backport. You can help address that concern by doing a review of the branch-2 patches that Masatake Iwasaki and I have posted and/or filing follow-up JIRAs for any issues you find.

          It is not fair to ask someone doing a simple docs change intended for a stable release to do it twice over (once for markdown in trunk, and another time in .apt.vm for branch-2.) We already have a problem keeping documentation current. Dumping more work on documentation authors is the exact opposite of what we should be doing and effectively negates any benefit this may have (in fact, the patch has negative benefit in this case). Please keep in mind that there is no Hadoop 3.x release yet. Since Apache is about releasing software, branch-2 is still at the core of what we are doing as an organization.

          To that end, I'd much prefer if you decided to do this work in another JIRA given that this one was always specifically targeted to trunk and was never intended for branch-2. Never mind the fact that frankly I don't want my name associated with your patch.

          We've almost always done backports on the same JIRA as the original work. If you'd like to change that practice, then start a discussion thread in hdfs-devel.

          Anyway, I am +1 on Masatake Iwasaki's patch. I will wait a few hours before committing in case there are more comments.

          Show
          cmccabe Colin P. McCabe added a comment - Allen Wittenauer , I understand your concerns about documentation changes from trunk getting into branch-2 accidentally through a backport. You can help address that concern by doing a review of the branch-2 patches that Masatake Iwasaki and I have posted and/or filing follow-up JIRAs for any issues you find. It is not fair to ask someone doing a simple docs change intended for a stable release to do it twice over (once for markdown in trunk, and another time in .apt.vm for branch-2.) We already have a problem keeping documentation current. Dumping more work on documentation authors is the exact opposite of what we should be doing and effectively negates any benefit this may have (in fact, the patch has negative benefit in this case). Please keep in mind that there is no Hadoop 3.x release yet. Since Apache is about releasing software, branch-2 is still at the core of what we are doing as an organization. To that end, I'd much prefer if you decided to do this work in another JIRA given that this one was always specifically targeted to trunk and was never intended for branch-2. Never mind the fact that frankly I don't want my name associated with your patch. We've almost always done backports on the same JIRA as the original work. If you'd like to change that practice, then start a discussion thread in hdfs-devel. Anyway, I am +1 on Masatake Iwasaki 's patch. I will wait a few hours before committing in case there are more comments.
          Hide
          iwasakims Masatake Iwasaki added a comment -

          FileSystemShell.md: added usage of "truncate" which was dropped. I will add this to trunk too later.

          I looked at the older file. FileSystemShell.md in trunk already have the usage of "truncate".

          Show
          iwasakims Masatake Iwasaki added a comment - FileSystemShell.md: added usage of "truncate" which was dropped. I will add this to trunk too later. I looked at the older file. FileSystemShell.md in trunk already have the usage of "truncate".
          Hide
          iwasakims Masatake Iwasaki added a comment -

          and I will do the conversion of CommandsManual / ClusterSetup for branch-2 in follow-up JIRA.

          Show
          iwasakims Masatake Iwasaki added a comment - and I will do the conversion of CommandsManual / ClusterSetup for branch-2 in follow-up JIRA.
          Hide
          iwasakims Masatake Iwasaki added a comment -

          I added b2.002 addressing:

          • FileSystemShell.md: added usage of "truncate" which was dropped. I will add this to trunk too later.
          • SecureMode.md: applied fixes for nits in HADOOP-11583
          • Tracing.md: applied fixes for nits in HADOOP-11585
          • site.xml: added links to RackAwareness and InterfaceClassification (HADOOP-11559)

          Notes:

          • files except for CommandsManual.apt.vm, ClusterSetup.apt.vm, FileSystemShell.apt.vm, RackAwareness.apt.vm, SingleCluster.apt.vm (which Colin mentioned) were identical for branch-2 and trunk.
          • usage of commands below are added to FileSystemShell.md. I just left them because they are also available on branch-2.
            • createSnapshot
            • deleteSnapshot
            • df
            • help
            • renameSnapshot
            • rmdir
            • usage
          Show
          iwasakims Masatake Iwasaki added a comment - I added b2.002 addressing: FileSystemShell.md: added usage of "truncate" which was dropped. I will add this to trunk too later. SecureMode.md: applied fixes for nits in HADOOP-11583 Tracing.md: applied fixes for nits in HADOOP-11585 site.xml: added links to RackAwareness and InterfaceClassification ( HADOOP-11559 ) Notes: files except for CommandsManual.apt.vm, ClusterSetup.apt.vm, FileSystemShell.apt.vm, RackAwareness.apt.vm, SingleCluster.apt.vm (which Colin mentioned) were identical for branch-2 and trunk. usage of commands below are added to FileSystemShell.md. I just left them because they are also available on branch-2. createSnapshot deleteSnapshot df help renameSnapshot rmdir usage
          Hide
          aw Allen Wittenauer added a comment -

          I'd like to restate that we should not creating huge divergences between branch-2 and trunk unless there is a very good reason.

          All of the divergences you are pointing out happened in previous JIRAs as part of the followups to the shell code rewrite and/or other JIRAs that didn't make their way to branch-2. In other words, yes, there was a good reason. Incompatible and/or removal of deprecated procedures/APIs/etc should always come with documentation changes.

          If you aren't careful, you will introduce actual, real trunk dependencies in the branch-2 code base with your patch. You're going to have to do a much more thorough audit to catch them all. It's almost certainly better to start with the actual branch-2 sources and convert them directly rather than play "find all the relevant changes" as there are a lot (and, FWIW, more will be incoming).

          To that end, I'd much prefer if you decided to do this work in another JIRA given that this one was always specifically targeted to trunk and was never intended for branch-2. Never mind the fact that frankly I don't want my name associated with your patch.

          Thanks.

          Show
          aw Allen Wittenauer added a comment - I'd like to restate that we should not creating huge divergences between branch-2 and trunk unless there is a very good reason. All of the divergences you are pointing out happened in previous JIRAs as part of the followups to the shell code rewrite and/or other JIRAs that didn't make their way to branch-2. In other words, yes, there was a good reason. Incompatible and/or removal of deprecated procedures/APIs/etc should always come with documentation changes. If you aren't careful, you will introduce actual, real trunk dependencies in the branch-2 code base with your patch. You're going to have to do a much more thorough audit to catch them all. It's almost certainly better to start with the actual branch-2 sources and convert them directly rather than play "find all the relevant changes" as there are a lot (and, FWIW, more will be incoming). To that end, I'd much prefer if you decided to do this work in another JIRA given that this one was always specifically targeted to trunk and was never intended for branch-2. Never mind the fact that frankly I don't want my name associated with your patch. Thanks.
          Hide
          iwasakims Masatake Iwasaki added a comment -

          Thanks for the b2 patch Colin P. McCabe. Let me check it shortly.

          Show
          iwasakims Masatake Iwasaki added a comment - Thanks for the b2 patch Colin P. McCabe . Let me check it shortly.
          Hide
          cmccabe Colin P. McCabe added a comment -

          OK, I wrote a patch for branch-2.

          • SingleCluster.md.vm: there were some differences in the branch-2 version which I forward-ported on to the rebase. Mostly "rsync" versus "pdsh", etc.
          • FileSystemShell.md: there were a bunch of conversions from "hdfs dfs" -> "hadoop dfs" in the trunk version. I simply overwrote the branch-2 version since "hadoop dfs" is the correct (non-deprecated) thing anyway.
          • CommandsManual.md / ClusterSetup.md: looks like these whole files got rewritten (more or less). I just retained the old .apt.vm versions. We can convert them later if needed.

          I'd like to restate that we should not creating huge divergences between branch-2 and trunk unless there is a very good reason. We should try to keep this in mind in the future. I would certainly have vetoed this if I thought there was a chance that it would create a divergence like that and I'm sure that a bunch of others feel the same way.

          anyway the patch is up, let me know if there's anything more to do or else, I think we should commit asap

          Show
          cmccabe Colin P. McCabe added a comment - OK, I wrote a patch for branch-2. SingleCluster.md.vm: there were some differences in the branch-2 version which I forward-ported on to the rebase. Mostly "rsync" versus "pdsh", etc. FileSystemShell.md: there were a bunch of conversions from "hdfs dfs" -> "hadoop dfs" in the trunk version. I simply overwrote the branch-2 version since "hadoop dfs" is the correct (non-deprecated) thing anyway. CommandsManual.md / ClusterSetup.md: looks like these whole files got rewritten (more or less). I just retained the old .apt.vm versions. We can convert them later if needed. I'd like to restate that we should not creating huge divergences between branch-2 and trunk unless there is a very good reason. We should try to keep this in mind in the future. I would certainly have vetoed this if I thought there was a chance that it would create a divergence like that and I'm sure that a bunch of others feel the same way. anyway the patch is up, let me know if there's anything more to do or else, I think we should commit asap
          Hide
          cmccabe Colin P. McCabe added a comment - - edited

          This will be a huge maintenance burden on people updating documentation if we don't backport it to 2.x. We will essentially have to do each documentation patch twice over. This certainly far outweighs any possible advantage of converting the docs from apt to markdown. Let's prepare a patch for 2.x ASAP.

          Show
          cmccabe Colin P. McCabe added a comment - - edited This will be a huge maintenance burden on people updating documentation if we don't backport it to 2.x. We will essentially have to do each documentation patch twice over. This certainly far outweighs any possible advantage of converting the docs from apt to markdown. Let's prepare a patch for 2.x ASAP.
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Hdfs-trunk-Java8 #97 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/97/)
          HADOOP-11495. Convert site documentation from apt to markdown (Masatake Iwasaki via aw) (aw: rev e9d26fe9eb16a0482d3581504ecad22b4cd65077)

          • hadoop-common-project/hadoop-common/src/site/apt/Metrics.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/CLIMiniCluster.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/InterfaceClassification.md
          • hadoop-common-project/hadoop-common/src/site/apt/ClusterSetup.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/Compatibility.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/SingleNodeSetup.md
          • hadoop-common-project/hadoop-common/src/site/apt/InterfaceClassification.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/DeprecatedProperties.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/ServiceLevelAuth.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/NativeLibraries.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/RackAwareness.md
          • hadoop-common-project/hadoop-common/src/site/apt/HttpAuthentication.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/FileSystemShell.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/NativeLibraries.md.vm
          • hadoop-common-project/hadoop-common/src/site/apt/CommandsManual.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/Superusers.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
          • hadoop-common-project/hadoop-common/src/site/apt/SecureMode.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/Tracing.md
          • hadoop-common-project/hadoop-common/src/site/markdown/DeprecatedProperties.md
          • hadoop-common-project/hadoop-common/src/site/apt/RackAwareness.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/Compatibility.md
          • hadoop-common-project/hadoop-common/src/site/markdown/HttpAuthentication.md
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md
          • hadoop-common-project/hadoop-common/src/site/markdown/ServiceLevelAuth.md
          • hadoop-common-project/hadoop-common/src/site/apt/SingleCluster.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/Superusers.md
          • hadoop-common-project/hadoop-common/src/site/markdown/CLIMiniCluster.md.vm
          • hadoop-common-project/hadoop-common/src/site/apt/Tracing.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/SecureMode.md
          • hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
          • hadoop-common-project/hadoop-common/src/site/markdown/FileSystemShell.md
          • hadoop-common-project/hadoop-common/src/site/apt/SingleNodeSetup.apt.vm
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Hdfs-trunk-Java8 #97 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/97/ ) HADOOP-11495 . Convert site documentation from apt to markdown (Masatake Iwasaki via aw) (aw: rev e9d26fe9eb16a0482d3581504ecad22b4cd65077) hadoop-common-project/hadoop-common/src/site/apt/Metrics.apt.vm hadoop-common-project/hadoop-common/src/site/apt/CLIMiniCluster.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/InterfaceClassification.md hadoop-common-project/hadoop-common/src/site/apt/ClusterSetup.apt.vm hadoop-common-project/hadoop-common/src/site/apt/Compatibility.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm hadoop-common-project/hadoop-common/src/site/markdown/SingleNodeSetup.md hadoop-common-project/hadoop-common/src/site/apt/InterfaceClassification.apt.vm hadoop-common-project/hadoop-common/src/site/apt/DeprecatedProperties.apt.vm hadoop-common-project/hadoop-common/src/site/apt/ServiceLevelAuth.apt.vm hadoop-common-project/hadoop-common/src/site/apt/NativeLibraries.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/RackAwareness.md hadoop-common-project/hadoop-common/src/site/apt/HttpAuthentication.apt.vm hadoop-common-project/hadoop-common/src/site/apt/FileSystemShell.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/NativeLibraries.md.vm hadoop-common-project/hadoop-common/src/site/apt/CommandsManual.apt.vm hadoop-common-project/hadoop-common/src/site/apt/Superusers.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md hadoop-common-project/hadoop-common/src/site/apt/SecureMode.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/Tracing.md hadoop-common-project/hadoop-common/src/site/markdown/DeprecatedProperties.md hadoop-common-project/hadoop-common/src/site/apt/RackAwareness.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/Compatibility.md hadoop-common-project/hadoop-common/src/site/markdown/HttpAuthentication.md hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md hadoop-common-project/hadoop-common/src/site/markdown/ServiceLevelAuth.md hadoop-common-project/hadoop-common/src/site/apt/SingleCluster.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/Superusers.md hadoop-common-project/hadoop-common/src/site/markdown/CLIMiniCluster.md.vm hadoop-common-project/hadoop-common/src/site/apt/Tracing.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/SecureMode.md hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md hadoop-common-project/hadoop-common/src/site/markdown/FileSystemShell.md hadoop-common-project/hadoop-common/src/site/apt/SingleNodeSetup.apt.vm
          Hide
          aw Allen Wittenauer added a comment -

          do you have any plans to merge this patch to branch-2?

          Nope. I don't do branch-2 anymore.

          Show
          aw Allen Wittenauer added a comment - do you have any plans to merge this patch to branch-2? Nope. I don't do branch-2 anymore.
          Hide
          wheat9 Haohui Mai added a comment -

          Allen Wittenauer, do you have any plans to merge this patch to branch-2?

          Show
          wheat9 Haohui Mai added a comment - Allen Wittenauer , do you have any plans to merge this patch to branch-2?
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk #2052 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2052/)
          HADOOP-11495. Convert site documentation from apt to markdown (Masatake Iwasaki via aw) (aw: rev e9d26fe9eb16a0482d3581504ecad22b4cd65077)

          • hadoop-common-project/hadoop-common/src/site/markdown/Compatibility.md
          • hadoop-common-project/hadoop-common/src/site/markdown/RackAwareness.md
          • hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
          • hadoop-common-project/hadoop-common/src/site/markdown/InterfaceClassification.md
          • hadoop-common-project/hadoop-common/src/site/apt/RackAwareness.apt.vm
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/site/apt/Metrics.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/Superusers.md
          • hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
          • hadoop-common-project/hadoop-common/src/site/apt/SingleNodeSetup.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/SecureMode.md
          • hadoop-common-project/hadoop-common/src/site/apt/ServiceLevelAuth.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/ClusterSetup.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/SingleCluster.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/HttpAuthentication.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/NativeLibraries.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/CLIMiniCluster.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/Tracing.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/NativeLibraries.md.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/SingleNodeSetup.md
          • hadoop-common-project/hadoop-common/src/site/apt/InterfaceClassification.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/Tracing.md
          • hadoop-common-project/hadoop-common/src/site/markdown/HttpAuthentication.md
          • hadoop-common-project/hadoop-common/src/site/apt/DeprecatedProperties.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/ServiceLevelAuth.md
          • hadoop-common-project/hadoop-common/src/site/apt/FileSystemShell.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/SecureMode.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/FileSystemShell.md
          • hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm
          • hadoop-common-project/hadoop-common/src/site/apt/CommandsManual.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md
          • hadoop-common-project/hadoop-common/src/site/apt/Superusers.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/CLIMiniCluster.md.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/DeprecatedProperties.md
          • hadoop-common-project/hadoop-common/src/site/apt/Compatibility.apt.vm
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2052 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2052/ ) HADOOP-11495 . Convert site documentation from apt to markdown (Masatake Iwasaki via aw) (aw: rev e9d26fe9eb16a0482d3581504ecad22b4cd65077) hadoop-common-project/hadoop-common/src/site/markdown/Compatibility.md hadoop-common-project/hadoop-common/src/site/markdown/RackAwareness.md hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md hadoop-common-project/hadoop-common/src/site/markdown/InterfaceClassification.md hadoop-common-project/hadoop-common/src/site/apt/RackAwareness.apt.vm hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/site/apt/Metrics.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/Superusers.md hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md hadoop-common-project/hadoop-common/src/site/apt/SingleNodeSetup.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/SecureMode.md hadoop-common-project/hadoop-common/src/site/apt/ServiceLevelAuth.apt.vm hadoop-common-project/hadoop-common/src/site/apt/ClusterSetup.apt.vm hadoop-common-project/hadoop-common/src/site/apt/SingleCluster.apt.vm hadoop-common-project/hadoop-common/src/site/apt/HttpAuthentication.apt.vm hadoop-common-project/hadoop-common/src/site/apt/NativeLibraries.apt.vm hadoop-common-project/hadoop-common/src/site/apt/CLIMiniCluster.apt.vm hadoop-common-project/hadoop-common/src/site/apt/Tracing.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/NativeLibraries.md.vm hadoop-common-project/hadoop-common/src/site/markdown/SingleNodeSetup.md hadoop-common-project/hadoop-common/src/site/apt/InterfaceClassification.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/Tracing.md hadoop-common-project/hadoop-common/src/site/markdown/HttpAuthentication.md hadoop-common-project/hadoop-common/src/site/apt/DeprecatedProperties.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/ServiceLevelAuth.md hadoop-common-project/hadoop-common/src/site/apt/FileSystemShell.apt.vm hadoop-common-project/hadoop-common/src/site/apt/SecureMode.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/FileSystemShell.md hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm hadoop-common-project/hadoop-common/src/site/apt/CommandsManual.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md hadoop-common-project/hadoop-common/src/site/apt/Superusers.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/CLIMiniCluster.md.vm hadoop-common-project/hadoop-common/src/site/markdown/DeprecatedProperties.md hadoop-common-project/hadoop-common/src/site/apt/Compatibility.apt.vm
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #102 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/102/)
          HADOOP-11495. Convert site documentation from apt to markdown (Masatake Iwasaki via aw) (aw: rev e9d26fe9eb16a0482d3581504ecad22b4cd65077)

          • hadoop-common-project/hadoop-common/src/site/markdown/CLIMiniCluster.md.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/Compatibility.md
          • hadoop-common-project/hadoop-common/src/site/apt/FileSystemShell.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/HttpAuthentication.md
          • hadoop-common-project/hadoop-common/src/site/apt/SecureMode.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/InterfaceClassification.md
          • hadoop-common-project/hadoop-common/src/site/apt/SingleCluster.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/SingleNodeSetup.md
          • hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/Tracing.md
          • hadoop-common-project/hadoop-common/src/site/apt/NativeLibraries.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/HttpAuthentication.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/ServiceLevelAuth.md
          • hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
          • hadoop-common-project/hadoop-common/src/site/apt/Compatibility.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/RackAwareness.md
          • hadoop-common-project/hadoop-common/src/site/markdown/NativeLibraries.md.vm
          • hadoop-common-project/hadoop-common/src/site/apt/ClusterSetup.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/Metrics.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/InterfaceClassification.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/Superusers.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/DeprecatedProperties.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/Tracing.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/SingleNodeSetup.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/CLIMiniCluster.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/SecureMode.md
          • hadoop-common-project/hadoop-common/src/site/markdown/FileSystemShell.md
          • hadoop-common-project/hadoop-common/src/site/markdown/Superusers.md
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
          • hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md
          • hadoop-common-project/hadoop-common/src/site/markdown/DeprecatedProperties.md
          • hadoop-common-project/hadoop-common/src/site/apt/CommandsManual.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/RackAwareness.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/ServiceLevelAuth.apt.vm
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #102 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/102/ ) HADOOP-11495 . Convert site documentation from apt to markdown (Masatake Iwasaki via aw) (aw: rev e9d26fe9eb16a0482d3581504ecad22b4cd65077) hadoop-common-project/hadoop-common/src/site/markdown/CLIMiniCluster.md.vm hadoop-common-project/hadoop-common/src/site/markdown/Compatibility.md hadoop-common-project/hadoop-common/src/site/apt/FileSystemShell.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/HttpAuthentication.md hadoop-common-project/hadoop-common/src/site/apt/SecureMode.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/InterfaceClassification.md hadoop-common-project/hadoop-common/src/site/apt/SingleCluster.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/SingleNodeSetup.md hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm hadoop-common-project/hadoop-common/src/site/markdown/Tracing.md hadoop-common-project/hadoop-common/src/site/apt/NativeLibraries.apt.vm hadoop-common-project/hadoop-common/src/site/apt/HttpAuthentication.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/ServiceLevelAuth.md hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md hadoop-common-project/hadoop-common/src/site/apt/Compatibility.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/RackAwareness.md hadoop-common-project/hadoop-common/src/site/markdown/NativeLibraries.md.vm hadoop-common-project/hadoop-common/src/site/apt/ClusterSetup.apt.vm hadoop-common-project/hadoop-common/src/site/apt/Metrics.apt.vm hadoop-common-project/hadoop-common/src/site/apt/InterfaceClassification.apt.vm hadoop-common-project/hadoop-common/src/site/apt/Superusers.apt.vm hadoop-common-project/hadoop-common/src/site/apt/DeprecatedProperties.apt.vm hadoop-common-project/hadoop-common/src/site/apt/Tracing.apt.vm hadoop-common-project/hadoop-common/src/site/apt/SingleNodeSetup.apt.vm hadoop-common-project/hadoop-common/src/site/apt/CLIMiniCluster.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/SecureMode.md hadoop-common-project/hadoop-common/src/site/markdown/FileSystemShell.md hadoop-common-project/hadoop-common/src/site/markdown/Superusers.md hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md hadoop-common-project/hadoop-common/src/site/markdown/DeprecatedProperties.md hadoop-common-project/hadoop-common/src/site/apt/CommandsManual.apt.vm hadoop-common-project/hadoop-common/src/site/apt/RackAwareness.apt.vm hadoop-common-project/hadoop-common/src/site/apt/ServiceLevelAuth.apt.vm
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk #2033 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2033/)
          HADOOP-11495. Convert site documentation from apt to markdown (Masatake Iwasaki via aw) (aw: rev e9d26fe9eb16a0482d3581504ecad22b4cd65077)

          • hadoop-common-project/hadoop-common/src/site/markdown/DeprecatedProperties.md
          • hadoop-common-project/hadoop-common/src/site/markdown/HttpAuthentication.md
          • hadoop-common-project/hadoop-common/src/site/apt/ClusterSetup.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/Metrics.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/FileSystemShell.md
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/site/apt/SingleNodeSetup.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/Superusers.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/RackAwareness.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/RackAwareness.md
          • hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
          • hadoop-common-project/hadoop-common/src/site/markdown/SingleNodeSetup.md
          • hadoop-common-project/hadoop-common/src/site/apt/InterfaceClassification.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/Compatibility.md
          • hadoop-common-project/hadoop-common/src/site/apt/CommandsManual.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/Superusers.md
          • hadoop-common-project/hadoop-common/src/site/markdown/SecureMode.md
          • hadoop-common-project/hadoop-common/src/site/apt/SecureMode.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/HttpAuthentication.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/NativeLibraries.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/Compatibility.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md
          • hadoop-common-project/hadoop-common/src/site/apt/Tracing.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/DeprecatedProperties.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/ServiceLevelAuth.md
          • hadoop-common-project/hadoop-common/src/site/apt/FileSystemShell.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/CLIMiniCluster.md.vm
          • hadoop-common-project/hadoop-common/src/site/apt/CLIMiniCluster.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/Tracing.md
          • hadoop-common-project/hadoop-common/src/site/apt/ServiceLevelAuth.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
          • hadoop-common-project/hadoop-common/src/site/markdown/NativeLibraries.md.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/InterfaceClassification.md
          • hadoop-common-project/hadoop-common/src/site/apt/SingleCluster.apt.vm
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2033 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2033/ ) HADOOP-11495 . Convert site documentation from apt to markdown (Masatake Iwasaki via aw) (aw: rev e9d26fe9eb16a0482d3581504ecad22b4cd65077) hadoop-common-project/hadoop-common/src/site/markdown/DeprecatedProperties.md hadoop-common-project/hadoop-common/src/site/markdown/HttpAuthentication.md hadoop-common-project/hadoop-common/src/site/apt/ClusterSetup.apt.vm hadoop-common-project/hadoop-common/src/site/apt/Metrics.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/FileSystemShell.md hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/site/apt/SingleNodeSetup.apt.vm hadoop-common-project/hadoop-common/src/site/apt/Superusers.apt.vm hadoop-common-project/hadoop-common/src/site/apt/RackAwareness.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm hadoop-common-project/hadoop-common/src/site/markdown/RackAwareness.md hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md hadoop-common-project/hadoop-common/src/site/markdown/SingleNodeSetup.md hadoop-common-project/hadoop-common/src/site/apt/InterfaceClassification.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/Compatibility.md hadoop-common-project/hadoop-common/src/site/apt/CommandsManual.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/Superusers.md hadoop-common-project/hadoop-common/src/site/markdown/SecureMode.md hadoop-common-project/hadoop-common/src/site/apt/SecureMode.apt.vm hadoop-common-project/hadoop-common/src/site/apt/HttpAuthentication.apt.vm hadoop-common-project/hadoop-common/src/site/apt/NativeLibraries.apt.vm hadoop-common-project/hadoop-common/src/site/apt/Compatibility.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md hadoop-common-project/hadoop-common/src/site/apt/Tracing.apt.vm hadoop-common-project/hadoop-common/src/site/apt/DeprecatedProperties.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/ServiceLevelAuth.md hadoop-common-project/hadoop-common/src/site/apt/FileSystemShell.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/CLIMiniCluster.md.vm hadoop-common-project/hadoop-common/src/site/apt/CLIMiniCluster.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/Tracing.md hadoop-common-project/hadoop-common/src/site/apt/ServiceLevelAuth.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md hadoop-common-project/hadoop-common/src/site/markdown/NativeLibraries.md.vm hadoop-common-project/hadoop-common/src/site/markdown/InterfaceClassification.md hadoop-common-project/hadoop-common/src/site/apt/SingleCluster.apt.vm
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk #835 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/835/)
          HADOOP-11495. Convert site documentation from apt to markdown (Masatake Iwasaki via aw) (aw: rev e9d26fe9eb16a0482d3581504ecad22b4cd65077)

          • hadoop-common-project/hadoop-common/src/site/apt/DeprecatedProperties.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/RackAwareness.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/Superusers.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/CLIMiniCluster.md.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/Compatibility.md
          • hadoop-common-project/hadoop-common/src/site/markdown/ServiceLevelAuth.md
          • hadoop-common-project/hadoop-common/src/site/apt/ServiceLevelAuth.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/CLIMiniCluster.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/CommandsManual.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/NativeLibraries.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/Compatibility.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/Tracing.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/SecureMode.md
          • hadoop-common-project/hadoop-common/src/site/markdown/SingleNodeSetup.md
          • hadoop-common-project/hadoop-common/src/site/markdown/FileSystemShell.md
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/site/apt/InterfaceClassification.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/RackAwareness.md
          • hadoop-common-project/hadoop-common/src/site/markdown/InterfaceClassification.md
          • hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
          • hadoop-common-project/hadoop-common/src/site/apt/Metrics.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/ClusterSetup.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/DeprecatedProperties.md
          • hadoop-common-project/hadoop-common/src/site/markdown/Tracing.md
          • hadoop-common-project/hadoop-common/src/site/apt/SingleCluster.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/SingleNodeSetup.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/HttpAuthentication.md
          • hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
          • hadoop-common-project/hadoop-common/src/site/apt/SecureMode.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/HttpAuthentication.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md
          • hadoop-common-project/hadoop-common/src/site/markdown/NativeLibraries.md.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/Superusers.md
          • hadoop-common-project/hadoop-common/src/site/apt/FileSystemShell.apt.vm
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #835 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/835/ ) HADOOP-11495 . Convert site documentation from apt to markdown (Masatake Iwasaki via aw) (aw: rev e9d26fe9eb16a0482d3581504ecad22b4cd65077) hadoop-common-project/hadoop-common/src/site/apt/DeprecatedProperties.apt.vm hadoop-common-project/hadoop-common/src/site/apt/RackAwareness.apt.vm hadoop-common-project/hadoop-common/src/site/apt/Superusers.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/CLIMiniCluster.md.vm hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm hadoop-common-project/hadoop-common/src/site/markdown/Compatibility.md hadoop-common-project/hadoop-common/src/site/markdown/ServiceLevelAuth.md hadoop-common-project/hadoop-common/src/site/apt/ServiceLevelAuth.apt.vm hadoop-common-project/hadoop-common/src/site/apt/CLIMiniCluster.apt.vm hadoop-common-project/hadoop-common/src/site/apt/CommandsManual.apt.vm hadoop-common-project/hadoop-common/src/site/apt/NativeLibraries.apt.vm hadoop-common-project/hadoop-common/src/site/apt/Compatibility.apt.vm hadoop-common-project/hadoop-common/src/site/apt/Tracing.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/SecureMode.md hadoop-common-project/hadoop-common/src/site/markdown/SingleNodeSetup.md hadoop-common-project/hadoop-common/src/site/markdown/FileSystemShell.md hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/site/apt/InterfaceClassification.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/RackAwareness.md hadoop-common-project/hadoop-common/src/site/markdown/InterfaceClassification.md hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md hadoop-common-project/hadoop-common/src/site/apt/Metrics.apt.vm hadoop-common-project/hadoop-common/src/site/apt/ClusterSetup.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/DeprecatedProperties.md hadoop-common-project/hadoop-common/src/site/markdown/Tracing.md hadoop-common-project/hadoop-common/src/site/apt/SingleCluster.apt.vm hadoop-common-project/hadoop-common/src/site/apt/SingleNodeSetup.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/HttpAuthentication.md hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md hadoop-common-project/hadoop-common/src/site/apt/SecureMode.apt.vm hadoop-common-project/hadoop-common/src/site/apt/HttpAuthentication.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md hadoop-common-project/hadoop-common/src/site/markdown/NativeLibraries.md.vm hadoop-common-project/hadoop-common/src/site/markdown/Superusers.md hadoop-common-project/hadoop-common/src/site/apt/FileSystemShell.apt.vm
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #101 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/101/)
          HADOOP-11495. Convert site documentation from apt to markdown (Masatake Iwasaki via aw) (aw: rev e9d26fe9eb16a0482d3581504ecad22b4cd65077)

          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/site/apt/HttpAuthentication.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/Tracing.md
          • hadoop-common-project/hadoop-common/src/site/apt/Tracing.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/Compatibility.md
          • hadoop-common-project/hadoop-common/src/site/apt/FileSystemShell.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/SecureMode.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md
          • hadoop-common-project/hadoop-common/src/site/apt/DeprecatedProperties.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/SingleCluster.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/RackAwareness.md
          • hadoop-common-project/hadoop-common/src/site/apt/CommandsManual.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/CLIMiniCluster.md.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/NativeLibraries.md.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/DeprecatedProperties.md
          • hadoop-common-project/hadoop-common/src/site/markdown/HttpAuthentication.md
          • hadoop-common-project/hadoop-common/src/site/apt/CLIMiniCluster.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/Superusers.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/NativeLibraries.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/Compatibility.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/ClusterSetup.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/RackAwareness.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/Superusers.md
          • hadoop-common-project/hadoop-common/src/site/apt/ServiceLevelAuth.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
          • hadoop-common-project/hadoop-common/src/site/apt/InterfaceClassification.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
          • hadoop-common-project/hadoop-common/src/site/markdown/SingleNodeSetup.md
          • hadoop-common-project/hadoop-common/src/site/apt/SingleNodeSetup.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/Metrics.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/FileSystemShell.md
          • hadoop-common-project/hadoop-common/src/site/markdown/SecureMode.md
          • hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/ServiceLevelAuth.md
          • hadoop-common-project/hadoop-common/src/site/markdown/InterfaceClassification.md
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #101 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/101/ ) HADOOP-11495 . Convert site documentation from apt to markdown (Masatake Iwasaki via aw) (aw: rev e9d26fe9eb16a0482d3581504ecad22b4cd65077) hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/site/apt/HttpAuthentication.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/Tracing.md hadoop-common-project/hadoop-common/src/site/apt/Tracing.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/Compatibility.md hadoop-common-project/hadoop-common/src/site/apt/FileSystemShell.apt.vm hadoop-common-project/hadoop-common/src/site/apt/SecureMode.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md hadoop-common-project/hadoop-common/src/site/apt/DeprecatedProperties.apt.vm hadoop-common-project/hadoop-common/src/site/apt/SingleCluster.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/RackAwareness.md hadoop-common-project/hadoop-common/src/site/apt/CommandsManual.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/CLIMiniCluster.md.vm hadoop-common-project/hadoop-common/src/site/markdown/NativeLibraries.md.vm hadoop-common-project/hadoop-common/src/site/markdown/DeprecatedProperties.md hadoop-common-project/hadoop-common/src/site/markdown/HttpAuthentication.md hadoop-common-project/hadoop-common/src/site/apt/CLIMiniCluster.apt.vm hadoop-common-project/hadoop-common/src/site/apt/Superusers.apt.vm hadoop-common-project/hadoop-common/src/site/apt/NativeLibraries.apt.vm hadoop-common-project/hadoop-common/src/site/apt/Compatibility.apt.vm hadoop-common-project/hadoop-common/src/site/apt/ClusterSetup.apt.vm hadoop-common-project/hadoop-common/src/site/apt/RackAwareness.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/Superusers.md hadoop-common-project/hadoop-common/src/site/apt/ServiceLevelAuth.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md hadoop-common-project/hadoop-common/src/site/apt/InterfaceClassification.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md hadoop-common-project/hadoop-common/src/site/markdown/SingleNodeSetup.md hadoop-common-project/hadoop-common/src/site/apt/SingleNodeSetup.apt.vm hadoop-common-project/hadoop-common/src/site/apt/Metrics.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/FileSystemShell.md hadoop-common-project/hadoop-common/src/site/markdown/SecureMode.md hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm hadoop-common-project/hadoop-common/src/site/markdown/ServiceLevelAuth.md hadoop-common-project/hadoop-common/src/site/markdown/InterfaceClassification.md
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #7064 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7064/)
          HADOOP-11495. Convert site documentation from apt to markdown (Masatake Iwasaki via aw) (aw: rev e9d26fe9eb16a0482d3581504ecad22b4cd65077)

          • hadoop-common-project/hadoop-common/src/site/markdown/Tracing.md
          • hadoop-common-project/hadoop-common/src/site/apt/FileSystemShell.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md
          • hadoop-common-project/hadoop-common/src/site/apt/HttpAuthentication.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/InterfaceClassification.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/NativeLibraries.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/Superusers.md
          • hadoop-common-project/hadoop-common/src/site/apt/ClusterSetup.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/ServiceLevelAuth.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/Metrics.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/Compatibility.md
          • hadoop-common-project/hadoop-common/src/site/apt/Compatibility.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/ServiceLevelAuth.md
          • hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/SecureMode.md
          • hadoop-common-project/hadoop-common/src/site/apt/SingleNodeSetup.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/CommandsManual.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/HttpAuthentication.md
          • hadoop-common-project/hadoop-common/src/site/apt/RackAwareness.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
          • hadoop-common-project/hadoop-common/src/site/markdown/FileSystemShell.md
          • hadoop-common-project/hadoop-common/src/site/markdown/InterfaceClassification.md
          • hadoop-common-project/hadoop-common/src/site/markdown/CLIMiniCluster.md.vm
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/site/apt/Tracing.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/SingleNodeSetup.md
          • hadoop-common-project/hadoop-common/src/site/apt/SingleCluster.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/RackAwareness.md
          • hadoop-common-project/hadoop-common/src/site/markdown/NativeLibraries.md.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/DeprecatedProperties.md
          • hadoop-common-project/hadoop-common/src/site/apt/DeprecatedProperties.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/CLIMiniCluster.apt.vm
          • hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
          • hadoop-common-project/hadoop-common/src/site/apt/SecureMode.apt.vm
          • hadoop-common-project/hadoop-common/src/site/apt/Superusers.apt.vm
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #7064 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7064/ ) HADOOP-11495 . Convert site documentation from apt to markdown (Masatake Iwasaki via aw) (aw: rev e9d26fe9eb16a0482d3581504ecad22b4cd65077) hadoop-common-project/hadoop-common/src/site/markdown/Tracing.md hadoop-common-project/hadoop-common/src/site/apt/FileSystemShell.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md hadoop-common-project/hadoop-common/src/site/apt/HttpAuthentication.apt.vm hadoop-common-project/hadoop-common/src/site/apt/InterfaceClassification.apt.vm hadoop-common-project/hadoop-common/src/site/apt/NativeLibraries.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/Superusers.md hadoop-common-project/hadoop-common/src/site/apt/ClusterSetup.apt.vm hadoop-common-project/hadoop-common/src/site/apt/ServiceLevelAuth.apt.vm hadoop-common-project/hadoop-common/src/site/apt/Metrics.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/Compatibility.md hadoop-common-project/hadoop-common/src/site/apt/Compatibility.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/ServiceLevelAuth.md hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm hadoop-common-project/hadoop-common/src/site/markdown/SecureMode.md hadoop-common-project/hadoop-common/src/site/apt/SingleNodeSetup.apt.vm hadoop-common-project/hadoop-common/src/site/apt/CommandsManual.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/HttpAuthentication.md hadoop-common-project/hadoop-common/src/site/apt/RackAwareness.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md hadoop-common-project/hadoop-common/src/site/markdown/FileSystemShell.md hadoop-common-project/hadoop-common/src/site/markdown/InterfaceClassification.md hadoop-common-project/hadoop-common/src/site/markdown/CLIMiniCluster.md.vm hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/site/apt/Tracing.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/SingleNodeSetup.md hadoop-common-project/hadoop-common/src/site/apt/SingleCluster.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/RackAwareness.md hadoop-common-project/hadoop-common/src/site/markdown/NativeLibraries.md.vm hadoop-common-project/hadoop-common/src/site/markdown/DeprecatedProperties.md hadoop-common-project/hadoop-common/src/site/apt/DeprecatedProperties.apt.vm hadoop-common-project/hadoop-common/src/site/apt/CLIMiniCluster.apt.vm hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md hadoop-common-project/hadoop-common/src/site/apt/SecureMode.apt.vm hadoop-common-project/hadoop-common/src/site/apt/Superusers.apt.vm
          Hide
          aw Allen Wittenauer added a comment -

          +1 committing to trunk.

          Thanks!

          Show
          aw Allen Wittenauer added a comment - +1 committing to trunk. Thanks!
          Hide
          iwasakims Masatake Iwasaki added a comment -

          I attached 05 patch fixing nits above and additional ones below.

          • escaped double dash in command opts
          • removed blank lines between items in lists
          • reflected the changes added to FileSystemShell.apt.vm after 04 was created

          I fixed only formatting part and left some dead links as is. I will fix them in follow-up jiras.

          Show
          iwasakims Masatake Iwasaki added a comment - I attached 05 patch fixing nits above and additional ones below. escaped double dash in command opts removed blank lines between items in lists reflected the changes added to FileSystemShell.apt.vm after 04 was created I fixed only formatting part and left some dead links as is. I will fix them in follow-up jiras.
          Hide
          iwasakims Masatake Iwasaki added a comment -

          I also found some dead links broken by my HADOOP-10976 patch I will fix them later after this conversion done..

          Show
          iwasakims Masatake Iwasaki added a comment - I also found some dead links broken by my HADOOP-10976 patch I will fix them later after this conversion done..
          Hide
          iwasakims Masatake Iwasaki added a comment -

          Thanks for working on this Allen Wittenauer. I build the docs with the 04 patch applied and compared them to original one side by side. It LGTM overall though I found some nits.

          • Overall: Some nested list including TOC of each page are flattened.
          • ClusterSetup.md: There are asterisks/backslashes left in URL string such as hdfs://host:port and http://nn_host:port/.
          • Compatibility.md: TOC is broken.
          • Compatibility.md: links to "MR Application Master" and "History Server" are dead.
          • FileSystemShell.md: some subcommand such as cp, df and rm are not interpreted as subsection title.
          • SingleCluser.md: subsection title such as "Setup passphraseless ssh", "Execution" and "YARN on a Single Node" are dropped.
          Show
          iwasakims Masatake Iwasaki added a comment - Thanks for working on this Allen Wittenauer . I build the docs with the 04 patch applied and compared them to original one side by side. It LGTM overall though I found some nits. Overall: Some nested list including TOC of each page are flattened. ClusterSetup.md: There are asterisks/backslashes left in URL string such as hdfs://host:port and http://nn_host:port/ . Compatibility.md: TOC is broken. Compatibility.md: links to "MR Application Master" and "History Server" are dead. FileSystemShell.md: some subcommand such as cp, df and rm are not interpreted as subsection title. SingleCluser.md: subsection title such as "Setup passphraseless ssh", "Execution" and "YARN on a Single Node" are dropped.
          Hide
          hadoopqa Hadoop QA added a comment -

          +1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12696635/HADOOP-11495-04.patch
          against trunk revision f990e9d.

          +1 @author. The patch does not contain any @author tags.

          +0 tests included. The patch appears to be a documentation patch that doesn't require tests.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-common-project/hadoop-common.

          Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/5590//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/5590//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12696635/HADOOP-11495-04.patch against trunk revision f990e9d. +1 @author . The patch does not contain any @author tags. +0 tests included . The patch appears to be a documentation patch that doesn't require tests. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-common-project/hadoop-common. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/5590//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/5590//console This message is automatically generated.
          Hide
          aw Allen Wittenauer added a comment -

          -04:

          • I dunno, a bunch of changes.
          • Manually fixed the download link
          • Manually fixed the rackawareness doc.

          I'll commit this next week.

          Show
          aw Allen Wittenauer added a comment - -04: I dunno, a bunch of changes. Manually fixed the download link Manually fixed the rackawareness doc. I'll commit this next week.
          Hide
          aw Allen Wittenauer added a comment -

          Somewhere around 60kb would be fine. A patch per-project should be fine too.

          To put this into perspective, this patch currently converts the following files:

          $ du -sh hadoop-common/src/site/apt/*
          4.0K	hadoop-common/src/site/apt/CLIMiniCluster.apt.vm
           32K	hadoop-common/src/site/apt/ClusterSetup.apt.vm
           16K	hadoop-common/src/site/apt/CommandsManual.apt.vm
           24K	hadoop-common/src/site/apt/Compatibility.apt.vm
           24K	hadoop-common/src/site/apt/DeprecatedProperties.apt.vm
           24K	hadoop-common/src/site/apt/FileSystemShell.apt.vm
          8.0K	hadoop-common/src/site/apt/HttpAuthentication.apt.vm
           12K	hadoop-common/src/site/apt/InterfaceClassification.apt.vm
           56K	hadoop-common/src/site/apt/Metrics.apt.vm
          8.0K	hadoop-common/src/site/apt/NativeLibraries.apt.vm
          8.0K	hadoop-common/src/site/apt/RackAwareness.apt.vm
           40K	hadoop-common/src/site/apt/SecureMode.apt.vm
           12K	hadoop-common/src/site/apt/ServiceLevelAuth.apt.vm
          8.0K	hadoop-common/src/site/apt/SingleCluster.apt.vm
          4.0K	hadoop-common/src/site/apt/SingleNodeSetup.apt.vm
          8.0K	hadoop-common/src/site/apt/Superusers.apt.vm
          8.0K	hadoop-common/src/site/apt/Tracing.apt.vm
          

          ... in other words, the core part of hadoop-common-project.

          60k would mean splitting this up into approx 8-9 different patches.

          Show
          aw Allen Wittenauer added a comment - Somewhere around 60kb would be fine. A patch per-project should be fine too. To put this into perspective, this patch currently converts the following files: $ du -sh hadoop-common/src/site/apt/* 4.0K hadoop-common/src/site/apt/CLIMiniCluster.apt.vm 32K hadoop-common/src/site/apt/ClusterSetup.apt.vm 16K hadoop-common/src/site/apt/CommandsManual.apt.vm 24K hadoop-common/src/site/apt/Compatibility.apt.vm 24K hadoop-common/src/site/apt/DeprecatedProperties.apt.vm 24K hadoop-common/src/site/apt/FileSystemShell.apt.vm 8.0K hadoop-common/src/site/apt/HttpAuthentication.apt.vm 12K hadoop-common/src/site/apt/InterfaceClassification.apt.vm 56K hadoop-common/src/site/apt/Metrics.apt.vm 8.0K hadoop-common/src/site/apt/NativeLibraries.apt.vm 8.0K hadoop-common/src/site/apt/RackAwareness.apt.vm 40K hadoop-common/src/site/apt/SecureMode.apt.vm 12K hadoop-common/src/site/apt/ServiceLevelAuth.apt.vm 8.0K hadoop-common/src/site/apt/SingleCluster.apt.vm 4.0K hadoop-common/src/site/apt/SingleNodeSetup.apt.vm 8.0K hadoop-common/src/site/apt/Superusers.apt.vm 8.0K hadoop-common/src/site/apt/Tracing.apt.vm ... in other words, the core part of hadoop-common-project. 60k would mean splitting this up into approx 8-9 different patches.
          Hide
          hadoopqa Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12694293/HADOOP-11495-03.patch
          against trunk revision 8f26d5a.

          +1 @author. The patch does not contain any @author tags.

          +0 tests included. The patch appears to be a documentation patch that doesn't require tests.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The following test timeouts occurred in hadoop-common-project/hadoop-common:

          org.apache.hadoop.ipc.TestIPC

          Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/5469//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/5469//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12694293/HADOOP-11495-03.patch against trunk revision 8f26d5a. +1 @author . The patch does not contain any @author tags. +0 tests included . The patch appears to be a documentation patch that doesn't require tests. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The following test timeouts occurred in hadoop-common-project/hadoop-common: org.apache.hadoop.ipc.TestIPC Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/5469//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/5469//console This message is automatically generated.
          Hide
          wheat9 Haohui Mai added a comment -

          Somewhere around 60kb would be fine. A patch per-project should be fine too. I trust your judgement to not overloading reviewers

          Show
          wheat9 Haohui Mai added a comment - Somewhere around 60kb would be fine. A patch per-project should be fine too. I trust your judgement to not overloading reviewers
          Hide
          aw Allen Wittenauer added a comment -

          I would like to help once the patches have stabilized enough and been separated into smaller patches.

          What size would you prefer? If we do one per document, there are going to be literally hundreds of JIRAs.

          Show
          aw Allen Wittenauer added a comment - I would like to help once the patches have stabilized enough and been separated into smaller patches. What size would you prefer? If we do one per document, there are going to be literally hundreds of JIRAs.
          Hide
          wheat9 Haohui Mai added a comment -

          Is anyone bothering to read these?

          I would like to help once the patches have stabilized enough and been separated into smaller patches.

          Show
          wheat9 Haohui Mai added a comment - Is anyone bothering to read these? I would like to help once the patches have stabilized enough and been separated into smaller patches.
          Hide
          aw Allen Wittenauer added a comment -

          -03:

          • Rebased on latest trunk
          • TIL: maven's markdown process can't handle nested tables very well. In order to fix this, we have to break the indenting on the tables, which in turn breaks the bullet point generation on the better markdown processors.
          • Not all of the velocity macros are supported, so removed the broken ones.
          • Is anyone bothering to read these?
          • Fixed a few minor stylistic issues here and there.
          • Removed the markdown meta data
          • Files without any velocity macros are named .md so they render on github
          Show
          aw Allen Wittenauer added a comment - -03: Rebased on latest trunk TIL: maven's markdown process can't handle nested tables very well. In order to fix this, we have to break the indenting on the tables, which in turn breaks the bullet point generation on the better markdown processors. Not all of the velocity macros are supported, so removed the broken ones. Is anyone bothering to read these? Fixed a few minor stylistic issues here and there. Removed the markdown meta data Files without any velocity macros are named .md so they render on github
          Hide
          hadoopqa Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12693990/HADOOP-11495-02.patch
          against trunk revision 825923f.

          +1 @author. The patch does not contain any @author tags.

          +0 tests included. The patch appears to be a documentation patch that doesn't require tests.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The patch failed these unit tests in hadoop-common-project/hadoop-common:

          org.apache.hadoop.ha.TestZKFailoverController

          The following test timeouts occurred in hadoop-common-project/hadoop-common:

          org.apache.hadoop.ha.TestZKFailoverControllerStress

          Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/5460//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/5460//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12693990/HADOOP-11495-02.patch against trunk revision 825923f. +1 @author . The patch does not contain any @author tags. +0 tests included . The patch appears to be a documentation patch that doesn't require tests. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-common-project/hadoop-common: org.apache.hadoop.ha.TestZKFailoverController The following test timeouts occurred in hadoop-common-project/hadoop-common: org.apache.hadoop.ha.TestZKFailoverControllerStress Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/5460//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/5460//console This message is automatically generated.
          Hide
          aw Allen Wittenauer added a comment -

          -02:

          • Fixed the naming of the patch.
          • Implemented the maven velocity bits and multimarkdown metadata so that TOCs, timestamps, etc are there now (at the cost of github rendering!!!)
          Show
          aw Allen Wittenauer added a comment - -02: Fixed the naming of the patch. Implemented the maven velocity bits and multimarkdown metadata so that TOCs, timestamps, etc are there now (at the cost of github rendering!!!)
          Hide
          aw Allen Wittenauer added a comment -

          Here is something to consider:

          Anything that uses the Velocity engine to render maven specific bits (such as $

          {project.version}

          ) will need to be named .md.vm. This means they won't render on github.

          Option 1: Strip as much of the maven build stuff out so that we get github rendering on those pages that don't absolutely need those vars. For the ones that do need them (e.g., anything referencing the mapreduce examples jar), only keep them named .md.vm

          Option 2: Name everything .md.vm and therefore have zero rendering on github?

          Show
          aw Allen Wittenauer added a comment - Here is something to consider: Anything that uses the Velocity engine to render maven specific bits (such as $ {project.version} ) will need to be named .md.vm. This means they won't render on github. Option 1: Strip as much of the maven build stuff out so that we get github rendering on those pages that don't absolutely need those vars. For the ones that do need them (e.g., anything referencing the mapreduce examples jar), only keep them named .md.vm Option 2: Name everything .md.vm and therefore have zero rendering on github?
          Hide
          aw Allen Wittenauer added a comment -

          Awesome! Thanks Akira Ajisaka! That's a great idea. I might push a post-md conversion to github as well so folks can do a side-by-side.

          Show
          aw Allen Wittenauer added a comment - Awesome! Thanks Akira Ajisaka ! That's a great idea. I might push a post-md conversion to github as well so folks can do a side-by-side.
          Hide
          ajisakaa Akira Ajisaka added a comment -

          +1 on the idea.

          This is made worse by the fact that we don't publish trunk docs anywhere, so one needs to generate both sets of docs.

          Published trunk docs at http://aajisaka.github.io/hadoop-project/ . If you need to update this, please ping me.

          Show
          ajisakaa Akira Ajisaka added a comment - +1 on the idea. This is made worse by the fact that we don't publish trunk docs anywhere, so one needs to generate both sets of docs. Published trunk docs at http://aajisaka.github.io/hadoop-project/ . If you need to update this, please ping me.
          Hide
          aw Allen Wittenauer added a comment -

          Linking HADOOP-8427, which was the JIRA that tracked the forrest to apt conversion.

          Show
          aw Allen Wittenauer added a comment - Linking HADOOP-8427 , which was the JIRA that tracked the forrest to apt conversion.
          Hide
          aw Allen Wittenauer added a comment -

          +1 on the idea, it might make sense to separate the patch to facilitate the reviews.

          I was planning on breaking this up into 6:

          • hadoop-common (core)
          • hadoop-tools
          • hadoop-yarn
          • hadoop-hdfs
          • hadoop-mapreduce
          • any stragglers

          I'm concerned that if this is broken up any more, then they won't get reviewed. Smaller patches get almost zero traction.

          Show
          aw Allen Wittenauer added a comment - +1 on the idea, it might make sense to separate the patch to facilitate the reviews. I was planning on breaking this up into 6: hadoop-common (core) hadoop-tools hadoop-yarn hadoop-hdfs hadoop-mapreduce any stragglers I'm concerned that if this is broken up any more, then they won't get reviewed. Smaller patches get almost zero traction.
          Hide
          wheat9 Haohui Mai added a comment -

          +1 on the idea, it might make sense to separate the patch to facilitate the reviews.

          Show
          wheat9 Haohui Mai added a comment - +1 on the idea, it might make sense to separate the patch to facilitate the reviews.
          Hide
          aw Allen Wittenauer added a comment -

          How to review the patches? Any idea other then manually comparing the generated docs?

          This is pretty much an exercise in formatting, so that's pretty much what I've been doing. This is made worse by the fact that we don't publish trunk docs anywhere, so one needs to generate both sets of docs.

          Show
          aw Allen Wittenauer added a comment - How to review the patches? Any idea other then manually comparing the generated docs? This is pretty much an exercise in formatting, so that's pretty much what I've been doing. This is made worse by the fact that we don't publish trunk docs anywhere, so one needs to generate both sets of docs.
          Hide
          szetszwo Tsz Wo Nicholas Sze added a comment -

          How to review the patches? Any idea other then manually comparing the generated docs?

          Show
          szetszwo Tsz Wo Nicholas Sze added a comment - How to review the patches? Any idea other then manually comparing the generated docs?
          Hide
          aw Allen Wittenauer added a comment -

          Argh. I keep uploading these as the wrong patch number. :/

          Show
          aw Allen Wittenauer added a comment - Argh. I keep uploading these as the wrong patch number. :/
          Hide
          aw Allen Wittenauer added a comment -

          -01:

          • rebased for latest trunk
          • still automated
          • fixed the broken tables
          • changed the encoding for lists
          • fixed lists of tables (I think)

          Known issues:

          • bullet point for Download in ClusterSetup.md
          • diagrams in rack awareness are a mess

          The above issues I'll fix manually when we feel this is ready to go.

          Show
          aw Allen Wittenauer added a comment - -01: rebased for latest trunk still automated fixed the broken tables changed the encoding for lists fixed lists of tables (I think) Known issues: bullet point for Download in ClusterSetup.md diagrams in rack awareness are a mess The above issues I'll fix manually when we feel this is ready to go.
          Hide
          aw Allen Wittenauer added a comment -

          One thing before applying it though: get pending doc patches in first.

          Just did a quick pass through doc + patch avail for HADOOP. Only one that is particularly interesting/outstanding is HADOOP-11008. The rest are for outside what I'm currently targetting with this change.

          Show
          aw Allen Wittenauer added a comment - One thing before applying it though: get pending doc patches in first. Just did a quick pass through doc + patch avail for HADOOP. Only one that is particularly interesting/outstanding is HADOOP-11008 . The rest are for outside what I'm currently targetting with this change.
          Hide
          stevel@apache.org Steve Loughran added a comment -

          APT was adopted, as recall, as it was what maven gave you. It wasn't that anyone chose it deliberately: it was what there was.

          Forrest, which renders very well into multiple formats, is superior to markdown & APT for outputting to, say, PDF, but it's been an under-staffed OSS project for a long time now, and while we use it for some of our site, that's it.

          What does MD bring to the table?

          1. IDE support
          2. editors like Mou —this can render the content alongside the markdown
          3. tools to export MD from google docs &c
          4. Automatic rendering on github simply by pushing the artifacts. This is great when developing your own branch on github: push and you can share the text, yet it also works for ASF content that is mirrored

          Best of all: anyone who knows markdown can edit the documents. We'll be (hopefully) opening up editing to more people, hence (again, hopefully) improving the quality of the docs.

          Regarding all-or-nothing, you don't have to migrate 100% of the site in one go. Sub-project-by-sub-project will work well.

          One thing before applying it though: get pending doc patches in first.

          Show
          stevel@apache.org Steve Loughran added a comment - APT was adopted, as recall, as it was what maven gave you. It wasn't that anyone chose it deliberately: it was what there was. Forrest, which renders very well into multiple formats, is superior to markdown & APT for outputting to, say, PDF, but it's been an under-staffed OSS project for a long time now, and while we use it for some of our site, that's it. What does MD bring to the table? IDE support editors like Mou —this can render the content alongside the markdown tools to export MD from google docs &c Automatic rendering on github simply by pushing the artifacts. This is great when developing your own branch on github: push and you can share the text, yet it also works for ASF content that is mirrored Best of all: anyone who knows markdown can edit the documents. We'll be (hopefully) opening up editing to more people, hence (again, hopefully) improving the quality of the docs. Regarding all-or-nothing, you don't have to migrate 100% of the site in one go. Sub-project-by-sub-project will work well. One thing before applying it though: get pending doc patches in first.
          Hide
          aw Allen Wittenauer added a comment -

          FWIW, I'm using the same method you did in TEZ-1310, except I opted to go to docbook instead of latex. The rest I'm cleaning up with perl. I've got a newer changeset that fixes a lot of the table problems, but I'll wait to post that later. I've been saving the intermediate bits to https://github.com/aw-altiscale/apt-to-markdown-test if someone wants to see what they would look like on github.

          Show
          aw Allen Wittenauer added a comment - FWIW, I'm using the same method you did in TEZ-1310 , except I opted to go to docbook instead of latex. The rest I'm cleaning up with perl. I've got a newer changeset that fixes a lot of the table problems, but I'll wait to post that later. I've been saving the intermediate bits to https://github.com/aw-altiscale/apt-to-markdown-test if someone wants to see what they would look like on github.
          Hide
          jeagles Jonathan Eagles added a comment -

          I helped with the markdown conversion of Tez as part of TEZ-1310. While there are many extensions to markdown as a whole, maven's doxia plugin uses the http://pegdown.org implementation which is helpful as a reference. This will allow you to understand what extensions are available and enable points to discuss in specifics with regard to this conversion.

          Show
          jeagles Jonathan Eagles added a comment - I helped with the markdown conversion of Tez as part of TEZ-1310 . While there are many extensions to markdown as a whole, maven's doxia plugin uses the http://pegdown.org implementation which is helpful as a reference. This will allow you to understand what extensions are available and enable points to discuss in specifics with regard to this conversion.
          Hide
          aw Allen Wittenauer added a comment -

          Are we at all worried about the lack of standardization in Markdown?

          I actually did some looking into this since we're sort of beholden to Maven.

          • We're not actually using that many fancy things. The biggest problems are table of contents and tables. Lists (numbered or otherwise) are surprisingly rare vs tables.
          • Maven's markdown support is pretty much the same as github's markdown support as far as extensions are concerned.

          It's probably worth pointing out that we've already got some markdown in the tree.

          it is preferable to change all sub-projects in the same release.

          I was planning on doing them all, depending upon how this JIRA goes. Additionally, we're not in a "do or die" situation like we were with forrest, so we can do this more piecemeal, hopefully spreading the proofreading load around a bit. In turn, this will hopefully prevent the problems that the forrest -> apt conversion hit (such as the complete mess that ClusterSetup ended up.. and still is in branch-2. I've since fixed it in trunk).

          Show
          aw Allen Wittenauer added a comment - Are we at all worried about the lack of standardization in Markdown? I actually did some looking into this since we're sort of beholden to Maven. We're not actually using that many fancy things. The biggest problems are table of contents and tables. Lists (numbered or otherwise) are surprisingly rare vs tables. Maven's markdown support is pretty much the same as github's markdown support as far as extensions are concerned. It's probably worth pointing out that we've already got some markdown in the tree. it is preferable to change all sub-projects in the same release. I was planning on doing them all, depending upon how this JIRA goes. Additionally, we're not in a "do or die" situation like we were with forrest, so we can do this more piecemeal, hopefully spreading the proofreading load around a bit. In turn, this will hopefully prevent the problems that the forrest -> apt conversion hit (such as the complete mess that ClusterSetup ended up.. and still is in branch-2. I've since fixed it in trunk).
          Hide
          kasha Karthik Kambatla added a comment -

          I don't know much about winning and losing, but I like that markdown reads well on github and developers could benefit from reading the latest (trunk/branch-2) documentation in a browser.

          That said, it would be nice for someone involved in earlier discussions around APT to weigh in. And, it is preferable to change all sub-projects in the same release.

          Show
          kasha Karthik Kambatla added a comment - I don't know much about winning and losing, but I like that markdown reads well on github and developers could benefit from reading the latest (trunk/branch-2) documentation in a browser. That said, it would be nice for someone involved in earlier discussions around APT to weigh in. And, it is preferable to change all sub-projects in the same release.
          Hide
          andrew.wang Andrew Wang added a comment -

          Are we at all worried about the lack of standardization in Markdown? Github has its own custom markdown format, which is one example of the potential incompatibilities. Atwood's blog post about CommonMark also outlines some of the problems.

          I hate to bikeshed this, but have we considered anything else? reStructuredText seems like the leading alternative, but I don't have much experience with it. Or maybe we think CommonMark is the One True Implementation.

          Show
          andrew.wang Andrew Wang added a comment - Are we at all worried about the lack of standardization in Markdown? Github has its own custom markdown format, which is one example of the potential incompatibilities. Atwood's blog post about CommonMark also outlines some of the problems. I hate to bikeshed this, but have we considered anything else? reStructuredText seems like the leading alternative, but I don't have much experience with it. Or maybe we think CommonMark is the One True Implementation.
          Hide
          aw Allen Wittenauer added a comment -

          -00:

          • this is a first, mostly automated pass at converting
          Show
          aw Allen Wittenauer added a comment - -00: this is a first, mostly automated pass at converting

            People

            • Assignee:
              iwasakims Masatake Iwasaki
              Reporter:
              aw Allen Wittenauer
            • Votes:
              0 Vote for this issue
              Watchers:
              17 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development