Hadoop Common
  1. Hadoop Common
  2. HADOOP-6328

Hadoop 0.20 Docs - backport changes for streaming and m/r tutorial docs

    Details

    • Type: Task Task
    • Status: Resolved
    • Priority: Blocker Blocker
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: 0.20.2
    • Component/s: documentation
    • Labels:
      None

      Description

      Doc changes added to the Hadoop/mapreduce/trunk (for Hadoop 0.21 release) need to be backported to Hadoop-0.20 branch (for Hadoop 0.20.2 release).

      Doc files affected:
      > streaming.xml
      > mapred_tutorial.xml

      Changes include:
      1. During the execution of a streaming job, the names of the "mapred" parameters are transformed. The dots ( . ) become underscores ( _ ). – (affects streaming doc and m/r tutorial doc)

      2. For -files and -archives options, Hadoop now creates symlink with same name as file (user-defined symlinks, #mysymlink, currently not supported) – (affects streaming doc)

      3. Streaming supports streaming command options and generic command options. Generic options must be placed before streaming options, otherwise command fails. – (affects streaming doc)

      1. mapred.patch
        54 kB
        Corinne Chandel
      2. mapred_tutorial.pdf
        162 kB
        Corinne Chandel
      3. mapred_tutorial.pdf
        162 kB
        Corinne Chandel
      4. streaming.patch
        61 kB
        Corinne Chandel
      5. hadoop-6328-2.patch
        115 kB
        Corinne Chandel
      6. hadoop-6328.patch
        115 kB
        Corinne Chandel

        Activity

        Hide
        Corinne Chandel added a comment -
        Show
        Corinne Chandel added a comment - Patch file Apply to this branch: http://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20
        Hide
        Corinne Chandel added a comment -


        Note: No new test code required; changes to documentation only.

        Show
        Corinne Chandel added a comment - Note: No new test code required; changes to documentation only.
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12422915/hadoop-6328.patch
        against trunk revision 828181.

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 6 new or modified tests.

        -1 patch. The patch command could not apply the patch.

        Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-h4.grid.sp2.yahoo.net/101/console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12422915/hadoop-6328.patch against trunk revision 828181. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 6 new or modified tests. -1 patch. The patch command could not apply the patch. Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-h4.grid.sp2.yahoo.net/101/console This message is automatically generated.
        Hide
        Tom White added a comment -

        Patch no longer applies.

        Show
        Tom White added a comment - Patch no longer applies.
        Hide
        Corinne Chandel added a comment -

        Re-created the patch. Please try again.

        Show
        Corinne Chandel added a comment - Re-created the patch. Please try again.
        Hide
        Amareshwari Sriramadasu added a comment -

        Corinne, In the generated patch, the complete streaming.xml file is deleted and added again (May be the patch generation was wrong), we might not want to do that. Can you regenerate the patch? Thanks

        Show
        Amareshwari Sriramadasu added a comment - Corinne, In the generated patch, the complete streaming.xml file is deleted and added again (May be the patch generation was wrong), we might not want to do that. Can you regenerate the patch? Thanks
        Hide
        Corinne Chandel added a comment -

        Streaming patch

        Show
        Corinne Chandel added a comment - Streaming patch
        Hide
        Corinne Chandel added a comment -

        MapReduce tutorial patch

        Show
        Corinne Chandel added a comment - MapReduce tutorial patch
        Hide
        Corinne Chandel added a comment -

        MapReduce Tutorial PDF

        Show
        Corinne Chandel added a comment - MapReduce Tutorial PDF
        Hide
        Corinne Chandel added a comment -

        MapReduce Tutorial patch

        Show
        Corinne Chandel added a comment - MapReduce Tutorial patch
        Hide
        Corinne Chandel added a comment -

        I have attached new (separate) patches for the Streaming doc and M/R Tutorial doc.
        I have attached Streaming and M/R Tutorial PDF files which show the changes.
        Please note - the Streaming doc was completely reorganized and edited - all sections were changed.

        Thanks/C

        Show
        Corinne Chandel added a comment - I have attached new (separate) patches for the Streaming doc and M/R Tutorial doc. I have attached Streaming and M/R Tutorial PDF files which show the changes. Please note - the Streaming doc was completely reorganized and edited - all sections were changed. Thanks/C

          People

          • Assignee:
            Corinne Chandel
            Reporter:
            Corinne Chandel
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development