Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-2915

mapred output files and directories should be created as the job submitter, not tasktracker or jobtracker

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.16.0
    • 0.16.1
    • None
    • None

    Description

      Quoted from an email sending to core-dev by Andy Li:

      For example, assuming I have installed Hadoop with an account 'hadoop' and I am going to run my program with user account 'test'. I have created an input folder as /user/test/input/ with user 'test' and the permission is set to 0775.
      /user/test/input <dir> 2008-02-27 01:20 rwxr-xr-x test hadoop

      When I run the MapReduce code, the output I specified will be set to user 'hadoop' instead of 'test'.
      /bin/hadoop jar /tmp/test_perm.jar -m 57 -r 3 "/user/test/input/l" "/user/test/output/"

      The directory "/user/test/output/" will have the following permission and user:group.
      /user/test/output <dir> 2008-02-27 03:53 rwxr-xr-x hadoop hadoop

      Attachments

        1. 2915_20080229.patch
          9 kB
          Tsz-wo Sze
        2. 2915_20080302.patch
          11 kB
          Tsz-wo Sze
        3. 2915_20080303.patch
          11 kB
          Tsz-wo Sze
        4. 2915_20080305d.patch
          15 kB
          Tsz-wo Sze
        5. 2915_20080306c.patch
          35 kB
          Tsz-wo Sze
        6. 2915_20080307.patch
          35 kB
          Tsz-wo Sze
        7. 2915_20080307b_16.patch
          43 kB
          Tsz-wo Sze
        8. 2915_20080307b.patch
          44 kB
          Tsz-wo Sze
        9. 2915_20080307c_16.patch
          42 kB
          Tsz-wo Sze
        10. 2915_20080307c.patch
          42 kB
          Tsz-wo Sze

        Issue Links

          Activity

            People

              szetszwo Tsz-wo Sze
              szetszwo Tsz-wo Sze
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: