Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-9652

Allow RawLocalFs#getFileLinkStatus to fill in the link owner and mode if requested

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.3.0
    • None
    • None
    • Reviewed

    Description

      RawLocalFs#getFileLinkStatus does not actually get the owner and mode of the symlink, but instead uses the owner and mode of the symlink target. If the target can't be found, it fills in bogus values (the empty string and FsPermission.getDefault) for these.

      Symlinks have an owner distinct from the owner of the target they point to, and getFileLinkStatus ought to expose this.

      In some operating systems, symlinks can have a permission other than 0777. We ought to expose this in RawLocalFilesystem and other places, although we don't necessarily have to support this behavior in HDFS.

      Attachments

        1. hadoop-9652-workaround.patch
          2 kB
          Andrew Wang
        2. hadoop-9652-6.patch
          33 kB
          Andrew Wang
        3. hadoop-9652-5.patch
          33 kB
          Andrew Wang
        4. hadoop-9652-4.patch
          33 kB
          Andrew Wang
        5. hadoop-9652-3.patch
          27 kB
          Andrew Wang
        6. hadoop-9652-2.patch
          27 kB
          Andrew Wang
        7. hadoop-9452-1.patch
          29 kB
          Andrew Wang
        8. 0001-temporarily-disable-HADOOP-9652.patch
          1 kB
          Colin McCabe

        Issue Links

          breaks

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-5584 ShuffleHandler becomes unresponsive during gridmix runs and can leak file descriptors

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-9782 Datanode daemon cannot be started on OS X

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-9981 globStatus should minimize its listStatus and getFileStatus calls

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          incorporates

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-9693 Shell should add a probe for OSX

          • Trivial - Cosmetic problem like misspelt words or misaligned text.
          • Closed
          is cloned by

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-10276 RawLocalFs#getFileLinkStatus does not fill in the link owner and mode by default

          • Major - Major loss of function.
          • Open
          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-9783 Fix OS detection for RawLocalFileSystem#getFileLinkStatus fallback path

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-9788 Add sticky bit support to org.apache.hadoop.fs.Stat

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-5430 TestMRApps#testSetClasspathWithArchives is failing

          • Major - Major loss of function.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue HADOOP-9371 Define Semantics of FileSystem more rigorously

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-9788 Add sticky bit support to org.apache.hadoop.fs.Stat

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-9769 Remove org.apache.hadoop.fs.Stat when JDK6 support is dropped

          • Major - Major loss of function.
          • Patch Available
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-9783 Fix OS detection for RawLocalFileSystem#getFileLinkStatus fallback path

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-8040 Add symlink support to FileSystem

          • Major - Major loss of function.
          • Closed

          Activity

            People

              andrew.wang Andrew Wang
              cmccabe Colin McCabe
              Votes:
              0 Vote for this issue
              Watchers:
              17 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: