Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-8694

Create true symbolic links on Windows

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1-win
    • 1-win
    • None
    • None
    • Reviewed

    Description

      In branch-1-win, we currently copy files for symbolic links in Hadoop on Windows. We have talked to davidlao who made the original fix, and did some investigation on Windows. Windows began to support symbolic links (symlinks) since Vista/Server 2008. The original reason to copy files instead of creating actual symlinks is that only Administrators has the privilege to create symlinks on Windows by default. After talking to NTFS folks, we knew the reason for that is mostly due to security, and this default behavior may not be changed in near future. Though this behavior can be changed via the Local Security Policy management console, i.e. secpol.msc, under Security Settings\Local Policies\User Rights Assignment\Create symbolic links.

      In Hadoop, symlinks is mostly used to for DistributedCache and attempted logs. We felt the usages are important enough for us to provide true symlinks support, and users need to have the symlink creation privilege enabled on Windows to use Hadoop.

      This JIRA is created to tracking symlink support on Windows.

      Attachments

        1. HADOOP-8694-branch-1-win.patch
          31 kB
          Chuan Liu
        2. HADOOP-8694-branch-1-win-2.patch
          40 kB
          Chuan Liu
        3. secpol.png
          57 kB
          Chuan Liu

        Issue Links

          Activity

            People

              chuanliu Chuan Liu
              chuanliu Chuan Liu
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: