Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-245

Create symbolic links in HDFS

        Details

        • Type: New Feature New Feature
        • Status: Closed
        • Priority: Major Major
        • Resolution: Fixed
        • Affects Version/s: None
        • Fix Version/s: 0.21.0
        • Component/s: None
        • Labels:
          None
        • Hadoop Flags:
          Reviewed
        • Release Note:
          Hide
          HDFS-245. Adds a symlink implementation to HDFS. This complements the new symlink feature added in HADOOP-6421
          Show
          HDFS-245 . Adds a symlink implementation to HDFS. This complements the new symlink feature added in HADOOP-6421

          Description

          HDFS should support symbolic links. A symbolic link is a special type of file that contains a reference to another file or directory in the form of an absolute or relative path and that affects pathname resolution. Programs which read or write to files named by a symbolic link will behave as if operating directly on the target file. However, archiving utilities can handle symbolic links specially and manipulate them directly.

          1. Text File
            symLink1.patch
            5 kB
            dhruba borthakur
          2. Text File
            symLink1.patch
            44 kB
            dhruba borthakur
          3. Text File
            symLink4.patch
            157 kB
            dhruba borthakur
          4. Text File
            symLink5.patch
            162 kB
            dhruba borthakur
          5. Text File
            symLink6.patch
            158 kB
            dhruba borthakur
          6. Text File
            symLink8.patch
            155 kB
            dhruba borthakur
          7. Text File
            symLink9.patch
            161 kB
            dhruba borthakur
          8. Text File
            HADOOP-4044-strawman.patch
            4 kB
            Doug Cutting
          9. Text File
            symLink11.patch
            185 kB
            dhruba borthakur
          10. Java Source File
            4044_20081030spi.java
            6 kB
            Tsz Wo Nicholas Sze
          11. Text File
            symLink12.patch
            199 kB
            dhruba borthakur
          12. Text File
            symLink13.patch
            200 kB
            dhruba borthakur
          13. Text File
            symLink14.patch
            200 kB
            dhruba borthakur
          14. Text File
            symLink15.txt
            213 kB
            dhruba borthakur
          15. Text File
            symLink15.txt
            213 kB
            dhruba borthakur
          16. Text File
            symlink-0.20.0.patch
            155 kB
            weimin zhu
          17. Text File
            symlink16-common.patch
            110 kB
            Eli Collins
          18. Text File
            symlink16-hdfs.patch
            138 kB
            Eli Collins
          19. Text File
            symlink16-mr.patch
            12 kB
            Eli Collins
          20. Text File
            designdocv1.txt
            7 kB
            Eli Collins
          21. Text File
            symlink17-common.txt
            47 kB
            dhruba borthakur
          22. Text File
            symlink17-hdfs.txt
            71 kB
            dhruba borthakur
          23. Text File
            symlink18-common.txt
            24 kB
            dhruba borthakur
          24. Text File
            symlink19-common.txt
            24 kB
            dhruba borthakur
          25. Text File
            symlink19-common.txt
            25 kB
            dhruba borthakur
          26. Text File
            symlink19-hdfs.txt
            66 kB
            dhruba borthakur
          27. Text File
            designdocv2.txt
            12 kB
            Eli Collins
          28. Text File
            symlink19-common-delta.patch
            6 kB
            Eli Collins
          29. Text File
            symlink19-hdfs-delta.patch
            45 kB
            Eli Collins
          30. Text File
            symlink20-hdfs.patch
            96 kB
            Eli Collins
          31. Text File
            symlink20-common.patch
            31 kB
            Eli Collins
          32. Text File
            symlink21-common.patch
            31 kB
            Eli Collins
          33. Text File
            symlink21-hdfs.patch
            96 kB
            Eli Collins
          34. Text File
            symlink22-common.patch
            31 kB
            Eli Collins
          35. Text File
            symlink22-hdfs.patch
            100 kB
            Eli Collins
          36. Text File
            symlink23-hdfs.patch
            101 kB
            Eli Collins
          37. Text File
            symlink23-common.patch
            34 kB
            Eli Collins
          38. Text File
            symlink24-hdfs.patch
            103 kB
            Eli Collins
          39. Text File
            symlink-25-hdfs.patch
            107 kB
            Eli Collins
          40. Text File
            symlink-26-hdfs.patch
            107 kB
            Eli Collins
          41. Text File
            symlink-26-hdfs.patch
            108 kB
            Eli Collins
          42. Text File
            symlink27-hdfs.patch
            113 kB
            Eli Collins
          43. Text File
            designdocv3.txt
            13 kB
            Eli Collins
          44. Text File
            symlink28-hdfs.patch
            117 kB
            Eli Collins
          45. Text File
            symlink29-hdfs.patch
            117 kB
            Eli Collins
          46. Text File
            symlink29-hdfs.patch
            117 kB
            Eli Collins
          47. Text File
            symlink30-hdfs.patch
            117 kB
            Eli Collins
          48. Text File
            symlink31-hdfs.patch
            97 kB
            Eli Collins
          49. Text File
            symlink33-hdfs.patch
            268 kB
            Eli Collins
          50. Text File
            symlink35-hdfs.patch
            176 kB
            Eli Collins
          51. Text File
            symlink36-hdfs.patch
            178 kB
            Eli Collins
          52. Text File
            symlink37-hdfs.patch
            178 kB
            Eli Collins
          53. Text File
            design-doc-v4.txt
            9 kB
            Eli Collins
          54. Text File
            symlink38-hdfs.patch
            181 kB
            Eli Collins
          55. Text File
            symlink39-hdfs.patch
            181 kB
            Eli Collins
          56. Text File
            symlink40-hdfs.patch
            180 kB
            Eli Collins
          57. Text File
            symlink41-hdfs.patch
            182 kB
            Eli Collins

            Issue Links

            depends upon

            New Feature - A new feature of the product, which has yet to be developed. HADOOP-6421 Symbolic links

            • Major - Major loss of function.
            • Resolved
            is depended upon by

            New Feature - A new feature of the product, which has yet to be developed. HDFS-468 libhdfs should expose symlink dfs API

            • Major - Major loss of function.
            • Open

            New Feature - A new feature of the product, which has yet to be developed. HDFS-220 Transparent archival and restore of files from HDFS

            • Major - Major loss of function.
            • Resolved

            Improvement - An improvement or enhancement to an existing feature or task. HDFS-427 fuse-dfs should support symlinks

            • Major - Major loss of function.
            • Open

            Improvement - An improvement or enhancement to an existing feature or task. HDFS-932 Resolve NN symlinks internally

            • Major - Major loss of function.
            • Open
            is related to

            New Feature - A new feature of the product, which has yet to be developed. HADOOP-6421 Symbolic links

            • Major - Major loss of function.
            • Resolved

            Improvement - An improvement or enhancement to an existing feature or task. HDFS-2246 Shortcut a local client reads to a Datanodes files directly

            • Major - Major loss of function.
            • Closed
            There are no Sub-Tasks for this issue.

              Activity

              Ascending order - Click to sort in descending order
              dhruba borthakur created issue -
              dhruba borthakur made changes -
              Field Original Value New Value
              Link This issue blocks HADOOP-4058 [ HADOOP-4058 ]
              dhruba borthakur made changes -
              Attachment symLink1.patch [ 12389629 ]
              Pete Wyckoff made changes -
              Link This issue blocks HADOOP-4107 [ HADOOP-4107 ]
              Pete Wyckoff made changes -
              Link This issue blocks HADOOP-4118 [ HADOOP-4118 ]
              Pete Wyckoff made changes -
              Link This issue blocks HADOOP-4107 [ HADOOP-4107 ]
              Pete Wyckoff made changes -
              Link This issue blocks HADOOP-4107 [ HADOOP-4107 ]
              dhruba borthakur made changes -
              Attachment symLink1.patch [ 12389910 ]
              dhruba borthakur made changes -
              Attachment symLink4.patch [ 12390503 ]
              dhruba borthakur made changes -
              Attachment symLink5.patch [ 12390559 ]
              dhruba borthakur made changes -
              Attachment symLink6.patch [ 12390999 ]
              dhruba borthakur made changes -
              Attachment symLink8.patch [ 12391178 ]
              dhruba borthakur made changes -
              Attachment symLink9.patch [ 12391447 ]
              Doug Cutting made changes -
              Attachment HADOOP-4044-strawman.patch [ 12391902 ]
              dhruba borthakur made changes -
              Attachment symLink11.patch [ 12392811 ]
              Tsz Wo Nicholas Sze made changes -
              Attachment 4044_20081030spi.java [ 12393084 ]
              dhruba borthakur made changes -
              Attachment symLink12.patch [ 12393857 ]
              dhruba borthakur made changes -
              Status Open [ 1 ] Patch Available [ 10002 ]
              dhruba borthakur made changes -
              Status Patch Available [ 10002 ] Open [ 1 ]
              dhruba borthakur made changes -
              Attachment symLink13.patch [ 12394050 ]
              dhruba borthakur made changes -
              Status Open [ 1 ] Patch Available [ 10002 ]
              Fix Version/s 0.20.0 [ 12313438 ]
              dhruba borthakur made changes -
              Status Patch Available [ 10002 ] Open [ 1 ]
              dhruba borthakur made changes -
              Attachment symLink14.patch [ 12394274 ]
              Nigel Daley made changes -
              Fix Version/s 0.20.0 [ 12313438 ]
              dhruba borthakur made changes -
              Link This issue is blocked by HADOOP-5986 [ HADOOP-5986 ]
              dhruba borthakur made changes -
              Link This issue is blocked by HADOOP-5987 [ HADOOP-5987 ]
              dhruba borthakur made changes -
              Attachment symLink15.txt [ 12410693 ]
              dhruba borthakur made changes -
              Attachment symLink15.txt [ 12410764 ]
              Owen O'Malley made changes -
              Project Hadoop Common [ 12310240 ] HDFS [ 12310942 ]
              Key HADOOP-4044 HDFS-245
              Component/s dfs [ 12310710 ]
              weimin zhu made changes -
              Attachment symlink-0.20.0.patch [ 12419498 ]
              Eli Collins made changes -
              Assignee dhruba borthakur [ dhruba ] Eli Collins [ eli ]
              Eli Collins made changes -
              Attachment symlink16-common.patch [ 12420243 ]
              Attachment symlink16-hdfs.patch [ 12420244 ]
              Attachment symlink16-mr.patch [ 12420245 ]
              Eli Collins made changes -
              Assignee Eli Collins [ eli ] dhruba borthakur [ dhruba ]
              Eli Collins made changes -
              Attachment designdocv1.txt [ 12420350 ]
              dhruba borthakur made changes -
              Attachment symlink17-common.txt [ 12420444 ]
              Attachment symlink17-hdfs.txt [ 12420445 ]
              dhruba borthakur made changes -
              Attachment symlink18-common.txt [ 12420689 ]
              dhruba borthakur made changes -
              Attachment symlink19-common.txt [ 12420743 ]
              dhruba borthakur made changes -
              Attachment symlink19-common.txt [ 12420772 ]
              Attachment symlink19-hdfs.txt [ 12420773 ]
              Eli Collins made changes -
              Attachment designdocv2.txt [ 12422293 ]
              Eli Collins made changes -
              Attachment symlink19-common-delta.patch [ 12422294 ]
              Attachment symlink19-hdfs-delta.patch [ 12422295 ]
              Eli Collins made changes -
              Attachment symlink20-hdfs.patch [ 12423412 ]
              Attachment symlink20-common.patch [ 12423413 ]
              Eli Collins made changes -
              Attachment symlink21-common.patch [ 12424103 ]
              Attachment symlink21-hdfs.patch [ 12424104 ]
              Eli Collins made changes -
              Attachment symlink22-common.patch [ 12424329 ]
              Attachment symlink22-hdfs.patch [ 12424330 ]
              Eli Collins made changes -
              Attachment symlink23-hdfs.patch [ 12427026 ]
              Attachment symlink23-common.patch [ 12427027 ]
              Eli Collins made changes -
              Link This issue depends on HADOOP-6421 [ HADOOP-6421 ]
              Eli Collins made changes -
              Attachment symlink24-hdfs.patch [ 12427408 ]
              Eli Collins made changes -
              Assignee dhruba borthakur [ dhruba ] Eli Collins [ eli ]
              Eli Collins made changes -
              Attachment symlink-25-hdfs.patch [ 12427678 ]
              Eli Collins made changes -
              Attachment symlink-26-hdfs.patch [ 12427766 ]
              Eli Collins made changes -
              Attachment symlink-26-hdfs.patch [ 12427775 ]
              Eli Collins made changes -
              Link This issue is blocked by HDFS-836 [ HDFS-836 ]
              Eli Collins made changes -
              Attachment symlink27-hdfs.patch [ 12428106 ]
              Eli Collins made changes -
              Attachment designdocv3.txt [ 12428108 ]
              Eli Collins made changes -
              Attachment symlink28-hdfs.patch [ 12428684 ]
              Eli Collins made changes -
              Attachment symlink29-hdfs.patch [ 12429578 ]
              Eli Collins made changes -
              Attachment symlink29-hdfs.patch [ 12429602 ]
              Eli Collins made changes -
              Attachment symlink30-hdfs.patch [ 12429688 ]
              Eli Collins made changes -
              Attachment symlink31-hdfs.patch [ 12429988 ]
              Eli Collins made changes -
              Attachment symlink33-hdfs.patch [ 12430485 ]
              Eli Collins made changes -
              Link This issue blocks HDFS-932 [ HDFS-932 ]
              Eli Collins made changes -
              Attachment symlink35-hdfs.patch [ 12431922 ]
              Eli Collins made changes -
              Attachment symlink36-hdfs.patch [ 12434649 ]
              Eli Collins made changes -
              Attachment symlink37-hdfs.patch [ 12434744 ]
              Eli Collins made changes -
              Attachment design-doc-v4.txt [ 12434745 ]
              Eli Collins made changes -
              Attachment symlink38-hdfs.patch [ 12435037 ]
              Eli Collins made changes -
              Attachment symlink39-hdfs.patch [ 12435349 ]
              Eli Collins made changes -
              Attachment symlink40-hdfs.patch [ 12436052 ]
              Eli Collins made changes -
              Status Open [ 1 ] Patch Available [ 10002 ]
              Jeff Hammerbacher made changes -
              Link This issue is related to HADOOP-6421 [ HADOOP-6421 ]
              Eli Collins made changes -
              Status Patch Available [ 10002 ] Open [ 1 ]
              Eli Collins made changes -
              Status Open [ 1 ] Patch Available [ 10002 ]
              Eli Collins made changes -
              Attachment symlink41-hdfs.patch [ 12436786 ]
              Eli Collins made changes -
              Status Patch Available [ 10002 ] Open [ 1 ]
              Eli Collins made changes -
              Status Open [ 1 ] Patch Available [ 10002 ]
              Sanjay Radia made changes -
              Status Patch Available [ 10002 ] Resolved [ 5 ]
              Hadoop Flags [Reviewed]
              Release Note HDFS-245. Adds a symlink implementation to HDFS. This complements the new symlink feature added in HADOOP-6421
              Fix Version/s 0.22.0 [ 12314241 ]
              Resolution Fixed [ 1 ]
              Tom White made changes -
              Fix Version/s 0.22.0 [ 12314241 ]
              Fix Version/s 0.21.0 [ 12314046 ]
              Tom White made changes -
              Status Resolved [ 5 ] Closed [ 6 ]
              Eli Collins made changes -
              Link This issue is blocked by HDFS-836 [ HDFS-836 ]
              Eli Collins made changes -
              Link This issue is blocked by HDFS-255 [ HDFS-255 ]
              Eli Collins made changes -
              Link This issue is blocked by HDFS-254 [ HDFS-254 ]
              Eli Collins made changes -
              Link This issue is related to HDFS-2246 [ HDFS-2246 ]
              Gavin made changes -
              Link This issue blocks HDFS-468 [ HDFS-468 ]
              Gavin made changes -
              Link This issue is depended upon by HDFS-468 [ HDFS-468 ]
              Gavin made changes -
              Link This issue blocks HDFS-220 [ HDFS-220 ]
              Gavin made changes -
              Link This issue is depended upon by HDFS-220 [ HDFS-220 ]
              Gavin made changes -
              Link This issue blocks HDFS-427 [ HDFS-427 ]
              Gavin made changes -
              Link This issue is depended upon by HDFS-427 [ HDFS-427 ]
              Gavin made changes -
              Link This issue depends on HADOOP-6421 [ HADOOP-6421 ]
              Gavin made changes -
              Link This issue depends upon HADOOP-6421 [ HADOOP-6421 ]
              Gavin made changes -
              Link This issue blocks HDFS-932 [ HDFS-932 ]
              Gavin made changes -
              Link This issue is depended upon by HDFS-932 [ HDFS-932 ]

                People

                • Assignee:
                  Eli Collins
                  Reporter:
                  dhruba borthakur
                • Votes:
                  3 Vote for this issue
                  Watchers:
                  41 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved:

                    Development