Details

    • Type: New Feature New Feature
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      We'd like to add a new feature hardlink to HDFS that allows harlinked files to share data without copying. Currently we will support hardlinking only closed files, but it could be extended to unclosed files as well.

      Among many potential use cases of the feature, the following two are primarily used in facebook:
      1. This provides a lightweight way for applications like hbase to create a snapshot;
      2. This also allows an application like Hive to move a table to a different directory without breaking current running hive queries.

      1. HDFS-HardLink.pdf
        1.03 MB
        Liyin Tang

        Issue Links

          Activity

            People

            • Assignee:
              Liyin Tang
              Reporter:
              Hairong Kuang
            • Votes:
              3 Vote for this issue
              Watchers:
              60 Start watching this issue

              Dates

              • Created:
                Updated:

                Development