Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7878

API - expose a unique file identifier

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.1.0
    • None
    • Reviewed

    Description

      See HDFS-487.
      Even though that is resolved as duplicate, the ID is actually not exposed by the JIRA it supposedly duplicates.
      INode ID for the file should be easy to expose; alternatively ID could be derived from block IDs, to account for appends...

      This is useful e.g. for cache key by file, to make sure cache stays correct when file is overwritten.

      Attachments

        1. HDFS-7878.patch
          5 kB
          Sergey Shelukhin
        2. HDFS-7878.21.patch
          58 kB
          Christopher Douglas
        3. HDFS-7878.20.patch
          58 kB
          Christopher Douglas
        4. HDFS-7878.19.patch
          58 kB
          Christopher Douglas
        5. HDFS-7878.18.patch
          57 kB
          Christopher Douglas
        6. HDFS-7878.17.patch
          56 kB
          Christopher Douglas
        7. HDFS-7878.16.patch
          56 kB
          Christopher Douglas
        8. HDFS-7878.15.patch
          56 kB
          Christopher Douglas
        9. HDFS-7878.14.patch
          56 kB
          Christopher Douglas
        10. HDFS-7878.13.patch
          56 kB
          Christopher Douglas
        11. HDFS-7878.12.patch
          56 kB
          Christopher Douglas
        12. HDFS-7878.11.patch
          55 kB
          Christopher Douglas
        13. HDFS-7878.10.patch
          42 kB
          Christopher Douglas
        14. HDFS-7878.09.patch
          42 kB
          Christopher Douglas
        15. HDFS-7878.08.patch
          35 kB
          Christopher Douglas
        16. HDFS-7878.07.patch
          30 kB
          Christopher Douglas
        17. HDFS-7878.06.patch
          16 kB
          Christopher Douglas
        18. HDFS-7878.05.patch
          8 kB
          Sergey Shelukhin
        19. HDFS-7878.04.patch
          8 kB
          Sergey Shelukhin
        20. HDFS-7878.03.patch
          8 kB
          Sergey Shelukhin
        21. HDFS-7878.02.patch
          2 kB
          Sergey Shelukhin
        22. HDFS-7878.01.patch
          2 kB
          Sergey Shelukhin

        Issue Links

        blocks

        Improvement - An improvement or enhancement to an existing feature or task. HDFS-14159 Backporting HDFS-12882 to branch-3.0: Support full open(PathHandle) contract in HDFS

        • Major - Major loss of function.
        • Resolved
        breaks

        Bug - A problem which impairs or prevents the functions of the product. HADOOP-15031 Fix javadoc issues in Hadoop Common

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Resolved
        contains

        Improvement - An improvement or enhancement to an existing feature or task. HDFS-10262 Change HdfsFileStatus::fileId to an opaque identifier

        • Major - Major loss of function.
        • Resolved
        is blocked by

        Improvement - An improvement or enhancement to an existing feature or task. HDFS-6984 Serialize FileStatus via protobuf

        • Major - Major loss of function.
        • Resolved
        is depended upon by

        Sub-task - The sub-task of the issue HDFS-11640 [READ] Datanodes should use a unique identifier when reading from external stores

        • Major - Major loss of function.
        • Resolved
        is related to

        Bug - A problem which impairs or prevents the functions of the product. HDFS-12681 Make HdfsLocatedFileStatus a subtype of LocatedFileStatus

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. HDFS-12882 Support full open(PathHandle) contract in HDFS

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. HDFS-12877 Add open(PathHandle) with default buffersize

        • Trivial - Cosmetic problem like misspelt words or misaligned text.
        • Resolved
        relates to

        New Feature - A new feature of the product, which has yet to be developed. HDFS-487 HDFS should expose a fileid to uniquely identify a file

        • Major - Major loss of function.
        • Resolved

        New Feature - A new feature of the product, which has yet to be developed. HDFS-9806 Allow HDFS block replicas to be provided by an external storage system

        • Major - Major loss of function.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            cdouglas Christopher Douglas
            sershe Sergey Shelukhin
            Votes:
            0 Vote for this issue
            Watchers:
            23 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment