Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7878

API - expose a unique file identifier

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.1.0
    • None
    • Reviewed

    Description

      See HDFS-487.
      Even though that is resolved as duplicate, the ID is actually not exposed by the JIRA it supposedly duplicates.
      INode ID for the file should be easy to expose; alternatively ID could be derived from block IDs, to account for appends...

      This is useful e.g. for cache key by file, to make sure cache stays correct when file is overwritten.

      Attachments

        1. HDFS-7878.patch
          5 kB
          Sergey Shelukhin
        2. HDFS-7878.01.patch
          2 kB
          Sergey Shelukhin
        3. HDFS-7878.02.patch
          2 kB
          Sergey Shelukhin
        4. HDFS-7878.03.patch
          8 kB
          Sergey Shelukhin
        5. HDFS-7878.04.patch
          8 kB
          Sergey Shelukhin
        6. HDFS-7878.05.patch
          8 kB
          Sergey Shelukhin
        7. HDFS-7878.06.patch
          16 kB
          Christopher Douglas
        8. HDFS-7878.07.patch
          30 kB
          Christopher Douglas
        9. HDFS-7878.08.patch
          35 kB
          Christopher Douglas
        10. HDFS-7878.09.patch
          42 kB
          Christopher Douglas
        11. HDFS-7878.10.patch
          42 kB
          Christopher Douglas
        12. HDFS-7878.11.patch
          55 kB
          Christopher Douglas
        13. HDFS-7878.12.patch
          56 kB
          Christopher Douglas
        14. HDFS-7878.13.patch
          56 kB
          Christopher Douglas
        15. HDFS-7878.14.patch
          56 kB
          Christopher Douglas
        16. HDFS-7878.15.patch
          56 kB
          Christopher Douglas
        17. HDFS-7878.16.patch
          56 kB
          Christopher Douglas
        18. HDFS-7878.17.patch
          56 kB
          Christopher Douglas
        19. HDFS-7878.18.patch
          57 kB
          Christopher Douglas
        20. HDFS-7878.19.patch
          58 kB
          Christopher Douglas
        21. HDFS-7878.20.patch
          58 kB
          Christopher Douglas
        22. HDFS-7878.21.patch
          58 kB
          Christopher Douglas

        Issue Links

          blocks

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-14159 Backporting HDFS-12882 to branch-3.0: Support full open(PathHandle) contract in HDFS

          • Major - Major loss of function.
          • Resolved
          breaks

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-15031 Fix javadoc issues in Hadoop Common

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          contains

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-10262 Change HdfsFileStatus::fileId to an opaque identifier

          • Major - Major loss of function.
          • Resolved
          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-6984 Serialize FileStatus via protobuf

          • Major - Major loss of function.
          • Resolved
          is depended upon by

          Sub-task - The sub-task of the issue HDFS-11640 [READ] Datanodes should use a unique identifier when reading from external stores

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-12681 Make HdfsLocatedFileStatus a subtype of LocatedFileStatus

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-12882 Support full open(PathHandle) contract in HDFS

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-12877 Add open(PathHandle) with default buffersize

          • Trivial - Cosmetic problem like misspelt words or misaligned text.
          • Resolved
          relates to

          New Feature - A new feature of the product, which has yet to be developed. HDFS-487 HDFS should expose a fileid to uniquely identify a file

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. HDFS-9806 Allow HDFS block replicas to be provided by an external storage system

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              cdouglas Christopher Douglas
              sershe Sergey Shelukhin
              Votes:
              0 Vote for this issue
              Watchers:
              23 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: