Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-246

Add a method to get file length for Seekable, FSDataInputStream and libhdfs

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      When open any seekable file, it should be able to get the length of the file via Seekable interface, since the seek method should be able to detect seeking beyond the end of file. Such interface can benefit distributed file systems by saving a network round-trip of FileSystem.getFileStatus(Path).getLen() for any open file.
      In libhdfs, such interface should also be exposed to make native program taking advantage of this change.
      I have the changes locally for all FSInputStream concrete classes. The change can be considered trivial, since some of the FSInputStream classes already have a method named getFileLength(), or a member field named size/length/end.

      Attachments

        1. hadoop.patch
          11 kB
          Qi Liu
        2. HADOOP-5143.patch
          10 kB
          Qi Liu
        3. HADOOP-5143-2.patch
          10 kB
          Qi Liu

        Issue Links

          Activity

            People

              visualage Qi Liu
              visualage Qi Liu
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated: