Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7694

FSDataInputStream should support "unbuffer"

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.7.0
    • 2.7.0, 2.6.4, 3.0.0-alpha1
    • None
    • None

    Description

      For applications that have many open HDFS (or other Hadoop filesystem) files, it would be useful to have an API to clear readahead buffers and sockets. This could be added to the existing APIs as an optional interface, in much the same way as we added setReadahead / setDropBehind / etc.

      Attachments

        1. HDFS-7694.005.patch
          12 kB
          Colin McCabe
        2. HDFS-7694.004.patch
          12 kB
          Colin McCabe
        3. HDFS-7694.003.patch
          13 kB
          Colin McCabe
        4. HDFS-7694.002.patch
          12 kB
          Colin McCabe
        5. HDFS-7694.001.patch
          13 kB
          Colin McCabe

        Issue Links

          is related to

          Sub-task - The sub-task of the issue HADOOP-14747 S3AInputStream to implement CanUnbuffer

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HADOOP-14748 Wasb input streams to implement CanUnbuffer

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HDFS-7744 Fix potential NPE in DFSInputStream after setDropBehind or setReadahead is called

          • Major - Major loss of function.
          • Closed
          relates to

          Sub-task - The sub-task of the issue HADOOP-14765 AdlFsInputStream should implement unbuffer

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-12805 Annotate CanUnbuffer with @InterfaceAudience.Public

          • Major - Major loss of function.
          • Closed

          Activity

            People

              cmccabe Colin McCabe
              cmccabe Colin McCabe
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: