Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15620 Über-jira: S3A phase VI: Hadoop 3.3 features
  3. HADOOP-16379

S3AInputStream#unbuffer should merge input stream stats into fs-wide stats

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.2.0
    • Fix Version/s: 3.3.0
    • Component/s: fs/s3
    • Labels:
      None

      Description

      HADOOP-14747 added support for CanUnbuffer to S3A. One issue for applications that rely on the CanUnbuffer functionality, is that the current S3A code only merges input stream stats when the stream is closed. Applications using CanUnbuffer might not close streams for a long time, so any stats reported by input streams don't get reported in the filesystem-wide metrics.

      This JIRA proposes merging input stream statistics when S3AInputStream#unbuffer is called.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                stakiar Sahil Takiar
                Reporter:
                stakiar Sahil Takiar
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: