Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-12177 [Umbrella] Update and extend filesystem specification
  3. HADOOP-13327

Add OutputStream + Syncable to the Filesystem Specification

    XMLWordPrintableJSON

Details

    Description

      Write down what a Filesystem output stream should do. While core the API is defined in Java, that doesn't say what's expected about visibility, durability, etc —and Hadoop Syncable interface is entirely ours to define.

      Attachments

        1. HADOOP-13327-002.patch
          53 kB
          Steve Loughran
        2. HADOOP-13327-003.patch
          66 kB
          Steve Loughran
        3. HADOOP-13327-branch-2-001.patch
          30 kB
          Steve Loughran

        Issue Links

          breaks

          Sub-task - The sub-task of the issue HADOOP-17537 Correct abfs test assertion reversed in HADOOP-13327

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HDFS-15836 RBF: Fix contract tests after HADOOP-13327

          • Major - Major loss of function.
          • Resolved
          causes

          Bug - A problem which impairs or prevents the functions of the product. HBASE-25900 HBoss tests compile/failure against Hadoop 3.3.1

          • Major - Major loss of function.
          • Resolved
          contains

          Sub-task - The sub-task of the issue HADOOP-14718 Add StreamCapabilities support to ADLS

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HADOOP-14719 Add StreamCapabilities support to WASB

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-14402 roll out StreamCapabilities across output streams of all filesystems

          • Major - Major loss of function.
          • Resolved
          incorporates

          Sub-task - The sub-task of the issue HADOOP-14790 PageBlobOutputStream to declare hflush/hsync StreamCapabilities for

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-12263 Revise StreamCapacities doc to describe the API usage and the requirements for customized OutputStream implemetation

          • Major - Major loss of function.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue HADOOP-17597 Add option to downgrade S3A rejection of Syncable to warning

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HDFS-14027 DFSStripedOutputStream should implement both hsync methods

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HDFS-11644 Support for querying outputstream capabilities

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-14365 Stabilise FileSystem builder-based create API

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-15051 FSDataOutputStream returned by LocalFileSystem#createNonRecursive doesn't have hflush capability

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-15229 Add FileSystem builder-based openFile() API to match createFile(); S3A to implement S3 Select through this API.

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-14872 CryptoInputStream should implement unbuffer

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #532

          Web Link GitHub Pull Request #564

          Web Link GitHub Pull Request #575

          Web Link GitHub Pull Request #1694

          Web Link GitHub Pull Request #2102

          Web Link GitHub Pull Request #2587

          Activity

            People

              stevel@apache.org Steve Loughran
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              17 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 11h 10m
                  11h 10m