Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12090 Handling writes from HDFS to Provided storages
  3. HDFS-13713

Add specification of Multipart Upload API to FS specification, with contract tests

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotVotersWatch issueWatchersConvert to IssueMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 3.2.0
    • Fix Version/s: 3.3.0, 3.2.1
    • Component/s: fs, test
    • Labels:
      None
    • Target Version/s:

      Description

      There's nothing in the FS spec covering the new API. Add it in a new .md file

      • add FS model with the notion of a function mapping (uploadID -> Upload), the operations (list, commit, abort). The TLA+ model of HADOOP-13786 shows how to do this.
      • Contract tests of not just the successful path, but all the invalid ones.
      • implementations of the contract tests of all FSs which support the new API.

        Attachments

        1. multipartuploader.md
          5 kB
          Steve Loughran
        2. HDFS-13713.008.patch
          59 kB
          Ewan Higgs
        3. HDFS-13713.008.patch
          59 kB
          Steve Loughran
        4. HDFS-13713.003.patch
          16 kB
          Ewan Higgs
        5. HDFS-13713.002.patch
          5 kB
          Ewan Higgs
        6. HDFS-13713.001.patch
          4 kB
          Ewan Higgs
        7. HADOOP-13713-009.patch
          59 kB
          Steve Loughran
        8. HADOOP-13713-007.patch
          60 kB
          Steve Loughran
        9. HADOOP-13713-006.patch
          49 kB
          Steve Loughran
        10. HADOOP-13713-005.patch
          47 kB
          Steve Loughran
        11. HADOOP-13713-004.patch
          41 kB
          Steve Loughran
        12. HADOOP-13713-004.patch
          41 kB
          Steve Loughran

        Issue Links

          Activity

          $i18n.getText('security.level.explanation', $currentSelection) Viewable by All Users
          Cancel

            People

            • Assignee:
              ehiggs Ewan Higgs Assign to me
              Reporter:
              stevel@apache.org Steve Loughran

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment