Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-4147 Abstractions for artifact delivery via arbitrary storage backends
  3. BEAM-4290

ArtifactStagingService that stages to a distributed filesystem

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • 2.6.0
    • runner-core
    • None

    Description

      Using the job's staging directory from PipelineOptions.

      Physical layout on the distributed filesystem is TBD but it should allow for arbitrary filenames and ideally for eventually avoiding uploading artifacts that are already there.

      Handling credentials is TBD.

      Attachments

        Activity

          People

            angoenka Ankur Goenka
            jkff Eugene Kirpichov
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 15h 40m
                15h 40m