Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-13459

Dataflow python runner should cache uploaded artifacts across job runs

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Triage Needed
    • P1
    • Resolution: Fixed
    • None
    • 2.36.0
    • runner-dataflow
    • None

    Description

      Similar to how the jvm dataflow runner caches artifacts uploaded to GCS across job runs (based on their sha256), the python runner should do the same.

      Attachments

        Activity

          People

            SteveNiemitz Steve Niemitz
            SteveNiemitz Steve Niemitz
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 8h 40m
                8h 40m