Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-1194

DataflowRunner should canonicalize gcpTempLocation/stagingLocation/etc formats.

    XMLWordPrintableJSON

Details

    • Test
    • Status: Open
    • P3
    • Resolution: Unresolved
    • None
    • None
    • runner-dataflow

    Description

      Cloud Dataflow has a minor history of small bugs related to various code paths expecting there to be or not be a trailing forward-slash in these location fields. The way that Beam's integration tests are set up, we are likely to only have one of these two cases tested (there is a single set of integration test pipeline options).

      We should add a dedicated DataflowRunner integration test to handle this case.

      Actually, we should probably canonicalize the URLs so that we only ever produce one version.

      Attachments

        Activity

          People

            Unassigned Unassigned
            dhalperi Dan Halperin
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: