Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-1988

utils.path.join does not correctly handle GCS bucket roots

Details

    • Bug
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • 2.0.0
    • sdk-py-core
    • None

    Description

      Here:
      https://github.com/apache/beam/blob/master/sdks/python/apache_beam/utils/path.py#L22

      Joining a bucket root with a filename e.g. (gs://mybucket/ , myfile) results in invalid 'gs://mybucket//myfile', notice the double // between mybucket and myfile. (It actually does not handle anything that already ends with / correctly)

      sb2nov could you take this one? Also, should the `join` operation move to a BeamFileSystem level code.

      (cc: chamikara)

      Attachments

        Activity

          People

            sb2nov Sourabh Bajaj
            altay Ahmet Altay
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: