Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-8239

Docker options in --environment_config

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: P2
    • Resolution: Unresolved
    • Affects Version/s: 2.15.0
    • Fix Version/s: None
    • Component/s: sdk-py-harness
    • Labels:
      None

      Description

      I'm trying to mount a directory by providing additional arguments via –environment_config in the PipelineOptions:

       

      pipeline_options = PipelineOptions(["--runner=PortableRunner", "--job_endpoint=localhost:8099", "--environment_config=-v /tmp:/tmp benjamintan-docker-apache.bintray.io/beam/python3:latest"], pipeline_type_check=True)

       

      However,  the command fails with the following:

       

       

      RuntimeError: Pipeline BeamApp-benjamintan-0916144446-839e633f_994659f0-7da9-412e-91e2-f32dd4f24b5c failed in state FAILED: java.io.IOException: Received exit code 125 for command 'docker run -d --mount type=bind,src=/home/benjamintan/.config/gcloud,dst=/root/.config/gcloud --network=host --env=DOCKER_MAC_CONTAINER=null -v /tmp:/tmp benjamintan-docker-apache.bintray.io/beam/python3:latest --id=7-1 --logging_endpoint=localhost:41835 --artifact_endpoint=localhost:40063 --provision_endpoint=localhost:39827 --control_endpoint=localhost:45355'. stderr: unknown flag: --idSee 'docker run --help'.

       

      However, if I were to copy and paste the `docker run ...` command, the command seems OK (no syntax errors)

       

      This seems related to BEAM-5440. It isn't clear if there's a "right" way to pass in additional Docker run arguments.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                bentanweihao Benjamin Tan
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated: