Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-12158

"v1.proto" is already registered error for golang dataflow

Details

    • Bug
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • Missing
    • sdk-go
    • None

    Description

      I tried to run wordcount example in go https://beam.apache.org/get-started/quickstart-go/

      It worked fine in dev but when I try to run it on GCP dataflow, I got '"v1.proto" is already registered' error and job crashes. 

       

      It seems proto definition here is using very generic package name "v1" which I suspect is a cause of issue

      https://github.com/apache/beam/blob/v2.28.0/sdks/go/pkg/beam/io/pubsubio/v1/v1.proto

       

      Here is log in GCP

      "panic: proto: file "v1.proto" is already registered "
      "See https://developers.google.com/protocol-buffers/docs/reference/go/faq#namespace-conflict "
      "goroutine 1 [running]: "
      "google.golang.org/protobuf/reflect/protoregistry.glob..func1(0x1683000, 0xc0005201c0, 0x164a080, 0xc0004657e0, 0xc0005201c0) "
      " /Users/kazuki/go/pkg/mod/google.golang.org/protobuf@v1.26.0/reflect/protoregistry/registry.go:54 +0x24c "
      "google.golang.org/protobuf/reflect/protoregistry.(*Files).RegisterFile(0xc000068350, 0x1688e40, 0xc0005201c0, 0x0, 0x0) "
      " /Users/kazuki/go/pkg/mod/google.golang.org/protobuf@v1.26.0/reflect/protoregistry/registry.go:127 +0xb6c "
      "google.golang.org/protobuf/internal/filedesc.Builder.Build(0x0, 0x0, 0xc000361e00, 0x12a, 0x200, 0x100000001, 0x0, 0x1654b00, 0xc00003c330, 0x1665e40, ...) "
      " /Users/kazuki/go/pkg/mod/google.golang.org/protobuf@v1.26.0/internal/filedesc/build.go:113 +0x195 "
      "github.com/golang/protobuf/proto.RegisterFile(0x148e167, 0x8, 0x1fdc7a0, 0xe2, 0xe2) "
      " /Users/kazuki/go/pkg/mod/github.com/golang/protobuf@v1.5.2/proto/registry.go:48 +0x13b "
      "github.com/apache/beam/sdks/go/pkg/beam/io/pubsubio/v1.init.1() "
      " /Users/kazuki/go/pkg/mod/github.com/apache/beam@v2.28.0+incompatible/sdks/go/pkg/beam/io/pubsubio/v1/v1.pb.go:115 +0x5a "
      "2021/04/12 19:32:22 User program exited: exit status 2 "
      

      Attachments

        Activity

          People

            lostluck Robert Burke
            nkazuki Kazuki Nishiura
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 3h 10m
                3h 10m