Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-4034

Hooks panic on flink

Details

    • Bug
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • 2.5.0
    • sdk-go
    • None

    Description

      It seems the serialized hooks are set only for Dataflow. It should probably not panic if nothing is set. I see the below on Flink.

      $ docker logs 0f5
      2018/04/09 21:03:48 Initializing Go harness: /opt/apache/beam/boot --id=-123 --logging_endpoint=docker.for.mac.host.internal:61723 --artifact_endpoint=docker.for.mac.host.internal:61724 --provision_endpoint=docker.for.mac.host.internal:61725 --control_endpoint=docker.for.mac.host.internal:61721 --semi_persist_dir=/tmp/semi_persistent_dir2198305397089608348
      Worker panic: DeserializeHooks failed on input "": unexpected end of JSON inputgoroutine 1 [running]:
      runtime/debug.Stack(0x4f, 0x0, 0x0)
      /usr/local/go/src/runtime/debug/stack.go:24 +0xa7
      runtime/debug.PrintStack()
      /usr/local/go/src/runtime/debug/stack.go:16 +0x22
      github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/init.hook.func1()
      /Users/herohde/go/src/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/init/init.go:76 +0xb6
      panic(0xc65060, 0xc4200402a0)
      /usr/local/go/src/runtime/panic.go:491 +0x283
      github.com/apache/beam/sdks/go/pkg/beam/core/util/hooks.DeserializeHooksFromOptions()
      /Users/herohde/go/src/github.com/apache/beam/sdks/go/pkg/beam/core/util/hooks/hooks.go:135 +0x402
      github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness.Main(0x136dd00, 0xc420060010, 0x7ffdcfb0dda8, 0x22, 0x7ffdcfb0ddde, 0x22, 0x0, 0x0)
      /Users/herohde/go/src/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go:41 +0x4f
      github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/init.hook()
      /Users/herohde/go/src/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/init/init.go:84 +0xc1
      github.com/apache/beam/sdks/go/pkg/beam/core/runtime.Init()
      /Users/herohde/go/src/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/init.go:42 +0x4c
      github.com/apache/beam/sdks/go/pkg/beam.Init()
      /Users/herohde/go/src/github.com/apache/beam/sdks/go/pkg/beam/forward.go:63 +0x20
      main.main()
      /Users/herohde/go/src/github.com/apache/beam/sdks/go/examples/wordcount/wordcount.go:156 +0x39
      2018/04/09 21:03:49 User program exited: exit status 2

      Attachments

        Issue Links

          Activity

            People

              herohde Henning Rohde
              herohde Henning Rohde
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 10m
                  1h 10m