Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-7507

StreamingDataflowWorker attempts to decode non-utf8 binary data as utf8

Details

    • Improvement
    • Status: Resolved
    • P4
    • Resolution: Fixed
    • None
    • 2.14.0
    • runner-dataflow
    • None

    Description

      In StreamingDataflowWorker, when setting the workId for the logging MDC, currently the code attempts to decode a binary blob as utf8.  This will (generally) cause a decoding error, and the java UTF8 decoder uses a globally synchronized cache to handle generating these error results.

      A simple solution would be to use the protobuf TextFormat escaping to convert the ByteString key into a string.

      Attachments

        Activity

          People

            SteveNiemitz Steve Niemitz
            SteveNiemitz Steve Niemitz
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 1.5h
                1.5h