Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-11940

JsonToRow can catch errors in downstream transforms

Details

    • Bug
    • Status: Open
    • P3
    • Resolution: Unresolved
    • 2.26.0, 2.27.0, 2.28.0
    • None
    • sdk-java-core
    • None

    Description

      JsonToRow :

       

      try {| | | | | |output.get(PARSED_LINE).output(jsonToRow(objectMapper(), element));| | | | | |}

      catch (Exception ex)

      {| Can catch errors thrown downstream with runners that have fusion. This can be confusing as it can appear that the issue happens in the parse operation , when its really happening in a transform further down the DAG. This is made worse as different runners can show different behaviour in this situation.   Replace with try\{i = parse}

      catch{}  if i not null output

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              rarokni@gmail.com Reza ardeshir rokni

              Dates

                Created:
                Updated:

                Slack

                  Issue deployment