Summary - When applying a `RenameFields` followed by BigQueryUtils.toTableRow(Row), renames on nested fields were not being applied when using DataflowRunner. DirectRunner appeared to be fine. This led to a failed BigQueryIO.Write.
Expected Behaviour - (field0_1.field1_0, nestedStringField) -> field0_1.nestedStringField and successful BQ insert
Actual Behaviour - (field0_1.field1_0, nestedStringField) -> field0_1.field1_0 and failed BQ insert because field0_1.field1_0 was not in the target BQ table
Thread from Users mailing list - https://lists.apache.org/thread.html/rd33a6f2bd8454cf650d70795bcdbbb873f988a557133d3bdbfc56cfc%40%3Cuser.beam.apache.org%3E