Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-2841

NPE in Dataflow job

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: P2
    • Resolution: Duplicate
    • Affects Version/s: 2.1.0
    • Fix Version/s: 2.2.0
    • Component/s: io-java-gcp
    • Labels:
      None

      Description

      My Dataflow job just started throwing exceptions after an unrelated update:

      java.lang.NullPointerException org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$DatasetServiceImpl.insertAll(BigQueryServicesImpl.java:759) org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$DatasetServiceImpl.insertAll(BigQueryServicesImpl.java:809) org.apache.beam.sdk.io.gcp.bigquery.StreamingWriteFn.flushRows(StreamingWriteFn.java:126) org.apache.beam.sdk.io.gcp.bigquery.StreamingWriteFn.finishBundle(StreamingWriteFn.java:96)

      The only change was to convert a DoFn<String, TableRow> to a DoFn<PubsubMessage, TableRow> and use PubsubIO.readMessages instead of PubsubIO.readString.

      Any ideas?

        Attachments

          Activity

            People

            • Assignee:
              chamikara Chamikara Madhusanka Jayalath
              Reporter:
              mc-coda Coda Hale
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: