Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-11047

BigQuery IO: Avro INTEGER values get converted to String objects

Details

    • Bug
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • 2.22.0, 2.23.0, 2.24.0
    • Missing
    • io-java-gcp
    • Patch

    Description

      For some reason, convertRequiredField used in BigQueryAvroUtils.convertGenericRecordToTableRow casts values with the Avro INTEGER type to Long, but then converts them to String objects via toString.

      I'm quite unsure where convertGenericRecordToTableRow is used elsewhere, but we use it to utilize BigQuery's Storage API reads.

      I'm fairly certain this is not expected behaviour because other types are converted properly and due to the cast to Long it's ensured that any values will fit into Long objects anyways.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              j.grabber Jonas Grabber
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h
                  1h