[BEAM-10930] Use dense encoding for BigQuery JSON API interactions

• Type: Improvement
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: Missing
• Component/s: io-java-gcp
• Assignee: Seth Hollyman
• Reporter: Seth Hollyman
• Created: 18/Sep/20 21:12
• Updated: 13/Jan/22 21:49
• Resolved: 15/May/21 18:00

Description

Did a quick audit of java BigQueryIO, which leverages the underlying discovery client for the HTTP interactions with the BigQuery service.

 

By default, interactions with BigQuery will use pretty-printed JSON responses which may include significant whitespace due to the complexity inherent in the BigQuery JSON response structure.  This whitespace is all unnecessary for programmatic interactions, and interactions should use dense encoding as JSON is whitespace agnostic.

Information about the system parameters can be found at the below URL.  In particular, the prettyPrint parameter governs dense-vs-pretty JSON representation.

https://cloud.google.com/apis/docs/system-parameters

 

I already have a fix for this issue in progress, creating this issue in order to submit the PR for review.

 

Issue Links

• links to: GitHub Pull Request #12874