[BEAM-8456] Add pipeline option to control truncate of BigQuery data processed by Beam SQL

• Type: Improvement
• Status: Triage Needed
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.18.0
• Component/s: dsl-sql
• Assignee: Kenneth Knowles
• Reporter: Kenneth Knowles
• Created: 22/Oct/19 02:15
• Updated: 13/Apr/23 10:58
• Resolved: 08/Nov/19 03:40

Description

Most of the time, a user reading a timestamp from BigQuery with higher-than-millisecond precision timestamps may not even realize that the data source created these high precision timestamps. They are probably timestamps on log entries generated by a system with higher precision.

If they are using it with Beam SQL, which only supports millisecond precision, it makes sense to "just work" by default.

Issue Links

• links to: GitHub Pull Request #9849