[BEAM-11322] Apache Beam Template to tokenize sensitive data

• Type: Improvement
• Status: Resolved
• Priority: P3
• Resolution: Implemented
• Fix Version/s: Missing
• Component/s: examples-java
• Labels: Clarified
• Assignee: Artur Khanin
• Reporter: Artur Khanin
• Created: 23/Nov/20 14:03
• Updated: 13/Jan/22 21:49
• Resolved: 31/Mar/21 08:47

Description

Some users may want to protect their sensitive data using tokenization.

We propose to create a Beam example template that will demonstrate Beam transform to protect sensitive data using tokenization. In our example, we will use an external service for the data tokenization. 

At a high level, a pipeline that will: 

• support batch (GCS) and streaming (Pub/Sub) input sources
• tokenize sensitive data via external REST service - we are about to use Protegrity
• output tokenized data into BigQuery or BigTable

Issue Links

• links to: GitHub Pull Request #13995