[BEAM-3647] Default Coder/Reading Coder From File

• Type: New Feature
• Status: Open
• Priority: P3
• Resolution: Unresolved
• Affects Version/s: 2.2.0
• Component/s: beam-model
• Flags: Important
• External issue URL: https://stackoverflow.com/questions/47806368/running-beamsql-withoutcoder-or-making-coder-dynamic
• Assignee: Unassigned
• Reporter: Kishan Kumar
• Created: 08/Feb/18 10:01
• Updated: 03/Jun/22 19:37

Description

Requirement-: Need to Run Template With Same Logics on Different Tables Data.(Example is Given Below)

 

Need: Default Coder is Required So According to Data It Make All Fields as String and Read Data else Thier must be Dynamic Options to Read Coder From GCS as JSON FILE and Parse Data on Basis of That (But We can Pass Location Using ValueProvider) or SomeWhere Else so At Runtime Using ValueProvider.

 

 

Examples: I Have Two Tables 1 is Having Column (NAME, CLASS, ROLL, SUB_PRICE)

And 2 Table is (NAME, ROLL, SUB, TEST_MARKS)

 

On Both Tables, I am Just Sorting Table on Basis Of Roll Number so if We can Read Coder at Run Time The Same Template Can Be Used For Different Tables at Run Time.

 

Such Situations Make Our Work Easy and Make Our job Easy.

 

Issue Links

• duplicates: BEAM-3615 Dynamic/Default Coder For Data
• is related to: BEAM-3157 BeamSql transform should support other PCollection types