[GOBBLIN-1980] Adding Support for Avro Date and timestamp Logical Types in Json Element Conversion Factory

• Type: New Feature
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 0.15.0
• Component/s: gobblin-core
• Assignee: Abhishek Tiwari
• Reporter: Nidhi Shah
• Created: 03/Jan/24 11:06
• Updated: 03/Jan/24 11:06

Description

In Apache Avro, along with primary data types  and complex datatype we have logical types. A logical type is an Avro primitive or complex type with extra attributes to represent a derived type.
This helps downstream systems to determine what exactly the data is and then process data accordingly. 
https://avro.apache.org/docs/1.11.1/specification/#logical-types

Currently, there is support for only primary avro datatypes. We need support to add logical datatype attribute to avro schema for date and timestamp datatype. 

Acceptance Criteria: 
1) configuration to enable logical type for avro schema 
2) avro schema to have logical type attribute for date and timestamp 

{{

{ "type": "int", "logicalType": "date" }

}}