Details
-
Improvement
-
Status: In Progress
-
Major
-
Resolution: Unresolved
-
None
-
None
Description
We have two diff configs to set the right timestamp format.
"hoodie.parquet.outputtimestamptype": "TIMESTAMP_MICROS",
and spark config
--conf spark.sql.parquet.outputTimestampType=TIMESTAMP_MICROS
We should deprecate our own config and just rely on spark's configs.