[PHOENIX-6792] FastDateFormat cannot parse greater than milisecond precision.

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 5.2.0
• Component/s: core
• Assignee: Unassigned
• Reporter: Istvan Toth
• Created: 26/Sep/22 06:19
• Updated: 14/Mar/23 09:10

Description

While working on PHOENIX-5066, I found that FastDateFormat is incapable of handling greater than milisecond precision.

We're using the format string: "yyyy-MM-dd HH:mm:ss.SSS", but we want to parse nanosecond resolution timestamp strings like "2020-01-01 13:30:00.123456789"

Strictly speaking FastDateFormat works as documented, as it interprets 123456789 as miliseconds, and sets miliseconds to "789", and adds "123456" seconds to the date.

However, this is clearly not the intended behaviour.

We either need to add some format-dependent heuristics, or drop FastDateFormat usage.

Issue Links

• depends upon: PHOENIX-5422 Use Java8 DateTime APIs instead of joda-time APIs
• is depended upon by: PHOENIX-6882 Umbrella Ticket for date/time handling issues
• is related to: PHOENIX-5066 The TimeZone is incorrectly used during writing or reading data