[HIVE-1483] Update AWS S3 log format deserializer regex

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.5.0, 0.6.0, 0.7.0
• Component/s: Serializers/Deserializers
• Assignee: Unassigned
• Reporter: Carl Steinbach
• Created: 23/Jul/10 18:30
• Updated: 23/Jul/10 18:30

Description

From HIVE-693:

Amazon Changed the format of the logs at the beginning of February 2010, so now the new regex is:
static Pattern regexpat = Pattern.compile( "(
S+) (
S+)
[(.?)
] (
S+) (
S+) (
S+) (
S+) (
S+) \"(.)\" (
S) (
S+) (
S+) (
S+) (
S+) (
S+) \"(.)\" \"(.*)\"(?: -)?");

(the only difference is addition of (?: -)? at the end.

Since Amazon hasn't yet documented the last field, I don't know if it is ok to do a catch-all regex for that field instead of the very specific one I've added.