[PIG-1314] Add DateTime Support to Pig

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.7.0
• Fix Version/s: 0.11
• Component/s: data
• Labels: gsoc2012
• Tags: pig date datetime time support primitive type
• Assignee: Zhijie Shen
• Reporter: Russell Jurney
• Created: 22/Mar/10 18:27
• Updated: 22/Feb/13 04:53
• Resolved: 15/Oct/12 23:20

Description

Hadoop/Pig are primarily used to parse log data, and most logs have a timestamp component. Therefore Pig should support dates as a primitive.

Can someone familiar with adding types to pig comment on how hard this is? We're looking at doing this, rather than use UDFs. Is this a patch that would be accepted?

This is a candidate project for Google summer of code 2012. More information about the program can be found at https://cwiki.apache.org/confluence/display/PIG/GSoc2012

Issue Links

• blocks: PIG-1310 ISO Date UDFs: Conversion, Trucation and Date Math
• blocks: PIG-1429 Add Boolean Data Type to Pig
• is related to: PIG-2996 The buildtin function "ToDate" has been mapped with wrong class names
• is related to: PIG-1310 ISO Date UDFs: Conversion, Trucation and Date Math
• is related to: PIG-1429 Add Boolean Data Type to Pig
• relates to: PIG-2980 documentation for DateTime datatype
• relates to: AVRO-739 Add Date/Time data types
• relates to: HIVE-1269 Support Date/Datetime/Time/Timestamp Primitive Types
• relates to: PIG-2981 add e2e tests for DateTime data type
• relates to: PIG-2982 add unit tests for DateTime type that test setting timezone

Sub-Tasks

• fix DBStorage compile issue: Closed
• jodatime jar missing in pig-withouthadoop.jar: Closed