Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-1314

Add DateTime Support to Pig

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.7.0
    • 0.11
    • data
    • pig date datetime time support primitive type

    Description

      Hadoop/Pig are primarily used to parse log data, and most logs have a timestamp component. Therefore Pig should support dates as a primitive.

      Can someone familiar with adding types to pig comment on how hard this is? We're looking at doing this, rather than use UDFs. Is this a patch that would be accepted?

      This is a candidate project for Google summer of code 2012. More information about the program can be found at https://cwiki.apache.org/confluence/display/PIG/GSoc2012

      Attachments

        1. joda_vs_builtin.zip
          4 kB
          Zhijie Shen
        2. PIG-1314-1.patch
          115 kB
          Zhijie Shen
        3. PIG-1314-2.patch
          148 kB
          Zhijie Shen
        4. PIG-1314-3.patch
          150 kB
          Zhijie Shen
        5. PIG-1314-4.patch
          226 kB
          Zhijie Shen
        6. PIG-1314-5.patch
          286 kB
          Zhijie Shen
        7. PIG-1314-6.patch
          288 kB
          Zhijie Shen
        8. PIG-1314-7.patch
          296 kB
          Zhijie Shen

        Issue Links

        blocks

        New Feature - A new feature of the product, which has yet to be developed. PIG-1310 ISO Date UDFs: Conversion, Trucation and Date Math

        • Major - Major loss of function.
        • Closed

        New Feature - A new feature of the product, which has yet to be developed. PIG-1429 Add Boolean Data Type to Pig

        • Major - Major loss of function.
        • Closed
        is related to

        Bug - A problem which impairs or prevents the functions of the product. PIG-2996 The buildtin function "ToDate" has been mapped with wrong class names

        • Major - Major loss of function.
        • Closed

        New Feature - A new feature of the product, which has yet to be developed. PIG-1310 ISO Date UDFs: Conversion, Trucation and Date Math

        • Major - Major loss of function.
        • Closed

        New Feature - A new feature of the product, which has yet to be developed. PIG-1429 Add Boolean Data Type to Pig

        • Major - Major loss of function.
        • Closed
        relates to

        Bug - A problem which impairs or prevents the functions of the product. PIG-2980 documentation for DateTime datatype

        • Major - Major loss of function.
        • Closed

        New Feature - A new feature of the product, which has yet to be developed. AVRO-739 Add Date/Time data types

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. HIVE-1269 Support Date/Datetime/Time/Timestamp Primitive Types

        • Major - Major loss of function.
        • Open

        Test - A new unit, integration or system test. PIG-2981 add e2e tests for DateTime data type

        • Major - Major loss of function.
        • Open

        Test - A new unit, integration or system test. PIG-2982 add unit tests for DateTime type that test setting timezone

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            zjshen Zhijie Shen
            russell.jurney Russell Jurney
            Votes:
            6 Vote for this issue
            Watchers:
            16 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - 672h
                672h
                Remaining:
                Remaining Estimate - 672h
                672h
                Logged:
                Time Spent - Not Specified
                Not Specified

                Slack

                  Issue deployment