Hive
  1. Hive
  2. HIVE-5814

Add DATE, TIMESTAMP, DECIMAL, CHAR, VARCHAR types support in HCat

    Details

    • Type: New Feature New Feature
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.12.0
    • Fix Version/s: 0.13.0
    • Component/s: HCatalog
    • Labels:
      None

      Description

      Hive 0.12 added support for new data types. Pig 0.12 added some as well. HCat should handle these as well. Also note that CHAR was added recently.

      Also allow user to specify a parameter in Pig like so HCatStorer('','', '-onOutOfRangeValue Throw') to control what happens when Pig's value is out of range for target Hive column. Valid values for the option are Throw and Null. Throw - make the runtime raise an exception, Null, which is the default, means NULL is written to target column and a message to that effect is emitted to the log. Only 1 message per column/data type is sent to the log.

      See attached HCat-Pig Type Mapping Hive 0.13.pdf for exact mappings.

      1. HIVE-5814.5.patch
        141 kB
        Eugene Koifman
      2. HIVE-5814.4.patch
        140 kB
        Eugene Koifman
      3. HIVE-5814.3.patch
        140 kB
        Eugene Koifman
      4. HCat-Pig Type Mapping Hive 0.13.pdf
        48 kB
        Eugene Koifman
      5. HIVE-5814.2.patch
        110 kB
        Eugene Koifman

        Issue Links

          Activity

          Lefty Leverenz made changes -
          Link This issue incorporates HIVE-6232 [ HIVE-6232 ]
          Sushanth Sowmyan made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 0.13.0 [ 12324986 ]
          Resolution Fixed [ 1 ]
          Eugene Koifman made changes -
          Link This issue is related to HIVE-6370 [ HIVE-6370 ]
          Eugene Koifman made changes -
          Description Hive 0.12 added support for new data types. Pig 0.12 added some as well. HCat should handle these as well. Also note that CHAR was added recently.

          Also allow user to specify a parameter in Pig like so HCatStorer('','', '-onOutOfRangeValue Throw') to control what happens when Pig's value is out of range for target Hive column. Valid values for the option are Throw and Null. Throw - make the runtime raise an exception, Null, which is the default, means NULL is written to target column and a message to that effect is emitted to the log. Only 1 message per column/data type is sent to the log.
          Hive 0.12 added support for new data types. Pig 0.12 added some as well. HCat should handle these as well. Also note that CHAR was added recently.

          Also allow user to specify a parameter in Pig like so HCatStorer('','', '-onOutOfRangeValue Throw') to control what happens when Pig's value is out of range for target Hive column. Valid values for the option are Throw and Null. Throw - make the runtime raise an exception, Null, which is the default, means NULL is written to target column and a message to that effect is emitted to the log. Only 1 message per column/data type is sent to the log.

          See attached HCat-Pig Type Mapping Hive 0.13.pdf for exact mappings.
          Eugene Koifman made changes -
          Description Hive 0.12 added support for new data types. Pig 0.12 added some as well. HCat should handle these as well. Also note that CHAR was added recently. Hive 0.12 added support for new data types. Pig 0.12 added some as well. HCat should handle these as well. Also note that CHAR was added recently.

          Also allow user to specify a parameter in Pig like so HCatStorer('','', '-onOutOfRangeValue Throw') to control what happens when Pig's value is out of range for target Hive column. Valid values for the option are Throw and Null. Throw - make the runtime raise an exception, Null, which is the default, means NULL is written to target column and a message to that effect is emitted to the log. Only 1 message per column/data type is sent to the log.
          Eugene Koifman made changes -
          Attachment HIVE-5814.5.patch [ 12626383 ]
          Eugene Koifman made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Eugene Koifman made changes -
          Attachment HIVE-5814.4.patch [ 12626347 ]
          Eugene Koifman made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Eugene Koifman made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Eugene Koifman made changes -
          Attachment HIVE-5814.3.patch [ 12625486 ]
          Eugene Koifman made changes -
          Attachment HIVE-5814.3.patch [ 12626277 ]
          Eugene Koifman made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Eugene Koifman made changes -
          Attachment HIVE-5814 HCat-Pig type mapping.pdf [ 12624013 ]
          Eugene Koifman made changes -
          Attachment HCat-Pig Type Mapping Hive 0.13.pdf [ 12626251 ]
          Eugene Koifman made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Eugene Koifman made changes -
          Attachment HIVE-5814.3.patch [ 12625486 ]
          Eugene Koifman made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Eugene Koifman made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Eugene Koifman made changes -
          Attachment HIVE-5814.2.patch [ 12625462 ]
          Eugene Koifman made changes -
          Attachment HIVE-5814.patch [ 12624020 ]
          Eugene Koifman made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Eugene Koifman made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Eugene Koifman made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Eugene Koifman made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Eugene Koifman made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Eugene Koifman made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Eugene Koifman made changes -
          Attachment HIVE-5814.patch [ 12624020 ]
          Eugene Koifman made changes -
          Attachment HIVE-5814 HCat-Pig type mapping.pdf [ 12624013 ]
          Eugene Koifman made changes -
          Attachment HIVE-5814PrimitiveTypeHivePigMapping.pdf [ 12622292 ]
          Eugene Koifman made changes -
          Attachment HIVE-5814.patch [ 12613912 ]
          Eugene Koifman made changes -
          Link This issue relates to HIVE-6194 [ HIVE-6194 ]
          Eugene Koifman made changes -
          Attachment HIVE-5814PrimitiveTypeHivePigMapping.pdf [ 12622292 ]
          Eugene Koifman made changes -
          Summary Add DATE, TIMESTAMP, DECIMAL, VARCHAR types support in HCat Add DATE, TIMESTAMP, DECIMAL, CHAR, VARCHAR types support in HCat
          Eugene Koifman made changes -
          Description Hive 0.12 added support for new data types. Pig 0.12 added some as well. HCat should handle these as well. Hive 0.12 added support for new data types. Pig 0.12 added some as well. HCat should handle these as well. Also note that CHAR was added recently.
          Eugene Koifman made changes -
          Link This issue relates to HIVE-5565 [ HIVE-5565 ]
          Eugene Koifman made changes -
          Field Original Value New Value
          Attachment HIVE-5814.patch [ 12613912 ]
          Eugene Koifman created issue -

            People

            • Assignee:
              Eugene Koifman
              Reporter:
              Eugene Koifman
            • Votes:
              1 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development