Hive
  1. Hive
  2. HIVE-3824

bug if different serdes are used for different partitions

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.11.0
    • Component/s: Query Processor
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Consider the following testcase:

      create table tst5 (key string, value string) partitioned by (ds string) stored as rcfile;
      insert overwrite table tst5 partition (ds='1') select * from src;
      insert overwrite table tst5 partition (ds='2') select * from src;
      insert overwrite table tst5 partition (ds='3') select * from src;

      alter table tst5 stored as sequencefile;

      insert overwrite table tst5 partition (ds='4') select * from src;
      insert overwrite table tst5 partition (ds='5') select * from src;
      insert overwrite table tst5 partition (ds='6') select * from src;

      alter table tst5 set serde 'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe';

      insert overwrite table tst5 partition (ds='7') select * from src;
      insert overwrite table tst5 partition (ds='8') select * from src;
      insert overwrite table tst5 partition (ds='9') select * from src;

      The following query works fine:

      select key + key, value from tst5 where ((ds = '4') or (ds = '1'));

      since both the partitions use ColumnarSerDe

      But the following query fails:

      select key + key, value from tst5 where ((ds = '4') or (ds = '1') or (ds='7'));

      since different serdes are used.

      1. hive.3824.4.patch
        20 kB
        Namit Jain
      2. hive.3824.3.patch
        19 kB
        Namit Jain
      3. hive.3824.1.patch
        19 kB
        Namit Jain

        Issue Links

          Activity

          Namit Jain created issue -
          Namit Jain made changes -
          Field Original Value New Value
          Attachment hive.3824.1.patch [ 12561875 ]
          Namit Jain made changes -
          Link This issue relates to HIVE-3833 [ HIVE-3833 ]
          Namit Jain made changes -
          Attachment hive.3824.3.patch [ 12562306 ]
          Namit Jain made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Assignee Namit Jain [ namit ]
          Namit Jain made changes -
          Attachment hive.3824.4.patch [ 12564613 ]
          Namit Jain made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Fix Version/s 0.11.0 [ 12323587 ]
          Resolution Fixed [ 1 ]
          Owen O'Malley made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Namit Jain
              Reporter:
              Namit Jain
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development