Hive
  1. Hive
  2. HIVE-3824

bug if different serdes are used for different partitions

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.11.0
    • Component/s: Query Processor
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Consider the following testcase:

      create table tst5 (key string, value string) partitioned by (ds string) stored as rcfile;
      insert overwrite table tst5 partition (ds='1') select * from src;
      insert overwrite table tst5 partition (ds='2') select * from src;
      insert overwrite table tst5 partition (ds='3') select * from src;

      alter table tst5 stored as sequencefile;

      insert overwrite table tst5 partition (ds='4') select * from src;
      insert overwrite table tst5 partition (ds='5') select * from src;
      insert overwrite table tst5 partition (ds='6') select * from src;

      alter table tst5 set serde 'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe';

      insert overwrite table tst5 partition (ds='7') select * from src;
      insert overwrite table tst5 partition (ds='8') select * from src;
      insert overwrite table tst5 partition (ds='9') select * from src;

      The following query works fine:

      select key + key, value from tst5 where ((ds = '4') or (ds = '1'));

      since both the partitions use ColumnarSerDe

      But the following query fails:

      select key + key, value from tst5 where ((ds = '4') or (ds = '1') or (ds='7'));

      since different serdes are used.

      1. hive.3824.4.patch
        20 kB
        Namit Jain
      2. hive.3824.3.patch
        19 kB
        Namit Jain
      3. hive.3824.1.patch
        19 kB
        Namit Jain

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Namit Jain
              Reporter:
              Namit Jain
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development