Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-3824

bug if different serdes are used for different partitions

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.11.0
    • Component/s: Query Processor
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Consider the following testcase:

      create table tst5 (key string, value string) partitioned by (ds string) stored as rcfile;
      insert overwrite table tst5 partition (ds='1') select * from src;
      insert overwrite table tst5 partition (ds='2') select * from src;
      insert overwrite table tst5 partition (ds='3') select * from src;

      alter table tst5 stored as sequencefile;

      insert overwrite table tst5 partition (ds='4') select * from src;
      insert overwrite table tst5 partition (ds='5') select * from src;
      insert overwrite table tst5 partition (ds='6') select * from src;

      alter table tst5 set serde 'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe';

      insert overwrite table tst5 partition (ds='7') select * from src;
      insert overwrite table tst5 partition (ds='8') select * from src;
      insert overwrite table tst5 partition (ds='9') select * from src;

      The following query works fine:

      select key + key, value from tst5 where ((ds = '4') or (ds = '1'));

      since both the partitions use ColumnarSerDe

      But the following query fails:

      select key + key, value from tst5 where ((ds = '4') or (ds = '1') or (ds='7'));

      since different serdes are used.

        Attachments

        1. hive.3824.4.patch
          20 kB
          Namit Jain
        2. hive.3824.3.patch
          19 kB
          Namit Jain
        3. hive.3824.1.patch
          19 kB
          Namit Jain

          Issue Links

            Activity

              People

              • Assignee:
                namit Namit Jain
                Reporter:
                namit Namit Jain
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: