[TAJO-2164] SequenceFile print wrong values with TextSerializerDeserializer

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.12.0, 0.11.4
• Component/s: Storage
• Assignee: JaeHwa Jung
• Reporter: JaeHwa Jung
• Created: 27/May/16 08:17
• Updated: 06/Jul/16 16:38
• Resolved: 06/Jul/16 15:24

Description

Currently, SequenceFile print wrong values on tsql with TextSerializerDeserializer as follows.

• Tajo version: 0.12.0-SNAPSHOT
• Catalog: HiveCatalogStore
• Dataset: TPC-H 1G
• Create table on hive

  CREATE TABLE lineitem_p (
    l_orderkey int, 
    l_partkey int, 
    l_suppkey int, 
    l_linenumber int, 
    l_quantity double, 
    l_extendedprice double, 
    l_discount double, 
    l_tax double, 
    l_returnflag string, 
    l_linestatus string, 
    l_commitdate string, 
    l_shipinstruct string, 
    l_shipmode string, 
    l_comment string)
  PARTITIONED BY(l_shipdate string, l_receiptdate string)
  ROW FORMAT DELIMITED 
    FIELDS TERMINATED BY '\u0001' 
  STORED AS SEQUENCEFILE;
  
  INSERT OVERWRITE TABLE lineitem_p
  PARTITION (L_SHIPDATE, L_RECEIPTDATE)
  SELECT L_ORDERKEY, L_PARTKEY, L_SUPPKEY, L_LINENUMBER, L_QUANTITY, L_EXTENDEDPRICE, L_DISCOUNT, L_TAX, L_RETURNFLAG, L_LINESTATUS, L_COMMITDATE, L_SHIPINSTRUCT, L_SHIPMODE, L_COMMENT, L_SHIPDATE, L_RECEIPTDATE
  FROM LINEITEM
  WHERE L_SHIPDATE < '1992-03-01';
  

• Bugs on tsql

  select * from lineitem_p limit 10;
  l_orderkey,  l_partkey,  l_suppkey,  l_linenumber,  l_quantity,  l_extendedprice,  l_discount,  l_tax,  l_returnflag,  l_linestatus,  l_commitdate,  l_shipinstruct,  l_shipmode,  l_comment,  l_shipdate,  l_receiptdate
  -------------------------------
  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  1992-01-02,  1992-01-05
  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  1992-01-02,  1992-01-07
  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  1992-01-02,  1992-01-09
  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  1992-01-02,  1992-01-11
  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  1992-01-02,  1992-01-14
  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  1992-01-02,  1992-01-15
  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  1992-01-02,  1992-01-15
  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  1992-01-02,  1992-01-15
  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  1992-01-02,  1992-01-15
  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  1992-01-02,  1992-01-18
  (10 rows, 2.75 sec, 0 B selected)
  

Issue Links

• links to: GitHub Pull Request #1033