Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-2164

SequenceFile print wrong values with TextSerializerDeserializer

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.12.0, 0.11.4
    • Component/s: Storage
    • Labels:
      None

      Description

      Currently, SequenceFile print wrong values on tsql with TextSerializerDeserializer as follows.

      • Tajo version: 0.12.0-SNAPSHOT
      • Catalog: HiveCatalogStore
      • Dataset: TPC-H 1G
      • Create table on hive
        CREATE TABLE lineitem_p (
          l_orderkey int, 
          l_partkey int, 
          l_suppkey int, 
          l_linenumber int, 
          l_quantity double, 
          l_extendedprice double, 
          l_discount double, 
          l_tax double, 
          l_returnflag string, 
          l_linestatus string, 
          l_commitdate string, 
          l_shipinstruct string, 
          l_shipmode string, 
          l_comment string)
        PARTITIONED BY(l_shipdate string, l_receiptdate string)
        ROW FORMAT DELIMITED 
          FIELDS TERMINATED BY '\u0001' 
        STORED AS SEQUENCEFILE;
        
        INSERT OVERWRITE TABLE lineitem_p
        PARTITION (L_SHIPDATE, L_RECEIPTDATE)
        SELECT L_ORDERKEY, L_PARTKEY, L_SUPPKEY, L_LINENUMBER, L_QUANTITY, L_EXTENDEDPRICE, L_DISCOUNT, L_TAX, L_RETURNFLAG, L_LINESTATUS, L_COMMITDATE, L_SHIPINSTRUCT, L_SHIPMODE, L_COMMENT, L_SHIPDATE, L_RECEIPTDATE
        FROM LINEITEM
        WHERE L_SHIPDATE < '1992-03-01';
        
      • Bugs on tsql
        select * from lineitem_p limit 10;
        l_orderkey,  l_partkey,  l_suppkey,  l_linenumber,  l_quantity,  l_extendedprice,  l_discount,  l_tax,  l_returnflag,  l_linestatus,  l_commitdate,  l_shipinstruct,  l_shipmode,  l_comment,  l_shipdate,  l_receiptdate
        -------------------------------
        ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  1992-01-02,  1992-01-05
        ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  1992-01-02,  1992-01-07
        ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  1992-01-02,  1992-01-09
        ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  1992-01-02,  1992-01-11
        ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  1992-01-02,  1992-01-14
        ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  1992-01-02,  1992-01-15
        ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  1992-01-02,  1992-01-15
        ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  1992-01-02,  1992-01-15
        ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  1992-01-02,  1992-01-15
        ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  ,  1992-01-02,  1992-01-18
        (10 rows, 2.75 sec, 0 B selected)
        

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                blrunner JaeHwa Jung
                Reporter:
                blrunner JaeHwa Jung
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: