Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-672

Wrong progress status when overwrites to partition table

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Trivial
    • Resolution: Fixed
    • Affects Version/s: 0.8.0, 0.9.0
    • Fix Version/s: 0.8.0, 0.9.0
    • Component/s: Data Shuffle
    • Labels:
      None

      Description

      I ran next query in cli. Progress is over 100% and then down to 97%. But finally finished at 100%.

      create table orders_partition (
      o_orderkey      INT8,
      o_custkey       INT8,
      o_orderstatus   TEXT,
      o_totalprice    FLOAT8,
      o_orderdate     TEXT,
      o_orderpriority TEXT,
      o_clerk TEXT,
      o_shippriority  INT4,
      o_comment       TEXT)
      partition by column (o_year text, o_month text);
      
      insert overwrite into orders_partition 
      select o_orderkey, o_custkey, o_orderstatus, o_totalprice, 
      o_orderdate, o_orderpriority, o_clerk, o_shippriority, o_comment, substr(o_orderdate, 1, 4), substr(o_orderdate , 6, 2) 
      from orders;
      
      Progress: 95%, response time: 73.572 sec
      Progress: 95%, response time: 74.573 sec
      Progress: 95%, response time: 75.574 sec
      Progress: 96%, response time: 76.576 sec
      Progress: 96%, response time: 77.578 sec
      Progress: 96%, response time: 78.58 sec
      Progress: 100%, response time: 79.581 sec
      Progress: 100%, response time: 80.582 sec
      Progress: 101%, response time: 81.584 sec
      Progress: 101%, response time: 82.586 sec
      Progress: 101%, response time: 83.587 sec
      Progress: 101%, response time: 84.589 sec
      Progress: 101%, response time: 85.591 sec
      Progress: 101%, response time: 86.593 sec
      Progress: 102%, response time: 87.595 sec
      Progress: 102%, response time: 88.596 sec
      Progress: 102%, response time: 89.598 sec
      Progress: 102%, response time: 90.601 sec
      Progress: 102%, response time: 91.603 sec
      Progress: 102%, response time: 92.605 sec
      Progress: 102%, response time: 93.607 sec
      Progress: 97%, response time: 94.608 sec
      Progress: 97%, response time: 95.61 sec
      

        Attachments

        1. TAJO-672.patch
          2 kB
          Hyoungjun Kim

          Activity

            People

            • Assignee:
              hjkim Hyoungjun Kim
              Reporter:
              hjkim Hyoungjun Kim
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: