Details

      Description

      Recently the following test started to fail when run on S3:

       TestScratchLimit.test_with_low_scratch_limit[exec_option: {'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0, 'batch_size': 0, 'num_nodes': 0} | table_format: text/none] 
      [gw1] linux2 -- Python 2.6.6 /data/jenkins/workspace/impala-umbrella-build-and-test-s3/repos/Impala/bin/../infra/python/env/bin/python
      query_test/test_scratch_limit.py:67: in test_with_low_scratch_limit
          assert False, "Query was expected to fail"
      E   AssertionError: Query was expected to fail
      E   assert False
      ----------------------------- Captured stderr call -----------------------------
      SET scratch_limit=50m;
      SET max_block_mgr_memory=64m;
      SET batch_size=0;
      SET num_nodes=0;
      SET disable_codegen=False;
      SET abort_on_error=1;
      SET exec_single_node_rows_threshold=0;
      -- executing against localhost:21000
      
            select o_orderdate, o_custkey, o_comment
            from tpch.orders
            order by o_orderdate
            ;
      

        Activity

        Hide
        tarasbob Taras Bobrovytsky added a comment -

        Maybe this has to do with you recent commit

        IMPALA-3202,IMPALA-2079: rework scratch file I/O

        . Feel free to reassign.

        Show
        tarasbob Taras Bobrovytsky added a comment - Maybe this has to do with you recent commit IMPALA-3202,IMPALA-2079: rework scratch file I/O . Feel free to reassign.
        Hide
        tarmstrong Tim Armstrong added a comment -

        Hopefully this should prevent it reoccuring.

        IMPALA-4745: fix TestScratchLimit failure on S3

        The commit "IMPALA-3202,IMPALA-2079: rework scratch file I/O"
        improved efficiency of scratch file use in some scenarios.
        TestScratchLimit::test_with_low_scratch_limit started failing
        on S3, because it expects to use more than 50MB of scratch space.

        Testing:
        Ran the test in a loop locally for 50+ iterations - didn't see
        any failures.

        Change-Id: I607b4c6ad10eba0e6c7bc8d6e640d42da26ee6c8
        Reviewed-on: http://gerrit.cloudera.org:8080/5654
        Reviewed-by: Tim Armstrong <tarmstrong@cloudera.com>
        Tested-by: Impala Public Jenkins

        Show
        tarmstrong Tim Armstrong added a comment - Hopefully this should prevent it reoccuring. IMPALA-4745 : fix TestScratchLimit failure on S3 The commit " IMPALA-3202 , IMPALA-2079 : rework scratch file I/O" improved efficiency of scratch file use in some scenarios. TestScratchLimit::test_with_low_scratch_limit started failing on S3, because it expects to use more than 50MB of scratch space. Testing: Ran the test in a loop locally for 50+ iterations - didn't see any failures. Change-Id: I607b4c6ad10eba0e6c7bc8d6e640d42da26ee6c8 Reviewed-on: http://gerrit.cloudera.org:8080/5654 Reviewed-by: Tim Armstrong <tarmstrong@cloudera.com> Tested-by: Impala Public Jenkins

          People

          • Assignee:
            tarmstrong Tim Armstrong
            Reporter:
            tarasbob Taras Bobrovytsky
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development