[IMPALA-4322] test_scanners_fuzz.py hits a DCHECK

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: Impala 2.8.0
• Fix Version/s: Impala 2.8.0
• Component/s: Backend
• Labels: broken-build
• Assignee: Sailesh Mukil
• Reporter: Taras Bobrovytsky
• Created: 19/Oct/16 01:23
• Updated: 01/Nov/16 18:45
• Resolved: 25/Oct/16 18:13

Description

Nightly exhaustive builds are failing. From the Jenkis console:

ERROR query_test/test_scanners_fuzz.py::TestScannersFuzzing::()::test_fuzz_alltypes[exec_option: {'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0, 'batch_size': 0, 'num_nodes': 0} | table_format: text/lzo/block]

It looks like this has something to do with the lzo scanner.
From impalad.FATAL:

F1018 15:45:14.758010  7262 hdfs-lzo-text-scanner.cc:236] Check failed: read_until >       unprocessed_bytes (0 vs. ^A) 
F1018 15:45:14.781767  7254 hdfs-lzo-text-scanner.cc:236] Check failed: read_until >       unprocessed_bytes (0 vs. ^E)

http://sandbox.jenkins.cloudera.com/view/Impala/view/Evergreen-asf-master/job/impala-asf-master-exhaustive/98/

Another strange thing is that 3 minidumps get produced and saved in our logs (1 for every Impalad), but a core dump does not get generated. A core dump should be generated if a DCHECK is hit.