[IMPALA-2853] full data load failure: garbage in load-functional-*.sql file

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 2.5.0
• Fix Version/s: Impala 2.5.0
• Component/s: Infrastructure
• Labels: broken-build
• Target Version: Impala 2.5.0
• Assignee: Tim Armstrong
• Reporter: Daniel Hecht
• Created: 14/Jan/16 21:27
• Updated: 20/Jan/16 05:42
• Resolved: 20/Jan/16 05:42

Description

00:29:32.177 Force loading functional because a schema change was detected
00:29:32.177 Loading workload 'functional-query' Using exploration strategy 'exhaustive'. Logging to /srv/jenkins/workspace/impala-master-cdh5-trunk-ASAN/repos/Impala/cluster_logs/data_loading/data-load-functional-exhaustive.log
01:48:54.781 Error loading data. The end of the log file is:
01:48:54.822 java.io.EOFException: Premature EOF: no length prefix available
01:48:54.822 	at org.apache.hadoop.hdfs.protocolPB.PBHelper.vintPrefixed(PBHelper.java:2241)
01:48:54.822 	at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.createBlockOutputStream(DFSOutputStream.java:1541)
01:48:54.822 	at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1463)
01:48:54.822 	at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:673)
01:48:54.822 2016-01-14 03:09:29,300 INFO  [Thread-5] hdfs.DFSClient (DFSOutputStream.java:nextBlockOutputStream(1466)) - Abandoning BP-1579735049-127.0.0.1-1452768556449:blk_1073749234_8410
01:48:54.822 2016-01-14 03:09:29,315 INFO  [Thread-5] hdfs.DFSClient (DFSOutputStream.java:nextBlockOutputStream(1470)) - Excluding datanode DatanodeInfoWithStorage[127.0.0.1:31001,DS-84076dd6-8678-41a4-a273-11d957adc929,DISK]
01:48:54.822 
01:48:54.822 INSERT OVERWRITE TABLE functional_parquet.dimtbl SELECT * FROM functional.dimtbl
01:48:54.822 
01:48:54.822 Data Loading from Impala failed with error: ImpalaBeeswaxException:
01:48:54.822  INNER EXCEPTION: <class 'impala._thrift_gen.beeswax.ttypes.BeeswaxException'>
01:48:54.822  MESSAGE: AnalysisException: Syntax error in line 1:
01:48:54.822 2016-01-14 03:09:29,295 INFO...
01:48:54.822 ^
01:48:54.822 Encountered: INTEGER LITERAL
01:48:54.822 Expected: ALTER, COMPUTE, CREATE, DESCRIBE, DROP, EXPLAIN, GRANT, INSERT, INVALIDATE, LOAD, REFRESH, REVOKE, SELECT, SET, SHOW, TRUNCATE, USE, VALUES, WITH
01:48:54.822 
01:48:54.822 CAUSED BY: Exception: Syntax error
01:48:54.822 
01:48:54.826 Error in /srv/jenkins/workspace/impala-master-cdh5-trunk-ASAN/repos/Impala/testdata/bin/create-load-data.sh at line 145: return 1
01:48:54.830 Error in /srv/jenkins/workspace/impala-master-cdh5-trunk-ASAN/repos/Impala/buildall.sh at line 373: ${IMPALA_HOME}/testdata/bin/create-load-data.sh ${CREATE_LOAD_DATA_ARGS} <<< Y
01:48:54.831 + echo 'buildall.sh ' -asan -skiptests -format_cluster '-snapshot_file /srv/jenkins/workspace/impala-master-cdh5-trunk-ASAN/testdata/test-warehouse-SNAPSHOT/test-warehouse-cdh5-780-SNAPSHOT.tar.gz' '-metastore_snapshot_file /srv/jenkins/workspace/impala-master-cdh5-trunk-ASAN/testdata/hive_metastore_snapshot/hive_impala_dump_cdh5-780.txt failed.'
01:48:54.831 buildall.sh  -asan -skiptests -format_cluster -snapshot_file /srv/jenkins/workspace/impala-master-cdh5-trunk-ASAN/testdata/test-warehouse-SNAPSHOT/test-warehouse-cdh5-780-SNAPSHOT.tar.gz -metastore_snapshot_file /srv/jenkins/workspace/impala-master-cdh5-trunk-ASAN/testdata/hive_metastore_snapshot/hive_impala_dump_cdh5-780.txt failed.