[IMPALA-10990] org.apache.impala.analysis.AnalyzeDDLTest.TestCreateTableLikeFile is flaky

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: Frontend
• Epic Color: ghx-label-14
• Assignee: Norbert Luksa
• Reporter: Tamas Mate
• Created: 28/Oct/21 08:21
• Updated: 23/May/22 14:39

Description

org.apache.impala.analysis.AnalyzeDDLTest.TestCreateTableLikeFile failed in the latest UBSAN build with the following stack:

java.lang.AssertionError:
got error:
Cannot infer schema, path does not exist: hdfs://localhost:20500/test-warehouse/zipcode_incomes_rc/000000_0
expected:
File is not a parquet file: hdfs://localhost:20500/test-warehouse/zipcode_incomes_rc/000000_0
        at org.junit.Assert.fail(Assert.java:88)
        at org.junit.Assert.assertTrue(Assert.java:41)
        at org.apache.impala.common.FrontendTestBase.AnalysisError(FrontendTestBase.java:303)
        at org.apache.impala.common.FrontendTestBase.AnalysisError(FrontendTestBase.java:278)
        at org.apache.impala.analysis.AnalyzeDDLTest.TestCreateTableLikeFile(AnalyzeDDLTest.java:2085)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

The test is looking for a file, but the file was created with _1 suffix instead of the expected _0, probably there were some hiccup during data loading:

    // check valid paths with bad file contents
    AnalysisError("create table database_DNE.newtbl_DNE like parquet " +
        "'/test-warehouse/zipcode_incomes_rc/000000_0'",
        "File is not a parquet file: " +
        "hdfs://localhost:20500/test-warehouse/zipcode_incomes_rc/000000_0");

./file-list-begin-1.log:26673:drwxr-xr-x   - jenkins supergroup          0 2021-10-25 23:22 /test-warehouse/zipcode_incomes_rc
./file-list-begin-1.log:26674:-rw-r--r--   3 jenkins supergroup    2024361 2021-10-25 23:22 /test-warehouse/zipcode_incomes_rc/000000_1
...
./file-list-end-1.log:27829:drwxr-xr-x   - jenkins supergroup          0 2021-10-25 23:22 /test-warehouse/zipcode_incomes_rc
./file-list-end-1.log:27830:-rw-r--r--   3 jenkins supergroup    2024361 2021-10-25 23:22 /test-warehouse/zipcode_incomes_rc/000000_1

Issue Links

• relates to: IMPALA-9351 AnalyzeDDLTest.TestCreateTableLikeFileOrc failed due to non-existing path