[IMPALA-9996] An S3 test failing with ResourceNotFoundException

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Duplicate
• Labels: broken-build flaky
• Epic Color: ghx-label-9
• Assignee: Sahil Takiar
• Reporter: Fang-Yu Rao
• Created: 23/Jul/20 04:27
• Updated: 23/Jul/20 16:02
• Resolved: 23/Jul/20 16:02

Description

In a recent S3 build, we have seen that test_tpcds_count (https://github.com/apache/impala/blob/master/testdata/workloads/tpcds/queries/count.test#L114-L119) failed with ResourceNotFoundException.

The issue may be related to IMPALA-9058.

The error message in impalad.INFO (under the directory of ee_tests) is as follows.

I0722 10:31:44.524209 13047 coordinator.cc:684] ExecState: query id=7d4f684028848784:ad2f6f0e00000000 finstance=7d4f684028848784:ad2f6f0e00000001 on host=impala-ec2-centos74-m5-4xlarge-ondemand-1230.vpc.cloudera.com:22002 (EXECUTING -> ERROR) status=Disk I/O error on impala-ec2-centos74-m5-4xlarge-ondemand-1230.vpc.cloudera.com:22002: Failed to open HDFS file s3a://impala-test-uswest2-1/test-warehouse/tpcds.store_sales_parquet/ss_sold_date_sk=2451752/d245f3a054fd2c66-f7f7052200000004_1984874558_data.0.parq
Error(2): No such file or directory
Root cause: ResourceNotFoundException: Requested resource not found (Service: AmazonDynamoDBv2; Status Code: 400; Error Code: ResourceNotFoundException; Request ID: G9QMA17VTSIKOQK33V9TDGMF13VV4KQNSO5AEMVJF66Q9ASUAAJG)

Maybe stakiar and joemcdonnell could offer some insight into it. Thanks!

Issue Links

• duplicates: IMPALA-8754 S3 with S3Guard tests encounter "ResourceNotFoundException" from DynamoDB
• duplicates: IMPALA-9058 S3 tests failing with FileNotFoundException getVersionMarkerItem on ../VERSION