[YARN-7514] TestAggregatedLogDeletionService.testRefreshLogRetentionSettings is flaky

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.0.0-beta1
• Component/s: log-aggregation
• Assignee: Unassigned
• Reporter: Haibo Chen
• Created: 16/Nov/17 18:14
• Updated: 07/Mar/19 18:11

Description

TestAggregatedLogDeletionService.testRefreshLogRetentionSettings fails occasionally with

Error Message

Argument(s) are different! Wanted:
fileSystem.delete(
mockfs://foo/tmp/logs/me/logs/application_1510201418065_0002,
true
);
-> at org.apache.hadoop.yarn.logaggregation.TestAggregatedLogDeletionService.testRefreshLogRetentionSettings(TestAggregatedLogDeletionService.java:300)
Actual invocation has different arguments:
fileSystem.delete(
mockfs://foo/tmp/logs/me/logs/application_1510201418024_0001,
true
);
-> at org.apache.hadoop.fs.FilterFileSystem.delete(FilterFileSystem.java:252)

Stacktrace

org.mockito.exceptions.verification.junit.ArgumentsAreDifferent:

Argument(s) are different! Wanted:
fileSystem.delete(
mockfs://foo/tmp/logs/me/logs/application_1510201418065_0002,
true
);
-> at org.apache.hadoop.yarn.logaggregation.TestAggregatedLogDeletionService.testRefreshLogRetentionSettings(TestAggregatedLogDeletionService.java:300)
Actual invocation has different arguments:
fileSystem.delete(
mockfs://foo/tmp/logs/me/logs/application_1510201418024_0001,
true
);
-> at org.apache.hadoop.fs.FilterFileSystem.delete(FilterFileSystem.java:252)

at org.apache.hadoop.yarn.logaggregation.TestAggregatedLogDeletionService.testRefreshLogRetentionSettings(TestAggregatedLogDeletionService.java:300)

Standard Output

2017-11-08 20:23:38,138 INFO [Timer-0] logaggregation.AggregatedLogDeletionService (AggregatedLogDeletionService.java:run(79)) - aggregated log deletion started.
2017-11-08 20:23:38,146 INFO [Timer-0] logaggregation.AggregatedLogDeletionService (AggregatedLogDeletionService.java:deleteOldLogDirsFrom(106)) - Deleting aggregated logs in mockfs://foo/tmp/logs/me/logs/application_1510201418024_0001
2017-11-08 20:23:38,146 INFO [Timer-0] logaggregation.AggregatedLogDeletionService (AggregatedLogDeletionService.java:run(92)) - aggregated log deletion finished.
2017-11-08 20:23:38,167 INFO [Timer-1] logaggregation.AggregatedLogDeletionService (AggregatedLogDeletionService.java:run(79)) - aggregated log deletion started.
2017-11-08 20:23:38,172 INFO [Timer-1] logaggregation.AggregatedLogDeletionService (AggregatedLogDeletionService.java:deleteOldLogDirsFrom(106)) - Deleting aggregated logs in mockfs://foo/tmp/logs/me/logs/application_1510201418024_0001
2017-11-08 20:23:38,173 INFO [Timer-1] logaggregation.AggregatedLogDeletionService (AggregatedLogDeletionService.java:deleteOldLogDirsFrom(106)) - Deleting aggregated logs in mockfs://foo/tmp/logs/me/logs/application_1510201418065_0002
2017-11-08 20:23:38,181 INFO [Timer-1] logaggregation.AggregatedLogDeletionService (AggregatedLogDeletionService.java:run(92)) - aggregated log deletion finished.