[SENTRY-1429] TestHDFSIntegration improvements

• Type: Test
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.8.0, 2.0.0
• Component/s: Sentry, Test
• Assignee: Unassigned
• Reporter: Sravya Tirukkovalur
• Created: 27/Jul/16 16:52
• Updated: 13/Sep/18 17:00

Description

There are a few problems with this test that would be good to fix:
1. NN pulls the Sentry acls periodically, which means tests cannot verify acls as soon as it sets up the required privileges. This requires having sleeps in the test but it leads to some flakyness. We need to make sure we are actually sleeping after setting the permissions and before veryfying. Or explore other options to make this robust.
2. We need to make the tests more granular. There is a bunch of stuff happening in a single test, so it is hard to pinpoint why a test failed without looking at the stacktrace and debugging further.
3. Fix inter test dependencies if any. I see that some tests pass if run alone, but fail when the entire test class is run, so there might be some dependencies which we need to clean up.
4. Make these tests runnable on real cluster. So that we can catch any integration and configuration issues.

Issue Links

• is related to: SENTRY-1377 improve handling of failures, both in tests and after-test cleanup, in TestHDFSIntegration.java
• is required by: SENTRY-1430 Test Sentry HA Tasks

Sub-Tasks

• Fix intermittent time out issue for TestHDFSIntegration: Resolved
• improve handling of failures, both in tests and after-test cleanup, in TestHDFSIntegration.java: Resolved