[SENTRY-664] After Namenode is restarted, Path updates remain unsynched

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.4.0
• Fix Version/s: 1.5.0
• Labels: sentry-hdfs
• Assignee: Arun Suresh
• Reporter: Arun Suresh
• Created: 04/Mar/15 00:49
• Updated: 18/Mar/15 05:21
• Resolved: 04/Mar/15 19:58

Description

Path updates remain un-synced after a Namenode restart.

Ideally, after a restart, the Namenode receives both the Path and Permission updates from sentry service. These updates are ordered by a sequence Id. Also the first Path/Permission update is supposed to be a FULL update.

From observing the logs, It looks like after namenode restart, the sequence of PathsUpdate objects do not start with a FULL update (The PermissionsUpdates are fine though). Thus the namenode remains unsynched with respect to path information.

A workaround is to restart the metastore after the namenode has restarted. This will ensure HMS will send a FULL update to Sentry. This will cause Sentry service will flush its existing update queue, so the next time the namenode asks for an update, this FULL update will be sent.

Issue Links

• links to: Review : https://reviews.apache.org/r/31722/