[SENTRY-2075] Previous HMS event with incomplete message information is logged every 500ms

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.0.0
• Component/s: Sentry
• Assignee: Xinran Tinney
• Reporter: Sergio Peña
• Created: 27/Nov/17 23:28
• Updated: 16/Feb/18 19:17

Description

Sentry keeps logging the same invalid HMS event when such event has incomplete information (due to not using the Sentry JSON message factory for instance). This just causes a lot of noise on the log and also on the DB because keeps persisting the last ID seen.

The log issue goes away once Sentry detects a valid message and the DB is cleaned afterward.

Here's an example of the message logged every 500ms several times:

2017-11-27 23:22:12,019 ERROR org.apache.sentry.service.thrift.NotificationProcessor: Create table event has incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:12,529 ERROR org.apache.sentry.service.thrift.NotificationProcessor: Create table event has incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:13,021 ERROR org.apache.sentry.service.thrift.NotificationProcessor: Create table event has incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:13,529 ERROR org.apache.sentry.service.thrift.NotificationProcessor: Create table event has incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:14,023 ERROR org.apache.sentry.service.thrift.NotificationProcessor: Create table event has incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:14,524 ERROR org.apache.sentry.service.thrift.NotificationProcessor: Create table event has incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:15,027 ERROR org.apache.sentry.service.thrift.NotificationProcessor: Create table event has incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:15,529 ERROR org.apache.sentry.service.thrift.NotificationProcessor: Create table event has incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:16,028 ERROR org.apache.sentry.service.thrift.NotificationProcessor: Create table event has incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:16,530 ERROR org.apache.sentry.service.thrift.NotificationProcessor: Create table event has incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:17,029 ERROR org.apache.sentry.service.thrift.NotificationProcessor: Create table event has incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:17,528 ERROR org.apache.sentry.service.thrift.NotificationProcessor: Create table event has incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:18,031 ERROR org.apache.sentry.service.thrift.NotificationProcessor: Create table event has incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:18,532 ERROR org.apache.sentry.service.thrift.NotificationProcessor: Create table event has incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:19,026 ERROR org.apache.sentry.service.thrift.NotificationProcessor: Create table event has incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:19,522 ERROR org.apache.sentry.service.thrift.NotificationProcessor: Create table event has incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:20,027 ERROR org.apache.sentry.service.thrift.NotificationProcessor: Create table event has incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:20,527 ERROR org.apache.sentry.service.thrift.NotificationProcessor: Create table event has incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:21,023 ERROR org.apache.sentry.service.thrift.NotificationProcessor: Create table event has incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:21,530 ERROR org.apache.sentry.service.thrift.NotificationProcessor: Create table event has incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:22,030 ERROR org.apache.sentry.service.thrift.NotificationProcessor: Create table event has incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:22,531 ERROR org.apache.sentry.service.thrift.NotificationProcessor: Create table event has incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:23,031 ERROR org.apache.sentry.service.thrift.NotificationProcessor: Create table event has incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:23,530 ERROR org.apache.sentry.service.thrift.NotificationProcessor: Create table event has incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:24,023 ERROR org.apache.sentry.service.thrift.NotificationProcessor: Create table event has incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:24,512 ERROR org.apache.sentry.service.thrift.NotificationProcessor: Create table event has incomplete information. dbName = default, tableName = t1, location = null