[HDDS-2388] Teragen test failure due to OM exception

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 0.5.0
• Fix Version/s: 0.5.0
• Assignee: Hanisha Koneru
• Reporter: Shashikant Banerjee
• Created: 31/Oct/19 09:58
• Updated: 24/Feb/20 20:56
• Resolved: 09/Dec/19 16:21

Description

Ran into below exception while running teragen:

Unable to get delta updates since sequenceNumber 79932 
org.rocksdb.RocksDBException: Requested sequence not yet written in the db
	at org.rocksdb.RocksDB.getUpdatesSince(Native Method)
	at org.rocksdb.RocksDB.getUpdatesSince(RocksDB.java:3587)
	at org.apache.hadoop.hdds.utils.db.RDBStore.getUpdatesSince(RDBStore.java:338)
	at org.apache.hadoop.ozone.om.OzoneManager.getDBUpdates(OzoneManager.java:3283)
	at org.apache.hadoop.ozone.protocolPB.OzoneManagerRequestHandler.getOMDBUpdates(OzoneManagerRequestHandler.java:404)
	at org.apache.hadoop.ozone.protocolPB.OzoneManagerRequestHandler.handle(OzoneManagerRequestHandler.java:314)
	at org.apache.hadoop.ozone.protocolPB.OzoneManagerProtocolServerSideTranslatorPB.submitRequestDirectlyToOM(OzoneManagerProtocolServerSideTranslatorPB.java:219)
	at org.apache.hadoop.ozone.protocolPB.OzoneManagerProtocolServerSideTranslatorPB.processRequest(OzoneManagerProtocolServerSideTranslatorPB.java:134)
	at org.apache.hadoop.hdds.server.OzoneProtocolMessageDispatcher.processRequest(OzoneProtocolMessageDispatcher.java:72)
	at org.apache.hadoop.ozone.protocolPB.OzoneManagerProtocolServerSideTranslatorPB.submitRequest(OzoneManagerProtocolServerSideTranslatorPB.java:102)
	at org.apache.hadoop.ozone.protocol.proto.OzoneManagerProtocolProtos$OzoneManagerService$2.callBlockingMethod(OzoneManagerProtocolProtos.java)
	at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:528)
	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1070)
	at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:984)
	at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:912)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1876)
	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2882)

Issue Links

• is duplicated by: HDDS-2379 OM terminates with RocksDB error while continuously writing keys.