[SAMZA-870] RocksDBException: Invalid argument: Compression type Snappy is not linked with the binary

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.10.1
• Component/s: kv-store

Environment

RedHat Enterprise Linux 6.6, Java 8 (Oracle 1.8.0_40)

• Assignee: Navina Ramesh
• Reporter: Edi Bice
• Created: 09/Feb/16 14:44
• Updated: 27/May/16 22:44

Description

I'm running latest from master with a small patch to allow for additional RocksDB configuration. All my jobs (which involve KV stores) fail with the following:

org.apache.samza.SamzaException: Error opening RocksDB store xxx-store/Partition_6, received the following exception from RocksDB org.rocksdb.RocksDBException: Invalid argument: Compression type Snappy is not linked with the binary.
at org.apache.samza.storage.kv.RocksDbKeyValueStore$.openDB(RocksDbKeyValueStore.scala:81)
at org.apache.samza.storage.kv.RocksDbKeyValueStore.db$lzycompute(RocksDbKeyValueStore.scala:103)
at org.apache.samza.storage.kv.RocksDbKeyValueStore.db(RocksDbKeyValueStore.scala:103)
at org.apache.samza.storage.kv.RocksDbKeyValueStore.flush(RocksDbKeyValueStore.scala:195)
at org.apache.samza.storage.kv.LoggedStore.flush(LoggedStore.scala:107)
at org.apache.samza.storage.kv.SerializedKeyValueStore.flush(SerializedKeyValueStore.scala:117)
at org.apache.samza.storage.kv.CachedStore.flush(CachedStore.scala:194)
at org.apache.samza.storage.kv.NullSafeKeyValueStore.flush(NullSafeKeyValueStore.scala:82)
at org.apache.samza.storage.kv.KeyValueStorageEngine.flush(KeyValueStorageEngine.scala:123)
at org.apache.samza.storage.kv.KeyValueStorageEngine.close(KeyValueStorageEngine.scala:135)
at org.apache.samza.storage.kv.KeyValueStorageEngine.stop(KeyValueStorageEngine.scala:129)
at org.apache.samza.storage.TaskStorageManager$$anonfun$stopStores$2.apply(TaskStorageManager.scala:193)
at org.apache.samza.storage.TaskStorageManager$$anonfun$stopStores$2.apply(TaskStorageManager.scala:193)
at scala.collection.Iterator$class.foreach(Iterator.scala:727)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)
at scala.collection.MapLike$DefaultValuesIterable.foreach(MapLike.scala:206)
at org.apache.samza.storage.TaskStorageManager.stopStores(TaskStorageManager.scala:193)
at org.apache.samza.storage.TaskStorageManager.stop(TaskStorageManager.scala:197)
at org.apache.samza.container.TaskInstance.shutdownStores(TaskInstance.scala:203)
at org.apache.samza.container.SamzaContainer$$anonfun$shutdownStores$2.apply(SamzaContainer.scala:689)
at org.apache.samza.container.SamzaContainer$$anonfun$shutdownStores$2.apply(SamzaContainer.scala:689)
at scala.collection.Iterator$class.foreach(Iterator.scala:727)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)
at scala.collection.MapLike$DefaultValuesIterable.foreach(MapLike.scala:206)
at org.apache.samza.container.SamzaContainer.shutdownStores(SamzaContainer.scala:689)
at org.apache.samza.container.SamzaContainer.run(SamzaContainer.scala:568)
at org.apache.samza.container.SamzaContainer$.safeMain(SamzaContainer.scala:93)
at org.apache.samza.container.SamzaContainer$.main(SamzaContainer.scala:67)
at org.apache.samza.container.SamzaContainer.main(SamzaContainer.scala)

Issue Links

• depends upon: SAMZA-955 Upgrade RocksDB JNI to 4.5.1