[RATIS-479] Load Generator Broken?

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Cannot Reproduce
• Assignee: Josh Elser
• Reporter: Clay B.
• Created: 31/Jan/19 23:22
• Updated: 05/Feb/19 20:37
• Resolved: 05/Feb/19 15:58

Description

Hi Josh, as mentioned in RATIS-463, it seems like RATIS-456 was working when applied as a patch during its merge but now breaks for my testing with the following perhaps due to the move to thirdparty?

Server processes are started via:

vagrant@ratis-server:~$ cat incubator-ratis/dev-support/vagrant/bin/start_ratis_server.sh |tail -3 | head -n2
cd /home/vagrant/incubator-ratis/
java -jar `find ./ -name 'ratis-examples*-SNAPSHOT.jar'` filestore server --storage $storage --id $id --peers $peers 2>&1 | tee ~/server_${id}.log

vagrant@ratis-server:~$ grep 'Exception in thread' server*.log
server_n0.log:Exception in thread "StateMachineUpdater-n0" java.lang.NoClassDefFoundError: org/apache/ratis/util/ExitUtils
server_n1.log:Exception in thread "n1-RaftLogWorker" Exception in thread "StateMachineUpdater-n1" java.lang.NoClassDefFoundError: org/apache/ratis/util/ExitUtils
server_n2.log:Exception in thread "org.apache.ratis.server.impl.LogAppender$$Lambda$155/1659649329@438afb89" java.lang.NoClassDefFoundError: org/apache/log4j/spi/ThrowableInformatio

The loadgen is started via:

vagrant@ratis-server:~$ cat incubator-ratis/dev-support/vagrant/bin/start_ratis_load_gen.sh |tail -3 | head -n2
cd /home/vagrant/incubator-ratis
./ratis-examples/src/main/bin/client.sh filestore loadgen --size 1048576 --numFiles 100 --peers $peers 2>&1 | tee ~/loadgen.log

vagrant@ratis-server:~$ grep 'Exception in thread' load*.log
loadgen.log:Exception in thread "main" java.util.concurrent.CompletionException: java.lang.NoClassDefFoundError: org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$9
server_n0.log:Exception in thread "StateMachineUpdater-n0" java.lang.NoClassDefFoundError: org/apache/ratis/util/ExitUtils
server_n1.log:Exception in thread "n1-RaftLogWorker" Exception in thread "StateMachineUpdater-n1" java.lang.NoClassDefFoundError: org/apache/ratis/util/ExitUtils
server_n2.log:Exception in thread "org.apache.ratis.server.impl.LogAppender$$Lambda$155/1659649329@438afb89" java.lang.NoClassDefFoundError: org/apache/log4j/spi/ThrowableInformation

I do see that these classes are present though:
ExitUtils:

incubator-ratis/ -name "*.jar" -a -exec jar -tf \{\} \; -a -print | egrep '.jar|org/apache/ratis/util/ExitUtils' | grep -B1 ExitUtils
/data/incubator-ratis/ratis-common/target/ratis-common-0.4.0-SNAPSHOT-tests.jar
org/apache/ratis/util/ExitUtils.class
org/apache/ratis/util/ExitUtils$States.class
org/apache/ratis/util/ExitUtils$ExitException.class
--
/data/incubator-ratis/ratis-proto/target/ratis-proto-0.4.0-SNAPSHOT-sources.jar
org/apache/ratis/util/ExitUtils.class
org/apache/ratis/util/ExitUtils$States.class
org/apache/ratis/util/ExitUtils$ExitException.class

And DelayedStream:

incubator-ratis/ -name "*.jar" -a -exec jar -tf \{\} \; -a -print | egrep '.jar|org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream' | grep -B1 DelayedStream
/data/incubator-ratis/ratis-proto/target/ratis-proto-0.4.0-SNAPSHOT-sources.jar
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$12.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$5.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$DelayedStreamListener$2.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$DelayedStreamListener$3.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$4.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$2.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$DelayedStreamListener.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$9.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$3.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$10.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$7.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$DelayedStreamListener$1.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$DelayedStreamListener$4.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$1.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$14.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$DelayedStreamListener$5.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$13.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$6.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$11.class
org/apache/ratis/thirdparty/io/grpc/internal/DelayedStream$8.class

 

Issue Links

• is related to: RATIS-480 Update documentation and scripts with new ratis-example usages