[BIGTOP-3416] Fix YCSB to work with CentOS 8 and Fedora 31

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Assignee: Kengo Seki
• Reporter: Kengo Seki
• Created: 25/Sep/20 12:49
• Updated: 30/Sep/20 04:06
• Resolved: 30/Sep/20 04:06

Description

Deploying YCSB onto CentOS 8 fails with the following error:
https://ci.bigtop.apache.org/job/Bigtop-trunk-smoke-tests/170/COMPONENTS=hdfs.hbase.hbase.ycsb@ycsb,OS=centos-8-x86_64-deploy/console

Error: Could not update: Execution of '/usr/bin/dnf -d 0 -e 1 -y install ycsb' returned 1: Error: 
 Problem: conflicting requests
  - nothing provides python needed by ycsb-0.12.0-1.el8.noarch
Error: /Stage[main]/Ycsb::Client/Package[ycsb]/ensure: change from 'purged' to 'latest' failed: Could not update: Execution of '/usr/bin/dnf -d 0 -e 1 -y install ycsb' returned 1: Error: 
 Problem: conflicting requests
  - nothing provides python needed by ycsb-0.12.0-1.el8.noarch

And its smoke test fails with the following error on Fedora 31:
https://ci.bigtop.apache.org/job/Bigtop-trunk-smoke-tests/170/COMPONENTS=hdfs.hbase.hbase.ycsb@ycsb,OS=fedora-31-aarch64-deploy/console
https://ci.bigtop.apache.org/job/Bigtop-trunk-smoke-tests/170/COMPONENTS=hdfs.hbase.hbase.ycsb@ycsb,OS=fedora-31-x86_64-deploy/console

TestYcsbSmoke > BasicDBTest STANDARD_OUT
    Failed command: ycsb load basic -P /usr/lib/ycsb/workloads/workloada -p recordcount=500000 -s > load_basic.dat
    	error code: 1
    	stdout: []
    	stderr: [  File "/usr/lib/ycsb/bin/ycsb", line 208,     except subprocess.CalledProcessError, err:,                                         ^, SyntaxError: invalid syntax]

TestYcsbSmoke > BasicDBTest FAILED
    java.lang.AssertionError: YCSB basic load failed.[] [  File "/usr/lib/ycsb/bin/ycsb", line 208,     except subprocess.CalledProcessError, err:,                                         ^, SyntaxError: invalid syntax]
        at org.junit.Assert.fail(Assert.java:88)
        at org.junit.Assert.assertTrue(Assert.java:41)
        at org.junit.Assert$assertTrue.callStatic(Unknown Source)
        at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallStatic(CallSiteArray.java:55)
        at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callStatic(AbstractCallSite.java:196)
        at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callStatic(AbstractCallSite.java:216)
        at TestYcsbSmoke.BasicDBTest(TestYcsbSmoke.groovy:65)

Gradle Test Executor 2 finished executing tests.

> Task :bigtop-tests:smoke-tests:ycsb:test FAILED

TestYcsbSmoke > HbaseTest STANDARD_OUT
    Failed command: ycsb load hbase10 -P /usr/lib/ycsb/workloads/workloada -p table=usertable -p columnfamily=cf -p recordcount=500000 -p operationcount=500000 -threads 10 
    	error code: 1
    	stdout: []
    	stderr: [  File "/usr/lib/ycsb/bin/ycsb", line 208,     except subprocess.CalledProcessError, err:,                                         ^, SyntaxError: invalid syntax]

TestYcsbSmoke > HbaseTest FAILED
    java.lang.AssertionError: YCSB HBase load failed.[] [  File "/usr/lib/ycsb/bin/ycsb", line 208,     except subprocess.CalledProcessError, err:,                                         ^, SyntaxError: invalid syntax]
        at org.junit.Assert.fail(Assert.java:88)
        at org.junit.Assert.assertTrue(Assert.java:41)
        at org.junit.Assert$assertTrue.callStatic(Unknown Source)
        at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallStatic(CallSiteArray.java:55)
        at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callStatic(AbstractCallSite.java:196)
        at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callStatic(AbstractCallSite.java:216)
        at TestYcsbSmoke.HbaseTest(TestYcsbSmoke.groovy:88)

2 tests completed, 2 failed

Issue Links

• links to: https://github.com/apache/bigtop/pull/681