Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 1.0.0
    • Fix Version/s: 1.1.0
    • Component/s: deployment
    • Labels:
      None

      Description

      Puppet recipe for YCSB(BIGTOP-1920)

        Issue Links

          Activity

          Hide
          githubbot ASF GitHub Bot added a comment -

          GitHub user youngwookim opened a pull request:

          https://github.com/apache/bigtop/pull/20

          BIGTOP-1921. Puppet recipe for YCSB

          You can merge this pull request into a Git repository by running:

          $ git pull https://github.com/youngwookim/bigtop BIGTOP-1921

          Alternatively you can review and apply these changes as the patch at:

          https://github.com/apache/bigtop/pull/20.patch

          To close this pull request, make a commit to your master/trunk branch
          with (at least) the following in the commit message:

          This closes #20


          commit ff5166e37e3b524f8905185ac8ca651b5c507ba9
          Author: YoungWoo Kim <ywkim@apache.org>
          Date: 2015-07-09T05:58:01Z

          BIGTOP-1921. Puppet recipe for YCSB


          Show
          githubbot ASF GitHub Bot added a comment - GitHub user youngwookim opened a pull request: https://github.com/apache/bigtop/pull/20 BIGTOP-1921 . Puppet recipe for YCSB You can merge this pull request into a Git repository by running: $ git pull https://github.com/youngwookim/bigtop BIGTOP-1921 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/bigtop/pull/20.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #20 commit ff5166e37e3b524f8905185ac8ca651b5c507ba9 Author: YoungWoo Kim <ywkim@apache.org> Date: 2015-07-09T05:58:01Z BIGTOP-1921 . Puppet recipe for YCSB
          Hide
          warwithin YoungWoo Kim added a comment - - edited

          Notes regarding running test on vagrant-puppet-vm:
          With this patch, you can boot up a VM

          $ cd $BIGTOP_HOME/......./vagrant-puppet-vm/
          $ export REPO="http://hostname/path/to"
          $ export COMPONENTS="[hadoop, yarn, hbase, ycsb]"
          
          $ vagrant up
          $ vagrant ssh
          

          Ans then, steps to run YCSB on the VM:

          First, you should create a hbase table for YCSB:

          $ hbase shell
          
          hbase(main):001:0> create 'usertable', {NAME=>'cf'}
          
          vagrant$ export YCSB_HOME=/usr/lib/ycsb
          vagrant$ sudo cp -f /etc/hbase/conf/hbase-site.xml $YCSB_HOME/hbase-binding/conf/ 
          
          vagrant$ cd $YCSB_HOME
          
          vagrant$ bin/ycsb load hbase -p table=usertable -p columnfamily=cf -P workloads/workloada
          
          vagrant$ bin/ycsb run hbase -p table=usertable -p columnfamily=cf -P workloads/workloada -s > /tmp/transactions.dat
          
          vagrant$ cat /tmp/trasactions.dat
          YCSB Client 0.1
          Command line: -db com.yahoo.ycsb.db.HBaseClient -p table=usertable -p columnfamily=cf -P workloads/workloada -s -t
          [OVERALL], RunTime(ms), 2898.0
          [OVERALL], Throughput(ops/sec), 345.0655624568668
          [UPDATE], Operations, 492
          [UPDATE], AverageLatency(us), 103.2560975609756
          [UPDATE], MinLatency(us), 0
          [UPDATE], MaxLatency(us), 4266
          [UPDATE], 95thPercentileLatency(ms), 0
          [UPDATE], 99thPercentileLatency(ms), 1
          [UPDATE], Return=0, 492
          [UPDATE], 0, 486
          [UPDATE], 1, 3
          [UPDATE], 2, 1
          
          ...
          

          For more information, please visit YCSB wiki, https://github.com/brianfrankcooper/YCSB/wiki You'll find information about workloads and detailed configurations.

          Show
          warwithin YoungWoo Kim added a comment - - edited Notes regarding running test on vagrant-puppet-vm: With this patch, you can boot up a VM $ cd $BIGTOP_HOME/......./vagrant-puppet-vm/ $ export REPO="http://hostname/path/to" $ export COMPONENTS="[hadoop, yarn, hbase, ycsb]" $ vagrant up $ vagrant ssh Ans then, steps to run YCSB on the VM: First, you should create a hbase table for YCSB: $ hbase shell hbase(main):001:0> create 'usertable', {NAME=>'cf'} vagrant$ export YCSB_HOME=/usr/lib/ycsb vagrant$ sudo cp -f /etc/hbase/conf/hbase-site.xml $YCSB_HOME/hbase-binding/conf/ vagrant$ cd $YCSB_HOME vagrant$ bin/ycsb load hbase -p table=usertable -p columnfamily=cf -P workloads/workloada vagrant$ bin/ycsb run hbase -p table=usertable -p columnfamily=cf -P workloads/workloada -s > /tmp/transactions.dat vagrant$ cat /tmp/trasactions.dat YCSB Client 0.1 Command line: -db com.yahoo.ycsb.db.HBaseClient -p table=usertable -p columnfamily=cf -P workloads/workloada -s -t [OVERALL], RunTime(ms), 2898.0 [OVERALL], Throughput(ops/sec), 345.0655624568668 [UPDATE], Operations, 492 [UPDATE], AverageLatency(us), 103.2560975609756 [UPDATE], MinLatency(us), 0 [UPDATE], MaxLatency(us), 4266 [UPDATE], 95thPercentileLatency(ms), 0 [UPDATE], 99thPercentileLatency(ms), 1 [UPDATE], Return=0, 492 [UPDATE], 0, 486 [UPDATE], 1, 3 [UPDATE], 2, 1 ... For more information, please visit YCSB wiki, https://github.com/brianfrankcooper/YCSB/wiki You'll find information about workloads and detailed configurations.
          Hide
          jayunit100 jay vyas added a comment -

          Looks got to me pending BIGTOP-1920 merger, +1

          Show
          jayunit100 jay vyas added a comment - Looks got to me pending BIGTOP-1920 merger, +1
          Hide
          warwithin YoungWoo Kim added a comment -

          Committed and pushed! jay vyas, Thank you for reviewing the patch.

          Show
          warwithin YoungWoo Kim added a comment - Committed and pushed! jay vyas , Thank you for reviewing the patch.

            People

            • Assignee:
              warwithin YoungWoo Kim
              Reporter:
              warwithin YoungWoo Kim
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development