Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 1.0.0
    • Fix Version/s: 1.1.0
    • Component/s: None
    • Labels:
      None

      Description

      Yahoo! Cloud Serving Benchmark (YCSB) [1][2] is a widely used benchmark tool for NoSQL databases and other data stores. It would be useful if Bigtop has that as a component to provide a benchmark tool for Apache HBase. Currently there is no YCSB binding for Apache Phoenix but Hopefully, Phoenix would use it to benchmark and evaluate the performance in near future

      [1] https://github.com/brianfrankcooper/YCSB/wiki
      [2] http://labs.yahoo.com/news/yahoo-cloud-serving-benchmark/

      1. BIGTOP-1920.patch
        15 kB
        YoungWoo Kim

        Issue Links

          Activity

          Hide
          evans_ye Evans Ye added a comment -

          Would be great to have this. We can use YCSB with small samples for HBase smoke test as well.

          Show
          evans_ye Evans Ye added a comment - Would be great to have this. We can use YCSB with small samples for HBase smoke test as well.
          Hide
          warwithin YoungWoo Kim added a comment -

          Found a PR for Apache Phoenix binding, https://github.com/brianfrankcooper/YCSB/pull/178 But, with the way that Sean Busbey commented Phoenix might work with generic JDBC binding.

          Show
          warwithin YoungWoo Kim added a comment - Found a PR for Apache Phoenix binding, https://github.com/brianfrankcooper/YCSB/pull/178 But, with the way that Sean Busbey commented Phoenix might work with generic JDBC binding.
          Hide
          warwithin YoungWoo Kim added a comment - - edited

          Good idea! it's worth a try. Filed BIGTOP-1921 & BIGTOP-1922

          Show
          warwithin YoungWoo Kim added a comment - - edited Good idea! it's worth a try. Filed BIGTOP-1921 & BIGTOP-1922
          Hide
          busbey Sean Busbey added a comment -

          my comment there was mostly a reflection of what the folks on dev@phoenix had to say.

          is there anything YCSB can do to make these kinds of tests easier? I was thinking about e.g. a maven plugin earlier this evening, but am not sure about utility.

          Show
          busbey Sean Busbey added a comment - my comment there was mostly a reflection of what the folks on dev@phoenix had to say. is there anything YCSB can do to make these kinds of tests easier? I was thinking about e.g. a maven plugin earlier this evening, but am not sure about utility.
          Hide
          warwithin YoungWoo Kim added a comment -

          Got it. Thanks for your comment Sean Busbey.

          Actually I did some work on packaging bits for YCSB 0.1.4 because current HBase on Bigtop is 0.98.12 so most of all, it would be useful if recent YCSB supports HBase which is included in Bigtop's BOM.

          Show
          warwithin YoungWoo Kim added a comment - Got it. Thanks for your comment Sean Busbey . Actually I did some work on packaging bits for YCSB 0.1.4 because current HBase on Bigtop is 0.98.12 so most of all, it would be useful if recent YCSB supports HBase which is included in Bigtop's BOM.
          Hide
          githubbot ASF GitHub Bot added a comment -

          GitHub user youngwookim opened a pull request:

          https://github.com/apache/bigtop/pull/19

          BIGTOP-1920. Include YCSB in Bigtop

          You can merge this pull request into a Git repository by running:

          $ git pull https://github.com/youngwookim/bigtop BIGTOP-1920

          Alternatively you can review and apply these changes as the patch at:

          https://github.com/apache/bigtop/pull/19.patch

          To close this pull request, make a commit to your master/trunk branch
          with (at least) the following in the commit message:

          This closes #19


          commit 979f35337e1b233831dd1a321aa07ada2a3e1326
          Author: YoungWoo Kim <ywkim@apache.org>
          Date: 2015-07-08T07:37:58Z

          BIGTOP-1920. Include YCSB in Bigtop


          Show
          githubbot ASF GitHub Bot added a comment - GitHub user youngwookim opened a pull request: https://github.com/apache/bigtop/pull/19 BIGTOP-1920 . Include YCSB in Bigtop You can merge this pull request into a Git repository by running: $ git pull https://github.com/youngwookim/bigtop BIGTOP-1920 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/bigtop/pull/19.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #19 commit 979f35337e1b233831dd1a321aa07ada2a3e1326 Author: YoungWoo Kim <ywkim@apache.org> Date: 2015-07-08T07:37:58Z BIGTOP-1920 . Include YCSB in Bigtop
          Hide
          warwithin YoungWoo Kim added a comment - - edited

          Send a PR for YCSB 0.1.4:

          • YCSB 0.1.4 with a patch because recent 0.2.0 has issues with HBase 0.98.x
          • Packaging works fine on CentOS6 and Ubuntu14.04
          Show
          warwithin YoungWoo Kim added a comment - - edited Send a PR for YCSB 0.1.4: YCSB 0.1.4 with a patch because recent 0.2.0 has issues with HBase 0.98.x Packaging works fine on CentOS6 and Ubuntu14.04
          Hide
          oflebbe Olaf Flebbe added a comment -

          Could you please upgrade compat to "9" and Standards Version to 3.9.4 ? This makes lintian more suitable for us.

          Documented this in https://cwiki.apache.org/confluence/display/BIGTOP/Bigtop+Packaging

          Have to test the patch ...

          Show
          oflebbe Olaf Flebbe added a comment - Could you please upgrade compat to "9" and Standards Version to 3.9.4 ? This makes lintian more suitable for us. Documented this in https://cwiki.apache.org/confluence/display/BIGTOP/Bigtop+Packaging Have to test the patch ...
          Hide
          warwithin YoungWoo Kim added a comment -

          Thanks for your comment Olaf Flebbe. Will address that and send a PR.

          Show
          warwithin YoungWoo Kim added a comment - Thanks for your comment Olaf Flebbe . Will address that and send a PR.
          Hide
          warwithin YoungWoo Kim added a comment -

          I just updated the PR, https://github.com/apache/bigtop/pull/19 and attached a patch to jira too.

          • Addressed Olaf Flebbe's comment
          • Add 'python' dependency
          Show
          warwithin YoungWoo Kim added a comment - I just updated the PR, https://github.com/apache/bigtop/pull/19 and attached a patch to jira too. Addressed Olaf Flebbe 's comment Add 'python' dependency
          Hide
          jayunit100 jay vyas added a comment -

          Looks good to me after a quick glance but untested. adding YCSB is a great idea.
          I gues YoungWoo will commit that he is the entry in MAINTAINERS.txt for this?

          Show
          jayunit100 jay vyas added a comment - Looks good to me after a quick glance but untested. adding YCSB is a great idea. I gues YoungWoo will commit that he is the entry in MAINTAINERS.txt for this?
          Hide
          warwithin YoungWoo Kim added a comment -

          Thanks for your review and comment jay vyas. Absolutely, I'll file a issue for that and add me as a maintainer for this component.

          Show
          warwithin YoungWoo Kim added a comment - Thanks for your review and comment jay vyas . Absolutely, I'll file a issue for that and add me as a maintainer for this component.
          Hide
          warwithin YoungWoo Kim added a comment -

          Olaf Flebbe, I believe you would review it and give some advice on debian related lines

          Show
          warwithin YoungWoo Kim added a comment - Olaf Flebbe , I believe you would review it and give some advice on debian related lines
          Hide
          oflebbe Olaf Flebbe added a comment -

          I checked your great work and it looks good to me. +1 . I sucessfully installed it and ran a basic test,

          Show
          oflebbe Olaf Flebbe added a comment - I checked your great work and it looks good to me. +1 . I sucessfully installed it and ran a basic test,
          Hide
          warwithin YoungWoo Kim added a comment -

          Committed! Olaf Flebbe, Thanks for reviewing the patch.

          Sean Busbey and YCSB maintainers, Thank you for all your great work!

          Show
          warwithin YoungWoo Kim added a comment - Committed! Olaf Flebbe , Thanks for reviewing the patch. Sean Busbey and YCSB maintainers, Thank you for all your great work!
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user youngwookim closed the pull request at:

          https://github.com/apache/bigtop/pull/19

          Show
          githubbot ASF GitHub Bot added a comment - Github user youngwookim closed the pull request at: https://github.com/apache/bigtop/pull/19
          Hide
          githubbot ASF GitHub Bot added a comment -

          GitHub user youngwookim reopened a pull request:

          https://github.com/apache/bigtop/pull/19

          BIGTOP-1920. Include YCSB in Bigtop

          You can merge this pull request into a Git repository by running:

          $ git pull https://github.com/youngwookim/bigtop BIGTOP-1920

          Alternatively you can review and apply these changes as the patch at:

          https://github.com/apache/bigtop/pull/19.patch

          To close this pull request, make a commit to your master/trunk branch
          with (at least) the following in the commit message:

          This closes #19


          commit 2e0966210a86b1c0a8707c49f6b118d152d22c50
          Author: YoungWoo Kim <ywkim@apache.org>
          Date: 2015-07-08T07:37:58Z

          BIGTOP-1920. Include YCSB in Bigtop


          Show
          githubbot ASF GitHub Bot added a comment - GitHub user youngwookim reopened a pull request: https://github.com/apache/bigtop/pull/19 BIGTOP-1920 . Include YCSB in Bigtop You can merge this pull request into a Git repository by running: $ git pull https://github.com/youngwookim/bigtop BIGTOP-1920 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/bigtop/pull/19.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #19 commit 2e0966210a86b1c0a8707c49f6b118d152d22c50 Author: YoungWoo Kim <ywkim@apache.org> Date: 2015-07-08T07:37:58Z BIGTOP-1920 . Include YCSB in Bigtop

            People

            • Assignee:
              warwithin YoungWoo Kim
              Reporter:
              warwithin YoungWoo Kim
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development