Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.0.0
    • Fix Version/s: 1.1.0
    • Component/s: None
    • Labels:
      None

      Description

      From Phoenix 4.4.0, there are support for Spark and new queryserver. It would be nice to have awesome features on Bigtop.

        Issue Links

          Activity

          Hide
          apurtell Andrew Purtell added a comment -

          Phoenix just released 4.5.0, update to that instead?

          Show
          apurtell Andrew Purtell added a comment - Phoenix just released 4.5.0, update to that instead?
          Hide
          warwithin YoungWoo Kim added a comment -

          Good point, Andrew Purtell! but to upgrade 4.5.0 we should have Spark 1.4+ for phoenix-spark. You may run into compilation errors with Spark 1.3.x
          So I would like to upgrade 4.4.0 first, after resolving dependencies for 4.5.0, Will file a JIRA for 4.5.0
          What do you think?

          Show
          warwithin YoungWoo Kim added a comment - Good point, Andrew Purtell ! but to upgrade 4.5.0 we should have Spark 1.4+ for phoenix-spark. You may run into compilation errors with Spark 1.3.x So I would like to upgrade 4.4.0 first, after resolving dependencies for 4.5.0, Will file a JIRA for 4.5.0 What do you think?
          Hide
          warwithin YoungWoo Kim added a comment -

          Filed BIGTOP-1942 for Phoenix 4.5.0 also it depends on BIGTOP-1943 and BIGTOP-1944

          Show
          warwithin YoungWoo Kim added a comment - Filed BIGTOP-1942 for Phoenix 4.5.0 also it depends on BIGTOP-1943 and BIGTOP-1944
          Hide
          githubbot ASF GitHub Bot added a comment -

          GitHub user youngwookim opened a pull request:

          https://github.com/apache/bigtop/pull/23

          BIGTOP-1941. Upgrade Phoenix to 4.4.0

          You can merge this pull request into a Git repository by running:

          $ git pull https://github.com/youngwookim/bigtop BIGTOP-1941

          Alternatively you can review and apply these changes as the patch at:

          https://github.com/apache/bigtop/pull/23.patch

          To close this pull request, make a commit to your master/trunk branch
          with (at least) the following in the commit message:

          This closes #23


          commit c72104b517cb6c067bf073843db0fb4797724e9c
          Author: YoungWoo Kim <ywkim@apache.org>
          Date: 2015-07-28T06:11:25Z

          BIGTOP-1941. Upgrade Phoenix to 4.4.0


          Show
          githubbot ASF GitHub Bot added a comment - GitHub user youngwookim opened a pull request: https://github.com/apache/bigtop/pull/23 BIGTOP-1941 . Upgrade Phoenix to 4.4.0 You can merge this pull request into a Git repository by running: $ git pull https://github.com/youngwookim/bigtop BIGTOP-1941 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/bigtop/pull/23.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #23 commit c72104b517cb6c067bf073843db0fb4797724e9c Author: YoungWoo Kim <ywkim@apache.org> Date: 2015-07-28T06:11:25Z BIGTOP-1941 . Upgrade Phoenix to 4.4.0
          Hide
          warwithin YoungWoo Kim added a comment - - edited

          First PR:

          • Bump up Phoenix version to 4.4.0
          • Add new queryserver
          • Add a simple smoke test for queryserver using sqlline-thin client

          The queryserver runs as 'phoenix' system user. I created some dirs for logs and PID for phoenix-queryserver but it depends on HBase configuration files like hbase-env and hbase-site.xml.
          So you should make sure the configurations are valid before running phoenix-queryserver. Unless you change default configurations, queryserver writes logs and pid under /tmp/phoenix/

          Andrew Purtell, it would be appreciated if you would review it.

          Show
          warwithin YoungWoo Kim added a comment - - edited First PR: Bump up Phoenix version to 4.4.0 Add new queryserver Add a simple smoke test for queryserver using sqlline-thin client The queryserver runs as 'phoenix' system user. I created some dirs for logs and PID for phoenix-queryserver but it depends on HBase configuration files like hbase-env and hbase-site.xml. So you should make sure the configurations are valid before running phoenix-queryserver. Unless you change default configurations, queryserver writes logs and pid under /tmp/phoenix/ Andrew Purtell , it would be appreciated if you would review it.
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user apurtell commented on the pull request:

          https://github.com/apache/bigtop/pull/23#issuecomment-126827630

          +1

          Show
          githubbot ASF GitHub Bot added a comment - Github user apurtell commented on the pull request: https://github.com/apache/bigtop/pull/23#issuecomment-126827630 +1
          Hide
          apurtell Andrew Purtell added a comment -

          PR reviewed, +1

          Adding a new 'phoenix' user for the queryserver makes sense.

          New smoke tests look great.

          Out of curiosity, did you start and try out the new query server daemon after installation?

          Show
          apurtell Andrew Purtell added a comment - PR reviewed, +1 Adding a new 'phoenix' user for the queryserver makes sense. New smoke tests look great. Out of curiosity, did you start and try out the new query server daemon after installation?
          Hide
          apurtell Andrew Purtell added a comment -

          So you should make sure the configurations are valid before running phoenix-queryserver. Unless you change default configurations, queryserver writes logs and pid under /tmp/phoenix/

          Could file a follow on issue for teaching the puppet scripts about this.

          Show
          apurtell Andrew Purtell added a comment - So you should make sure the configurations are valid before running phoenix-queryserver. Unless you change default configurations, queryserver writes logs and pid under /tmp/phoenix/ Could file a follow on issue for teaching the puppet scripts about this.
          Hide
          warwithin YoungWoo Kim added a comment -

          Exactly. I'll file a JIRA for that. Thanks Andrew Purtell for reviewing the patch!

          Show
          warwithin YoungWoo Kim added a comment - Exactly. I'll file a JIRA for that. Thanks Andrew Purtell for reviewing the patch!
          Hide
          warwithin YoungWoo Kim added a comment -

          Oh! Forgot to mention, Yes, I've done some tests with Bigtop's vagrant-puppet-vm using a local repository. I tested it with sample data and query for Phoenix through phoenix thin client.

          Show
          warwithin YoungWoo Kim added a comment - Oh! Forgot to mention, Yes, I've done some tests with Bigtop's vagrant-puppet-vm using a local repository. I tested it with sample data and query for Phoenix through phoenix thin client.
          Hide
          apurtell Andrew Purtell added a comment -

          I've done some tests with Bigtop's vagrant-puppet-vm using a local repository. I tested it with sample data and query for Phoenix through phoenix thin client.

          Wow, that's great. Thanks so much!

          Show
          apurtell Andrew Purtell added a comment - I've done some tests with Bigtop's vagrant-puppet-vm using a local repository. I tested it with sample data and query for Phoenix through phoenix thin client. Wow, that's great. Thanks so much!
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user youngwookim closed the pull request at:

          https://github.com/apache/bigtop/pull/23

          Show
          githubbot ASF GitHub Bot added a comment - Github user youngwookim closed the pull request at: https://github.com/apache/bigtop/pull/23

            People

            • Assignee:
              warwithin YoungWoo Kim
              Reporter:
              warwithin YoungWoo Kim
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development