Bigtop
  1. Bigtop
  2. BIGTOP-961

hcatalog should be re-using hive user when running

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.6.0
    • Fix Version/s: 0.6.0
    • Component/s: deployment, general
    • Labels:
      None

      Description

      Given that hcatalog and hive actually share tons of common metadata it makes sense to run both under the same uder id (partially to solve legacy issues with existing hive deployments)

        Activity

        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Patch Available Patch Available
        6m 1 Roman Shaposhnik 03/May/13 18:05
        Patch Available Patch Available Resolved Resolved
        4d 1h 39m 1 Roman Shaposhnik 07/May/13 19:44
        Resolved Resolved Closed Closed
        45d 5h 5m 1 Roman Shaposhnik 22/Jun/13 00:49
        Roman Shaposhnik made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Roman Shaposhnik made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Hide
        Mark Grover added a comment -

        Hi Roman, good point. I think for now it's ok for us to change the user to hive user. Having 2 separate users would have puts some restrictions on the permissions of hive warehouse directory on HDFS and the embedded derby file based storage on local filesystem at the very least. Changing to hive user should fix those.

        I have been thinking about this a little more and I think moving forward, it would be really nice to have a standalone RDBMS in Bigtop which we can use to house all metastores (hive, oozie, hue, etc.) in Bigtop. I will create a separate JIRA (for Bigtop 0.7) for that but when that happens, perhaps it would make sense to revert back to HCat user since we would no longer be using embedded derby and can easily manage the permissions of hive warehouse directory on HDFS.

        You have my +1 (non-committer).

        Show
        Mark Grover added a comment - Hi Roman, good point. I think for now it's ok for us to change the user to hive user. Having 2 separate users would have puts some restrictions on the permissions of hive warehouse directory on HDFS and the embedded derby file based storage on local filesystem at the very least. Changing to hive user should fix those. I have been thinking about this a little more and I think moving forward, it would be really nice to have a standalone RDBMS in Bigtop which we can use to house all metastores (hive, oozie, hue, etc.) in Bigtop. I will create a separate JIRA (for Bigtop 0.7) for that but when that happens, perhaps it would make sense to revert back to HCat user since we would no longer be using embedded derby and can easily manage the permissions of hive warehouse directory on HDFS. You have my +1 (non-committer).
        Hide
        Roman Shaposhnik added a comment -

        Mark Grover that doesn't seem to work as far as accessing common metadata is concerned. Also, on a more philosophical note, I guess I'd say that now that HCatalog is part of Hive we should probably treat it as such, would you agree?

        Show
        Roman Shaposhnik added a comment - Mark Grover that doesn't seem to work as far as accessing common metadata is concerned. Also, on a more philosophical note, I guess I'd say that now that HCatalog is part of Hive we should probably treat it as such, would you agree?
        Hide
        Anatoli Fomenko added a comment -

        +1

        Show
        Anatoli Fomenko added a comment - +1
        Hide
        Mark Grover added a comment -

        Roman, would it make sense to use a separate hcatalog user that's a part of the hive group instead?

        Show
        Mark Grover added a comment - Roman, would it make sense to use a separate hcatalog user that's a part of the hive group instead?
        Roman Shaposhnik made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Roman Shaposhnik made changes -
        Field Original Value New Value
        Attachment 0001-BIGTOP-961.-hcatalog-should-be-re-using-hive-user-wh.patch [ 12581713 ]
        Roman Shaposhnik created issue -

          People

          • Assignee:
            Roman Shaposhnik
            Reporter:
            Roman Shaposhnik
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development