Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-16354

Make hive internal parts more private - avoid exposing them for jdbc/metastore api users

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      This would enable:

      • to not ship unneeded things for the api users...the jdbcdriver contains a hiveserver2 with the full hive runtime and a metastore with the orm...all these are not neccessary
      • make it easier for the api users to integrate with hive, because it wouldnt pull in transitively garbage
      • would make it clear that where is the line...by enforcing the usage of these modules internally - it would make the external api for the users really usable - this is especcialy true for metastore; which currently have deep ties with the ql module.

      in HIVE-16214 I've identified some pieces which might be good to move to new modules...since that I've looked into it a bit more what could be done in this aspect...and to prevent going backward in this path; or get stuck at some point - I would like to be able to propose smaller changes prior to creating any modules...

      The goal here is to remove the unneeded dependencies from the modules which doesn't necessarily need them: the biggest fish in this tank is the jdbc module, which currently ships with full hiveserver server side + all of the ql codes + the whole metastore (including the jpa persistence libs) - this makes the jdbc driver a really fat jar...

      These changes will also reduce the hive binary distribution size; introducing service-client have reduce it by 20% percent alone.

      Attachments

        1. allinwonder.1.patch
          969 kB
          Zoltan Haindrich
        2. allinwonder.2.patch
          230 kB
          Zoltan Haindrich
        3. allinwonder.3.patch
          300 kB
          Zoltan Haindrich
        4. allinwonder.4.patch
          209 kB
          Zoltan Haindrich

        Activity

          People

            Unassigned Unassigned
            kgyrtkirk Zoltan Haindrich
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 40m
                40m