Uploaded image for project: 'HCatalog'
  1. HCatalog
  2. HCATALOG-434

Package HCatalog pig support as a separate jar

    XMLWordPrintableJSON

Details

    • Task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.5
    • None
    • None

    Description

      HCatalog's pig support should be moved into a separate jar.

      DETAILS:

      One of HCatalog's major goals is making the HiveMetaStore accessible to other processing frameworks (pig for example). If we bundle everything inside a single hcatalog.jar it will have a large number of processing framework dependencies.

      For example, let's say HCatalog has the core classes, and adaptors for pig & scalding all bundled inside a single hcatalog.jar. The maven dependencies will include both pig & scalding. Projects integrating with hcat either end up with way more dependencies than necessary, or they need to pick & choose which dependencies to include in their project.

      Packaging pig support as a separate jar allows users to get the pig support without dependencies from other processing frameworks.

      Attachments

        1. HCATALOG-434.4.patch
          13 kB
          Travis Crawford

        Issue Links

          Activity

            People

              traviscrawford Travis Crawford
              traviscrawford Travis Crawford
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: