Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-1359

developer guide should mention how to manage hive job dependencies

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Minor
    • Resolution: Cannot Reproduce
    • Affects Version/s: v1.2
    • Fix Version/s: Future
    • Component/s: Documentation
    • Labels:
      None
    • Environment:
      kylin 1.2, mac osx, hdp sandbox 2.2.4.2-2

      Description

      When start cubing jobs in Kylin dev environment for example from Intellij, we should explicitly set hive dependent jars which include FactDistinctColumnsMapper etc.

      This is missing in http://kylin.apache.org/development/dev_env.html. We can tell developer to do the following:

      1) In IDE,
      set -Dkylin.hive.dependency=/usr/hdp/current/kylinjob/kylin-job-1.2-job.jar

      2) copy the corresponding jar file
      under kylin/job/target/kylin-job-1.2-job.jar to sandbox if you use sandbox
      as development env.

      BuildCubeWithEngineTest may directly run some scrip to get
      hive dependent jars, but in IDE, looks we have to do manual work above.

        Attachments

          Activity

            People

            • Assignee:
              yonzhang2012 Edward Zhang
              Reporter:
              yonzhang2012 Edward Zhang

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - 12h
                12h
                Remaining:
                Remaining Estimate - 12h
                12h
                Logged:
                Time Spent - Not Specified
                Not Specified

                  Issue deployment