Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-1839

improvement set classpath before submitting mr job

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • v1.5.2
    • v1.6.0
    • Job Engine
    • None

    Description

      in setClasspath, kylin will alway find hive jars from hive dependency using regex, however, this will not change in one process lifetime, so I cache the location of tmpjars and tmpfiles.

      What is more, support extends user lib setting to hdfs path rather than only support local filesystem which will cause upload jars every time if DistributedCache do not exist.

      Attachments

        Activity

          People

            feng_xiao_yu fengYu
            feng_xiao_yu fengYu
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: