Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-3277

Override hiveconf settings when connecting to hive using jdbc

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • v2.4.0
    • None

    Description

      Hi, kylin developers. My cube building procedure failing at Step 2 "Redistribute Flat Hive Table" because Kylin always trying to submit a mr job to the default yarn queue.

       

      I have overrided the mapred.job.queue.name property in both kylin_hive_conf.xml and kylin.properties but it doesn't work.

       

      kylin.properties

      ```

      kylin.source.hive.beeline-params=-n hive -p hive --hiveconf mapred.job.queue.name=myQueue  -u "jdbc:hive2://myZk:2181/;serviceDiscoveryMode=zooKeeper;"

      ```

       

      kylin_hive_conf.xml

      ```

         <property>

             <name>mapred.job.queue.name</name>

             <value>myQueue</value>

         </property>

      ```

       

      After digging into the source code ,I found that kylin try to get the row count of hive table before redistributing it. But it dose not override the hive configuration when using jdbc to connect to hive server.

       

       

       

      Attachments

        1. 0001-KYLIN-3277.patch
          10 kB
          Chuqian Yu

        Activity

          People

            yuchuqian Chuqian Yu
            yuchuqian Chuqian Yu
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: