Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-490

Tajo can't use 'dfs.nameservices' based on namenode ha mode.

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.8.0
    • Fix Version/s: 0.8.0
    • Component/s: conf and scripts
    • Labels:
      None

      Description

      I tested tajo based on namenode ha mode. I set hdfs-site.xml as follows:

        <property>
          <name>dfs.nameservices</name>
          <value>local-cluster</value>
        </property>
        <property>
          <name>dfs.ha.namenodes.local-cluster</name>
          <value>nn1,nn2</value>
        </property>
        <property>
          <name>dfs.namenode.rpc-address.local-cluster.nn1</name>
          <value>server01:9020</value>
        </property>
        <property>
          <name>dfs.namenode.rpc-address.local-cluster.nn2</name>
          <value>server02:9020</value>
        </property>
        <property>
          <name>dfs.ha.automatic-failover.enabled</name>
          <value>true</value>
        </property>
        ...... omit middle .....
      

      But tajo deamons couldn't start up as follows:

      2014-01-10 12:08:25,892 INFO  master.TajoMaster (TajoMaster.java:checkAndInitializeSystemDirectories(218)) - Tajo Root Directory: hdfs://local-cluster/tajo
      2014-01-10 12:08:27,576 ERROR master.TajoMaster (TajoMaster.java:init(181)) - java.net.UnknownHostException: local-cluster
      java.lang.IllegalArgumentException: java.net.UnknownHostException: local-cluster
              at org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:414)
              at org.apache.hadoop.hdfs.NameNodeProxies.createNonHAProxy(NameNodeProxies.java:164)
              at org.apache.hadoop.hdfs.NameNodeProxies.createProxy(NameNodeProxies.java:129)
              at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:448)
              at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:410)
              at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:128)
              at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2308)
              at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:87)
              at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2342)
              at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2324)
              at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:351)
              at org.apache.hadoop.fs.Path.getFileSystem(Path.java:194)
              at org.apache.tajo.master.TajoMaster.checkAndInitializeSystemDirectories(TajoMaster.java:221)
              at org.apache.tajo.master.TajoMaster.init(TajoMaster.java:161)
              at org.apache.tajo.master.TajoMaster.main(TajoMaster.java:1060)
      Caused by: java.net.UnknownHostException: local-cluster
              ... 15 more
      
      1. TAJO-490.patch
        0.9 kB
        Jaehwa Jung

        Activity

        Hide
        blrunner Jaehwa Jung added a comment -

        I created a review request in RB https://reviews.apache.org/r/16775/.
        Please check it.

        Show
        blrunner Jaehwa Jung added a comment - I created a review request in RB https://reviews.apache.org/r/16775/ . Please check it.
        Hide
        blrunner Jaehwa Jung added a comment -

        Thanks Jinho Kim.
        I just shipped it.

        Show
        blrunner Jaehwa Jung added a comment - Thanks Jinho Kim . I just shipped it.
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Tajo-master-build #4 (See https://builds.apache.org/job/Tajo-master-build/4/)
        TAJO-490: Tajo can't use 'dfs.nameservices' based on namenode ha mode. (jhjung: https://git-wip-us.apache.org/repos/asf?p=incubator-tajo.git&a=commit&h=3937ca992c87b4e89a8056c2becef80066501698)

        • tajo-dist/src/main/bin/tajo
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Tajo-master-build #4 (See https://builds.apache.org/job/Tajo-master-build/4/ ) TAJO-490 : Tajo can't use 'dfs.nameservices' based on namenode ha mode. (jhjung: https://git-wip-us.apache.org/repos/asf?p=incubator-tajo.git&a=commit&h=3937ca992c87b4e89a8056c2becef80066501698 ) tajo-dist/src/main/bin/tajo
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Tajo-master-build #5 (See https://builds.apache.org/job/Tajo-master-build/5/)
        TAJO-490: Tajo can't use 'dfs.nameservices' based on namenode ha mode. (Added a missed changelog) (jhjung: https://git-wip-us.apache.org/repos/asf?p=incubator-tajo.git&a=commit&h=4c1929fc361e0bae116089230929c54badd12d0f)

        • CHANGES.txt
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Tajo-master-build #5 (See https://builds.apache.org/job/Tajo-master-build/5/ ) TAJO-490 : Tajo can't use 'dfs.nameservices' based on namenode ha mode. (Added a missed changelog) (jhjung: https://git-wip-us.apache.org/repos/asf?p=incubator-tajo.git&a=commit&h=4c1929fc361e0bae116089230929c54badd12d0f ) CHANGES.txt

          People

          • Assignee:
            blrunner Jaehwa Jung
            Reporter:
            blrunner Jaehwa Jung
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development