[TAJO-490] Tajo can't use 'dfs.nameservices' based on namenode ha mode.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.8.0
• Fix Version/s: 0.8.0
• Component/s: conf and scripts
• Assignee: JaeHwa Jung
• Reporter: JaeHwa Jung
• Created: 10/Jan/14 04:54
• Updated: 10/Jan/14 08:30
• Resolved: 10/Jan/14 08:18

Description

I tested tajo based on namenode ha mode. I set hdfs-site.xml as follows:

  <property>
    <name>dfs.nameservices</name>
    <value>local-cluster</value>
  </property>
  <property>
    <name>dfs.ha.namenodes.local-cluster</name>
    <value>nn1,nn2</value>
  </property>
  <property>
    <name>dfs.namenode.rpc-address.local-cluster.nn1</name>
    <value>server01:9020</value>
  </property>
  <property>
    <name>dfs.namenode.rpc-address.local-cluster.nn2</name>
    <value>server02:9020</value>
  </property>
  <property>
    <name>dfs.ha.automatic-failover.enabled</name>
    <value>true</value>
  </property>
  ...... omit middle .....

But tajo deamons couldn't start up as follows:

2014-01-10 12:08:25,892 INFO  master.TajoMaster (TajoMaster.java:checkAndInitializeSystemDirectories(218)) - Tajo Root Directory: hdfs://local-cluster/tajo
2014-01-10 12:08:27,576 ERROR master.TajoMaster (TajoMaster.java:init(181)) - java.net.UnknownHostException: local-cluster
java.lang.IllegalArgumentException: java.net.UnknownHostException: local-cluster
        at org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:414)
        at org.apache.hadoop.hdfs.NameNodeProxies.createNonHAProxy(NameNodeProxies.java:164)
        at org.apache.hadoop.hdfs.NameNodeProxies.createProxy(NameNodeProxies.java:129)
        at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:448)
        at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:410)
        at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:128)
        at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2308)
        at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:87)
        at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2342)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2324)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:351)
        at org.apache.hadoop.fs.Path.getFileSystem(Path.java:194)
        at org.apache.tajo.master.TajoMaster.checkAndInitializeSystemDirectories(TajoMaster.java:221)
        at org.apache.tajo.master.TajoMaster.init(TajoMaster.java:161)
        at org.apache.tajo.master.TajoMaster.main(TajoMaster.java:1060)
Caused by: java.net.UnknownHostException: local-cluster
        ... 15 more