Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-490

Tajo can't use 'dfs.nameservices' based on namenode ha mode.

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.8.0
    • Fix Version/s: 0.8.0
    • Component/s: conf and scripts
    • Labels:
      None

      Description

      I tested tajo based on namenode ha mode. I set hdfs-site.xml as follows:

        <property>
          <name>dfs.nameservices</name>
          <value>local-cluster</value>
        </property>
        <property>
          <name>dfs.ha.namenodes.local-cluster</name>
          <value>nn1,nn2</value>
        </property>
        <property>
          <name>dfs.namenode.rpc-address.local-cluster.nn1</name>
          <value>server01:9020</value>
        </property>
        <property>
          <name>dfs.namenode.rpc-address.local-cluster.nn2</name>
          <value>server02:9020</value>
        </property>
        <property>
          <name>dfs.ha.automatic-failover.enabled</name>
          <value>true</value>
        </property>
        ...... omit middle .....
      

      But tajo deamons couldn't start up as follows:

      2014-01-10 12:08:25,892 INFO  master.TajoMaster (TajoMaster.java:checkAndInitializeSystemDirectories(218)) - Tajo Root Directory: hdfs://local-cluster/tajo
      2014-01-10 12:08:27,576 ERROR master.TajoMaster (TajoMaster.java:init(181)) - java.net.UnknownHostException: local-cluster
      java.lang.IllegalArgumentException: java.net.UnknownHostException: local-cluster
              at org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:414)
              at org.apache.hadoop.hdfs.NameNodeProxies.createNonHAProxy(NameNodeProxies.java:164)
              at org.apache.hadoop.hdfs.NameNodeProxies.createProxy(NameNodeProxies.java:129)
              at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:448)
              at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:410)
              at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:128)
              at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2308)
              at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:87)
              at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2342)
              at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2324)
              at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:351)
              at org.apache.hadoop.fs.Path.getFileSystem(Path.java:194)
              at org.apache.tajo.master.TajoMaster.checkAndInitializeSystemDirectories(TajoMaster.java:221)
              at org.apache.tajo.master.TajoMaster.init(TajoMaster.java:161)
              at org.apache.tajo.master.TajoMaster.main(TajoMaster.java:1060)
      Caused by: java.net.UnknownHostException: local-cluster
              ... 15 more
      

        Attachments

        1. TAJO-490.patch
          0.9 kB
          Jaehwa Jung

          Activity

            People

            • Assignee:
              blrunner Jaehwa Jung
              Reporter:
              blrunner Jaehwa Jung
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: