[GIRAPH-882] List of zookeeper connection strings is trimmed by Hadoop counters.

• Type: Bug
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.1.0, 1.2.0
• Component/s: zookeeper
• Assignee: Unassigned
• Reporter: Lukas Nalezenec
• Created: 20/Mar/14 09:58
• Updated: 02/Jul/16 16:30

Description

We are running job with quorum of 3 zookeepers. Each serves has got long name (turing452.fi.callan.de:22181). Connection strings are stored to Hadoop Counters (for example: turing452.fi.callan.de:22181,turing124.fi.callan.de:22181,turing488.fi.callan.de:22181) but since name of counter is limited to ~63 character the connection string is trimmed (turing452.fi.callan.de:22181,turing124.fi.callan.de:22181,turin).

14/03/18 23:44:41 INFO zookeeper.ZooKeeper: Client environment:user.name=hadoop
14/03/18 23:44:41 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=turing452.fi.callan.de:22181,turing124.fi.callan.de:22181,turin sessionTimeout=60000

Exception in thread "main" java.net.UnknownHostException: turin
at java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method)
at java.net.InetAddress$1.lookupAllHostAddr(InetAddress.java:901)
at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1293)
at java.net.InetAddress.getAllByName0(InetAddress.java:1246)
at java.net.InetAddress.getAllByName(InetAddress.java:1162)
at java.net.InetAddress.getAllByName(InetAddress.java:1098)
at org.apache.zookeeper.client.StaticHostProvider.<init>(StaticHostProvider.java:60)
at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:445)
at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:380)
at org.apache.giraph.zk.ZooKeeperExt.<init>(ZooKeeperExt.java:114)
at org.apache.giraph.job.JobProgressTracker.<init>(JobProgressTracker.java:69)
at org.apache.giraph.job.GiraphJob.run(GiraphJob.java:255)