Uploaded image for project: 'Giraph (Retired)'
  1. Giraph (Retired)
  2. GIRAPH-1099

Bypass all DNC calls in Giraph

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • None
    • None

    Description

      After GIRAPH-1034 we have reduced the number of DNS lookups and reverse DNS lookups dramatically. However, we still see failures occasionally and it would be great to completely bypass DNS if PREFER_IP_ADDRESSES is set.

      Currently I'm aware of two places that make DNS lookups:

      One in BspService:
      this.hostname = conf.getLocalHostname();

      Another one is probably related:
      java.net.UnknownHostException: ***.com: unknown error
      at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method)
      at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:928)
      at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1323)
      at java.net.InetAddress.getAllByName0(InetAddress.java:1276)
      at java.net.InetAddress.getAllByName(InetAddress.java:1192)
      at java.net.InetAddress.getAllByName(InetAddress.java:1126)
      at org.apache.zookeeper.client.StaticHostProvider.<init>(StaticHostProvider.java:60)
      at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:445)
      at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:380)
      at org.apache.giraph.zk.ZooKeeperExt.<init>(ZooKeeperExt.java:114)
      at org.apache.giraph.bsp.BspService.<init>(BspService.java:281)

      Attachments

        Activity

          People

            edunov Sergey Edunov
            edunov Sergey Edunov
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: