[SPARK-22030] GraphiteSink fails to re-connect to Graphite instances behind an ELB or any other auto-scaled LB

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.2.0
• Fix Version/s: 2.3.0
• Component/s: Spark Core
• Assignee: Alex Mikhailau
• Reporter: Alex Mikhailau
• Created: 15/Sep/17 15:31
• Updated: 19/Sep/17 02:08
• Resolved: 19/Sep/17 02:06

Description

Upgrade codahale metrics library so that Graphite constructor can re-resolve hosts behind a CNAME with re-tried DNS lookups. When Graphite is deployed behind an ELB, ELB may change IP addresses based on auto-scaling needs. Using current approach yields Graphite usage impossible, fixing for that use case

Upgrade to codahale 3.1.5
Use new Graphite(host, port) constructor instead of new Graphite(new InetSocketAddress(host, port)) constructor

This are proposed changes for codahale lib - dropwizard/metrics@v3.1.2...v3.1.5#diff-6916c85d2dd08d89fe771c952e3b8512R120. Specifically, https://github.com/dropwizard/metrics/blob/b4d246d34e8a059b047567848b3522567cbe6108/metrics-graphite/src/main/java/com/codahale/metrics/graphite/Graphite.java#L120

Issue Links

• links to: [Github] Pull Request #19210 (alexmnyc)