[FLUME-3361] Environment variables are not substituted/resolved if agent is configured via ZooKeeper

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.9.0
• Component/s: Configuration
• Labels: patch pull-request-available
• Assignee: Unassigned
• Reporter: Avinash Kumar
• Created: 26/Mar/20 19:31
• Updated: 03/Feb/21 00:59

Description

Environment variables are not substituted/resolved during agent (re-)configuration if agent is configured via ZooKeeper.

Steps to replicate the issue
1) Create a znode having agent conf in the ZooKeeper path /flume/a1 . Relevant part of the conf is shown below

cia.sources = accessLog
cia.channels = channel
cia.sinks = kafka
cia.sources.accessLog.type = com.xyz.agent.LogSource
cia.sources.accessLog.cid = ${CUSTOMER_ID}

 

2) Add environment variable in conf/flume-env.sh as shown below

export CUSTOMER_ID="AB123"

 

3) Start the agent
./flume-ng agent -n a1 -c ../conf -z localhost:2182 -p /flume -DpropertiesImplementation=org.apache.flume.node.EnvVarResolverProperties

 

Issue Links

• links to: GitHub Pull Request #326