[FLUME-1222] rolling file sink "Directory may not be null" (Preconditions check) error when a directory is set

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Not A Problem
• Affects Version/s: 1.2.0
• Component/s: Docs, Sinks+Sources
• Assignee: Unassigned
• Reporter: Alexander Alten-Lorenz
• Created: 22/May/12 06:28
• Updated: 22/May/12 08:41
• Resolved: 22/May/12 08:41

Description

12/05/22 08:24:21 INFO lifecycle.LifecycleSupervisor: Starting lifecycle supervisor 1
12/05/22 08:24:21 INFO node.FlumeNode: Flume node starting - agent1
12/05/22 08:24:21 INFO nodemanager.DefaultLogicalNodeManager: Node manager starting
12/05/22 08:24:21 INFO lifecycle.LifecycleSupervisor: Starting lifecycle supervisor 10
12/05/22 08:24:21 INFO properties.PropertiesFileConfigurationProvider: Configuration provider starting
12/05/22 08:24:21 INFO properties.PropertiesFileConfigurationProvider: Reloading configuration file:/flumeNG/test1.cnf
12/05/22 08:24:22 INFO conf.FlumeConfiguration: Processing:sink
12/05/22 08:24:22 INFO conf.FlumeConfiguration: Processing:log-sink1
12/05/22 08:24:22 INFO conf.FlumeConfiguration: Processing:sink
12/05/22 08:24:22 INFO conf.FlumeConfiguration: Processing:log-sink1
12/05/22 08:24:22 INFO conf.FlumeConfiguration: Processing:sink
12/05/22 08:24:22 INFO conf.FlumeConfiguration: Processing:sink
12/05/22 08:24:22 INFO conf.FlumeConfiguration: Added sinks: sink Agent: agent1
12/05/22 08:24:22 INFO conf.FlumeConfiguration: Post-validation flume configuration contains configuration for agents: [agent1]
12/05/22 08:24:22 INFO properties.PropertiesFileConfigurationProvider: Creating channels
12/05/22 08:24:23 INFO properties.PropertiesFileConfigurationProvider: created channel ch1
12/05/22 08:24:23 INFO sink.DefaultSinkFactory: Creating instance of sink sink typefile_roll
>>>>>>>> content of directory:null <<<<<<<<<<
12/05/22 08:24:23 ERROR properties.PropertiesFileConfigurationProvider: Failed to load configuration data. Exception follows.
java.lang.IllegalArgumentException: Directory may not be nullnull
at com.google.common.base.Preconditions.checkArgument(Preconditions.java:88)
at org.apache.flume.sink.RollingFileSink.configure(RollingFileSink.java:85)
at org.apache.flume.conf.Configurables.configure(Configurables.java:41)
at org.apache.flume.conf.properties.PropertiesFileConfigurationProvider.loadSinks(PropertiesFileConfigurationProvider.java:350)
at org.apache.flume.conf.properties.PropertiesFileConfigurationProvider.load(PropertiesFileConfigurationProvider.java:223)
at org.apache.flume.conf.file.AbstractFileConfigurationProvider.doLoad(AbstractFileConfigurationProvider.java:123)
at org.apache.flume.conf.file.AbstractFileConfigurationProvider.access$300(AbstractFileConfigurationProvider.java:38)
at org.apache.flume.conf.file.AbstractFileConfigurationProvider$FileWatcherRunnable.run(AbstractFileConfigurationProvider.java:202)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:204)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)

Config:
agent1.channels.ch1.type = memory

agent1.sources.avro-source1.channels = ch1
agent1.sources.avro-source1.type = avro
agent1.sources.avro-source1.bind = 0.0.0.0
agent1.sources.avro-source1.port = 41414

agent1.sinks.log-sink1.channel = ch1
agent1.sinks.log-sink1.type = logger

agent1.sinks.sink.channel = ch1
agent1.sinks.sink.directory = /home/alex/test1/
agent1.sinks.sink.rollInterval=0
agent1.sinks.sink.type = file_roll

agent1.channels = ch1
agent1.sources = avro-source1
agent1.sinks = sink

I added System.out.print ("content of directory:" + directory +"\n"); indeed the variable is empty.

Issue Links

• is superceded by: FLUME-1223 Userguide improvement rolling file sink