[FLUME-1294] flume-ng script parses java.library.path incorrectly

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Component/s: Node
• Assignee: Unassigned
• Reporter: Hari Shreedharan
• Created: 19/Jun/12 21:35
• Updated: 09/Jul/12 22:21
• Resolved: 21/Jun/12 18:29

Description

Running an agent with HADOOP_HOME and HBASE_HOME:

./flume-ng agent -n agent -f ~/Desktop/conf_files/file_channel_null_sink -c ../conf/
Info: Including Hadoop libraries found via (/Users/hshreedharan/hadoop-1.0.1//bin/hadoop) for HDFS access
Info: Excluding /Users/hshreedharan/hadoop-1.0.1/libexec/../lib/slf4j-api-1.4.3.jar from classpath
Info: Excluding /Users/hshreedharan/hadoop-1.0.1/libexec/../lib/slf4j-log4j12-1.4.3.jar from classpath
Info: Including HBASE libraries found via (/Users/hshreedharan/hbase/hbase-0.92.1/bin/hbase) for HBASE access
Info: Excluding /Users/hshreedharan/hbase/hbase-0.92.1/lib/slf4j-api-1.5.8.jar from classpath
Info: Excluding /Users/hshreedharan/hbase/hbase-0.92.1/lib/slf4j-log4j12-1.5.8.jar from classpath
Info: Excluding /Users/hshreedharan/hadoop-1.0.1/libexec/../lib/slf4j-api-1.4.3.jar from classpath
Info: Excluding /Users/hshreedharan/hadoop-1.0.1/libexec/../lib/slf4j-log4j12-1.4.3.jar from classpath
+ exec /Library/Java/Home/bin/java -Xmx20m -cp '/Users/hshreedharan/work/flume-latest/flume/flume-ng-dist/target/flume-1.2.0-incubating-SNAPSHOT/conf:/Users/hshreedharan/work/flume-latest/flume/flume-ng-dist/target/flume-1.2.0-incubating-SNAPSHOT/lib/:/Users/hshreedharan/hadoop-1.0.1/libexec/../conf:/Library/Java/Home/lib/tools.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/..:/Users/hshreedharan/hadoop-1.0.1/libexec/../hadoop-core-1.0.1.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/asm-3.2.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/aspectjrt-1.6.5.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/aspectjtools-1.6.5.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/commons-beanutils-1.7.0.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/commons-beanutils-core-1.8.0.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/commons-cli-1.2.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/commons-codec-1.4.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/commons-collections-3.2.1.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/commons-configuration-1.6.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/commons-daemon-1.0.1.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/commons-digester-1.8.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/commons-el-1.0.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/commons-httpclient-3.0.1.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/commons-lang-2.4.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/commons-logging-1.1.1.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/commons-logging-api-1.0.4.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/commons-math-2.1.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/commons-net-1.4.1.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/core-3.1.1.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/hadoop-capacity-scheduler-1.0.1.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/hadoop-fairscheduler-1.0.1.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/hadoop-thriftfs-1.0.1.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/hsqldb-1.8.0.10.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/jackson-core-asl-1.8.8.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/jackson-mapper-asl-1.8.8.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/jasper-compiler-5.5.12.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/jasper-runtime-5.5.12.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/jdeb-0.8.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/jersey-core-1.8.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/jersey-json-1.8.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/jersey-server-1.8.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/jets3t-0.6.1.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/jetty-6.1.26.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/jetty-util-6.1.26.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/jsch-0.1.42.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/junit-4.5.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/kfs-0.2.2.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/log4j-1.2.15.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/mockito-all-1.8.5.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/oro-2.0.8.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/servlet-api-2.5-20081211.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/xmlenc-0.52.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/jsp-2.1/jsp-2.1.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/jsp-2.1/jsp-api-2.1.jar:/Users/hshreedharan/hbase/hbase-0.92.1/conf:/Library/Java/Home/lib/tools.jar:/Users/hshreedharan/hbase/hbase-0.92.1:/Users/hshreedharan/hbase/hbase-0.92.1/hbase-0.92.1-tests.jar:/Users/hshreedharan/hbase/hbase-0.92.1/hbase-0.92.1.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/activation-1.1.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/asm-3.1.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/avro-1.5.3.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/avro-ipc-1.5.3.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/commons-beanutils-1.7.0.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/commons-beanutils-core-1.8.0.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/commons-cli-1.2.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/commons-codec-1.4.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/commons-collections-3.2.1.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/commons-configuration-1.6.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/commons-digester-1.8.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/commons-el-1.0.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/commons-httpclient-3.1.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/commons-lang-2.5.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/commons-logging-1.1.1.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/commons-math-2.1.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/commons-net-1.4.1.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/core-3.1.1.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/guava-r09.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/hadoop-core-1.0.0.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/high-scale-lib-1.1.1.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/httpclient-4.0.1.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/httpcore-4.0.1.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/jackson-core-asl-1.5.5.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/jackson-jaxrs-1.5.5.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/jackson-mapper-asl-1.5.5.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/jackson-xc-1.5.5.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/jamon-runtime-2.3.1.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/jasper-compiler-5.5.23.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/jasper-runtime-5.5.23.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/jaxb-api-2.1.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/jaxb-impl-2.1.12.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/jersey-core-1.4.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/jersey-json-1.4.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/jersey-server-1.4.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/jettison-1.1.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/jetty-6.1.26.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/jetty-util-6.1.26.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/jruby-complete-1.6.5.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/jsp-2.1-6.1.14.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/jsp-api-2.1-6.1.14.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/libthrift-0.7.0.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/log4j-1.2.16.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/netty-3.2.4.Final.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/protobuf-java-2.4.0a.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/servlet-api-2.5-6.1.14.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/servlet-api-2.5.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/snappy-java-1.0.3.2.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/stax-api-1.0.1.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/velocity-1.7.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/xmlenc-0.52.jar:/Users/hshreedharan/hbase/hbase-0.92.1/lib/zookeeper-3.4.3.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../conf:/Library/Java/Home/lib/tools.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/..:/Users/hshreedharan/hadoop-1.0.1/libexec/../hadoop-core-1.0.1.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/asm-3.2.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/aspectjrt-1.6.5.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/aspectjtools-1.6.5.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/commons-beanutils-1.7.0.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/commons-beanutils-core-1.8.0.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/commons-cli-1.2.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/commons-codec-1.4.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/commons-collections-3.2.1.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/commons-configuration-1.6.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/commons-daemon-1.0.1.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/commons-digester-1.8.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/commons-el-1.0.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/commons-httpclient-3.0.1.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/commons-lang-2.4.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/commons-logging-1.1.1.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/commons-logging-api-1.0.4.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/commons-math-2.1.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/commons-net-1.4.1.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/core-3.1.1.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/hadoop-capacity-scheduler-1.0.1.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/hadoop-fairscheduler-1.0.1.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/hadoop-thriftfs-1.0.1.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/hsqldb-1.8.0.10.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/jackson-core-asl-1.8.8.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/jackson-mapper-asl-1.8.8.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/jasper-compiler-5.5.12.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/jasper-runtime-5.5.12.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/jdeb-0.8.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/jersey-core-1.8.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/jersey-json-1.8.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/jersey-server-1.8.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/jets3t-0.6.1.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/jetty-6.1.26.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/jetty-util-6.1.26.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/jsch-0.1.42.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/junit-4.5.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/kfs-0.2.2.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/log4j-1.2.15.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/mockito-all-1.8.5.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/oro-2.0.8.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/servlet-api-2.5-20081211.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/xmlenc-0.52.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/jsp-2.1/jsp-2.1.jar:/Users/hshreedharan/hadoop-1.0.1/libexec/../lib/jsp-2.1/jsp-api-2.1.jar:/Users/hshreedharan/hbase/hbase-0.92.1/conf' -Djava.library.path=:/Users/hshreedhara:/Users/hshreedhara* org.apache.flume.node.Application -n agent -f /Users/hshreedharan/Desktop/conf_files/file_channel_null_sink

Everything including and after an 'n' are gone. Something to do with the \n parsing in the script?

Issue Links

• duplicates: FLUME-1303 java.library.path value is being truncated at first 'n' char