Flume
  1. Flume
  2. FLUME-1661

ExecSource cannot execute complex *nix commands

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: v1.2.0
    • Fix Version/s: v1.4.0
    • Component/s: Sinks+Sources
    • Labels:
      None
    • Release Note:
      Added new optional config directive 'shell' for Exec source. This enables support for commands that use wildcards, backticks, pipes and other such shell features.

      Description

      • command line parsing
        • conf/flume.conf
          agent.sources.source1.type = exec
          agent.sources.source1.command = tail -f /some/path/logs/exception/error.log.`date +%Y%m%d%H`
          
        • result
          tail: /some/path/logs/exception/error.log.`date: No such file or directory
          tail: +%Y%m%d%H`: No such file or directory
          
        • needs to be improved
          (ExecSouce.java:242) String[] commandArgs = command.split("\\s+") 
          
      • using special character (e.g. *, `, ', ...)
        • conf/flume.conf
          agent.sources.source1.type = exec
          agent.sources.source1.command = tail -f /some/path/logs/exception/error.log.*
          
        • result
          tail: /some/path/logs/exception/error.log.*: No such file or directory
          
        • needs to be improved
          (ExecSouce.java:243) process = new ProcessBuilder(commandArgs).start();
          
      1. 1661.patch.v5
        14 kB
        Roshan Naik
      2. 1661.patch.v6
        14 kB
        Roshan Naik
      3. 1661.patch.v7
        15 kB
        Roshan Naik
      4. 1661.patch.v8
        15 kB
        Roshan Naik
      5. 1661.patch.v9
        15 kB
        Roshan Naik
      6. FLUME-1661.patch
        12 kB
        Roshan Naik
      7. FLUME-1661.patch.v2
        12 kB
        Roshan Naik
      8. FLUME-1661.patch.v3
        14 kB
        Roshan Naik
      9. FLUME-1661.patch.v4
        14 kB
        Roshan Naik
      10. FLUME-1661-1.patch
        0.7 kB
        Daisuke Kobayashi
      11. FlumeProcessRunner.tar.gz
        3 kB
        Nitin Verma

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Roshan Naik
              Reporter:
              Yoonseok Woo
            • Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development