Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-1042

Improve delim / delimMode used by tail and tailDir to allow inclusion or exclusion of part of the delimiter

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Won't Fix
    • 0.9.4
    • 0.9.5
    • Sinks+Sources
    • None

    Description

      I want stack dumps in a log file sent as a single event to a collector.

      From the user manual:

      Finally, this example tails a file and uses the regex "\n\d\d\d\d" as a delimiter and appends the delimiter to the next event. This could be used to gather lines from a stack dump in a log file that starts with four digits (like a year from a date stamp).

      tail("file", delim="\\n\\d\\d\\d\\d", delimMode="next")
      

      The output using the configuration above includes the entire delimiter, including the newline. However, I want the date stamp part of the delimiter to be included in the output, but the newline part of the delimiter to be excluded from the output. Perhaps the delim and delimMode properties could be enhanced to allow users to include or exclude parts of the delimiter based on matching groups in the regex.

      Attachments

        Activity

          People

            Unassigned Unassigned
            steve1976 Steve Stogner
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: