Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-1042

Improve delim / delimMode used by tail and tailDir to allow inclusion or exclusion of part of the delimiter

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Won't Fix
    • Affects Version/s: 0.9.4
    • Fix Version/s: 0.9.5
    • Component/s: Sinks+Sources
    • Labels:
      None

      Description

      I want stack dumps in a log file sent as a single event to a collector.

      From the user manual:

      Finally, this example tails a file and uses the regex "\n\d\d\d\d" as a delimiter and appends the delimiter to the next event. This could be used to gather lines from a stack dump in a log file that starts with four digits (like a year from a date stamp).

      tail("file", delim="\\n\\d\\d\\d\\d", delimMode="next")
      

      The output using the configuration above includes the entire delimiter, including the newline. However, I want the date stamp part of the delimiter to be included in the output, but the newline part of the delimiter to be excluded from the output. Perhaps the delim and delimMode properties could be enhanced to allow users to include or exclude parts of the delimiter based on matching groups in the regex.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              steve1976 Steve Stogner
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: