Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2911

Add includePattern option in SpoolDirectorySource configuration

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.6.0, 1.7.0
    • Fix Version/s: 1.7.0
    • Component/s: Sinks+Sources
    • Labels:
    • Release Note:
      Added includePattern option to spooling directory source.
    • Flags:
      Patch

      Description

      Current implementation of SpoolDirectorySource does not allow users to specify a regex pattern to select which files should be monitored. Instead, the current implementation allows users to specify which should not monitored, via the ignorePattern parameter.

      I implemented the feature, allowing users to specify the include pattern as a1.sources.src-1.includePattern=^foo.*$ (includes all the files that starts in "foo").

      By default, the includePattern regex is set to ^.*$ (all files). Include and exclude patterns can be used at same time and the results are combined.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                arota Andrea Rota
                Reporter:
                arota Andrea Rota
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: