Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2960

Support Wildcards in directory name in TaildirSource

    Details

    • Type: Improvement
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.7.0
    • Fix Version/s: 1.9.0
    • Component/s: Sinks+Sources
    • Labels:

      Description

      In our log management project, we wan't to track many log files like this:
      /app/dir1/log.*
      /app/dir2/log.*
      ...
      /app/dirn/log.*
      But TaildirSource can't support wildcards in filegroup directory name. The following config is expected:
      a1.sources.r1.filegroups.fg = /app/*/log.*

        Attachments

        1. FLUME-2960_1.patch
          14 kB
          tinawenqiao
        2. FLUME-2960_2.patch
          16 kB
          tinawenqiao
        3. FLUME-2960_3.patch
          19 kB
          tinawenqiao
        4. FLUME-2960_4.patch
          20 kB
          tinawenqiao
        5. FLUME-2960_5.patch
          20 kB
          tinawenqiao
        6. FLUME-2960_6.patch
          36 kB
          tinawenqiao
        7. FLUME-2960_7.patch
          38 kB
          tinawenqiao
        8. FLUME-2960_8.patch
          38 kB
          tinawenqiao

          Issue Links

            Activity

              People

              • Assignee:
                wenqiao tinawenqiao
                Reporter:
                wenqiao tinawenqiao
              • Votes:
                0 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Time Tracking

                  Estimated:
                  Original Estimate - 168h
                  168h
                  Remaining:
                  Remaining Estimate - 168h
                  168h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified