Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2960

Support Wildcards in directory name in TaildirSource

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 1.7.0
    • None
    • Sinks+Sources

    Description

      In our log management project, we wan't to track many log files like this:
      /app/dir1/log.*
      /app/dir2/log.*
      ...
      /app/dirn/log.*
      But TaildirSource can't support wildcards in filegroup directory name. The following config is expected:
      a1.sources.r1.filegroups.fg = /app/*/log.*

      Attachments

        1. FLUME-2960_1.patch
          14 kB
          tinawenqiao
        2. FLUME-2960_2.patch
          16 kB
          tinawenqiao
        3. FLUME-2960_3.patch
          19 kB
          tinawenqiao
        4. FLUME-2960_4.patch
          20 kB
          tinawenqiao
        5. FLUME-2960_5.patch
          20 kB
          tinawenqiao
        6. FLUME-2960_6.patch
          36 kB
          tinawenqiao
        7. FLUME-2960_7.patch
          38 kB
          tinawenqiao
        8. FLUME-2960_8.patch
          38 kB
          tinawenqiao

        Issue Links

          Activity

            People

              wenqiao tinawenqiao
              wenqiao tinawenqiao
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:

                Time Tracking

                  Estimated:
                  Original Estimate - 168h
                  168h
                  Remaining:
                  Remaining Estimate - 168h
                  168h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified