Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2902

Add field projecting interceptor

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Critical
    • Resolution: Unresolved
    • None
    • None
    • Sinks+Sources
    • Patch

    Description

      Main functionalities are as below:
      1. filter out specified fields from the raw input
      2. reorder these selected fields
      3. change field separator
      4. trim field

      Use case:

      • agent.sources.r1.type = SEQ
      • agent.sources.r1.interceptors = i1
      • agent.sources.r1.interceptors.i1.type = org.apache.flume.interceptor.FieldProjectInterceptor
      • agent.sources.r1.interceptors.i1.charset = UTF-8
      • agent.sources.r1.interceptors.i1.inputSeparator = |
      • agent.sources.r1.interceptors.i1.outputSeparator = ,
      • agent.sources.r1.interceptors.i1.outputFields = 3 5 2

      Attachments

        1. FLUME-2902.patch
          21 kB
          zhengcanbin

        Issue Links

          Activity

            People

              Unassigned Unassigned
              zhengcanbin zhengcanbin
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:

                Time Tracking

                  Estimated:
                  Original Estimate - 0.05h
                  0.05h
                  Remaining:
                  Remaining Estimate - 0.05h
                  0.05h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified