Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2902

Add field projecting interceptor

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Critical
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Sinks+Sources
    • Labels:
    • Flags:
      Patch

      Description

      Main functionalities are as below:
      1. filter out specified fields from the raw input
      2. reorder these selected fields
      3. change field separator
      4. trim field

      Use case:

      • agent.sources.r1.type = SEQ
      • agent.sources.r1.interceptors = i1
      • agent.sources.r1.interceptors.i1.type = org.apache.flume.interceptor.FieldProjectInterceptor
      • agent.sources.r1.interceptors.i1.charset = UTF-8
      • agent.sources.r1.interceptors.i1.inputSeparator = |
      • agent.sources.r1.interceptors.i1.outputSeparator = ,
      • agent.sources.r1.interceptors.i1.outputFields = 3 5 2

        Attachments

        1. FLUME-2902.patch
          21 kB
          zhengcanbin

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                zhengcanbin zhengcanbin
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Time Tracking

                  Estimated:
                  Original Estimate - 0.05h
                  0.05h
                  Remaining:
                  Remaining Estimate - 0.05h
                  0.05h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified