Details

    • Type: New Feature New Feature
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: v1.3.0
    • Fix Version/s: v1.3.0
    • Component/s: Easy
    • Labels:
      None

      Description

      Add a RegexExtractor interceptor that will allow the user to extract regex matches and append them as header fields of the event.

      This will allow functionality similar to FlumeOG where dates..etc can be extracted from the event body and used as meta-data.

      1. FLUME-1657.patch
        28 kB
        Cameron Gandevia

        Issue Links

          Activity

          Cameron Gandevia created issue -
          Cameron Gandevia made changes -
          Field Original Value New Value
          Attachment FLUME-1657.patch [ 12549745 ]
          Cameron Gandevia made changes -
          Attachment FLUME-1657.patch [ 12550319 ]
          Cameron Gandevia made changes -
          Attachment FLUME-1657.patch [ 12549745 ]
          Cameron Gandevia made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Brock Noland added a comment -

          In general I think this looks good, would you mind putting it in Review Board?

          Show
          Brock Noland added a comment - In general I think this looks good, would you mind putting it in Review Board?
          Hide
          Cameron Gandevia added a comment -

          https://reviews.apache.org/r/7700/


          Thanks

          Cameron Gandevia

          Show
          Cameron Gandevia added a comment - https://reviews.apache.org/r/7700/ – Thanks Cameron Gandevia
          Brock Noland made changes -
          Remote Link This issue links to "Review Board (Web Link)" [ 11405 ]
          Brock Noland made changes -
          Fix Version/s v1.4.0 [ 12323372 ]
          Fix Version/s v1.3.0 [ 12322140 ]
          Hide
          Brock Noland added a comment -

          Thank you Cameron! Committed to trunk, 1.4, and 1.3.0

          Show
          Brock Noland added a comment - Thank you Cameron! Committed to trunk, 1.4, and 1.3.0
          Brock Noland made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Assignee Cameron Gandevia [ gnoremac ]
          Fix Version/s v1.3.0 [ 12322140 ]
          Fix Version/s v1.4.0 [ 12323372 ]
          Resolution Fixed [ 1 ]
          Hide
          Hudson added a comment -

          Integrated in flume-trunk #328 (See https://builds.apache.org/job/flume-trunk/328/)
          FLUME-1657: Regex Extractor Interceptor (Revision d466e8cbc3f3c5a26e700b55732b1c059d23eb95)
          Revert "FLUME-1657: Regex Extractor Interceptor" (Revision 310e70ee3558f20422da3218d88342dffe6ad2cb)
          FLUME-1657: Regex Extractor Interceptor (Revision 9f9c04813573d18c8055582c4cddbbba95c8693b)

          Result = SUCCESS
          brock : http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=d466e8cbc3f3c5a26e700b55732b1c059d23eb95
          Files :

          • flume-ng-core/src/test/java/org/apache/flume/interceptor/TestRegexExtractorInterceptorPassThroughSerializer.java
          • flume-ng-doc/sphinx/FlumeUserGuide.rst
          • flume-ng-core/src/test/java/org/apache/flume/interceptor/TestRegexExtractorInterceptor.java
          • flume-ng-core/src/main/java/org/apache/flume/interceptor/RegexExtractorInterceptorPassThroughSerializer.java
          • flume-ng-core/src/main/java/org/apache/flume/interceptor/RegexExtractorInterceptor.java
          • flume-ng-core/src/test/java/org/apache/flume/interceptor/TestRegexExtractorInterceptorMillisSerializer.java
          • flume-ng-core/src/main/java/org/apache/flume/interceptor/RegexExtractorInterceptorMillisSerializer.java
          • flume-ng-core/src/main/java/org/apache/flume/interceptor/RegexExtractorInterceptorSerializer.java
          • flume-ng-core/src/main/java/org/apache/flume/interceptor/InterceptorType.java

          brock : http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=310e70ee3558f20422da3218d88342dffe6ad2cb
          Files :

          • flume-ng-doc/sphinx/FlumeUserGuide.rst
          • flume-ng-core/src/main/java/org/apache/flume/interceptor/RegexExtractorInterceptorSerializer.java
          • flume-ng-core/src/main/java/org/apache/flume/interceptor/RegexExtractorInterceptor.java
          • flume-ng-core/src/main/java/org/apache/flume/interceptor/RegexExtractorInterceptorPassThroughSerializer.java
          • flume-ng-core/src/main/java/org/apache/flume/interceptor/RegexExtractorInterceptorMillisSerializer.java
          • flume-ng-core/src/test/java/org/apache/flume/interceptor/TestRegexExtractorInterceptorMillisSerializer.java
          • flume-ng-core/src/test/java/org/apache/flume/interceptor/TestRegexExtractorInterceptor.java
          • flume-ng-core/src/test/java/org/apache/flume/interceptor/TestRegexExtractorInterceptorPassThroughSerializer.java
          • flume-ng-core/src/main/java/org/apache/flume/interceptor/InterceptorType.java

          brock : http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=9f9c04813573d18c8055582c4cddbbba95c8693b
          Files :

          • flume-ng-core/src/test/java/org/apache/flume/interceptor/TestRegexExtractorInterceptorPassThroughSerializer.java
          • flume-ng-core/src/test/java/org/apache/flume/interceptor/TestRegexExtractorInterceptor.java
          • flume-ng-doc/sphinx/FlumeUserGuide.rst
          • flume-ng-core/src/main/java/org/apache/flume/interceptor/RegexExtractorInterceptorSerializer.java
          • flume-ng-core/src/main/java/org/apache/flume/interceptor/InterceptorType.java
          • flume-ng-core/src/main/java/org/apache/flume/interceptor/RegexExtractorInterceptorMillisSerializer.java
          • flume-ng-core/src/main/java/org/apache/flume/interceptor/RegexExtractorInterceptor.java
          • flume-ng-core/src/main/java/org/apache/flume/interceptor/RegexExtractorInterceptorPassThroughSerializer.java
          • flume-ng-core/src/test/java/org/apache/flume/interceptor/TestRegexExtractorInterceptorMillisSerializer.java
          Show
          Hudson added a comment - Integrated in flume-trunk #328 (See https://builds.apache.org/job/flume-trunk/328/ ) FLUME-1657 : Regex Extractor Interceptor (Revision d466e8cbc3f3c5a26e700b55732b1c059d23eb95) Revert " FLUME-1657 : Regex Extractor Interceptor" (Revision 310e70ee3558f20422da3218d88342dffe6ad2cb) FLUME-1657 : Regex Extractor Interceptor (Revision 9f9c04813573d18c8055582c4cddbbba95c8693b) Result = SUCCESS brock : http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=d466e8cbc3f3c5a26e700b55732b1c059d23eb95 Files : flume-ng-core/src/test/java/org/apache/flume/interceptor/TestRegexExtractorInterceptorPassThroughSerializer.java flume-ng-doc/sphinx/FlumeUserGuide.rst flume-ng-core/src/test/java/org/apache/flume/interceptor/TestRegexExtractorInterceptor.java flume-ng-core/src/main/java/org/apache/flume/interceptor/RegexExtractorInterceptorPassThroughSerializer.java flume-ng-core/src/main/java/org/apache/flume/interceptor/RegexExtractorInterceptor.java flume-ng-core/src/test/java/org/apache/flume/interceptor/TestRegexExtractorInterceptorMillisSerializer.java flume-ng-core/src/main/java/org/apache/flume/interceptor/RegexExtractorInterceptorMillisSerializer.java flume-ng-core/src/main/java/org/apache/flume/interceptor/RegexExtractorInterceptorSerializer.java flume-ng-core/src/main/java/org/apache/flume/interceptor/InterceptorType.java brock : http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=310e70ee3558f20422da3218d88342dffe6ad2cb Files : flume-ng-doc/sphinx/FlumeUserGuide.rst flume-ng-core/src/main/java/org/apache/flume/interceptor/RegexExtractorInterceptorSerializer.java flume-ng-core/src/main/java/org/apache/flume/interceptor/RegexExtractorInterceptor.java flume-ng-core/src/main/java/org/apache/flume/interceptor/RegexExtractorInterceptorPassThroughSerializer.java flume-ng-core/src/main/java/org/apache/flume/interceptor/RegexExtractorInterceptorMillisSerializer.java flume-ng-core/src/test/java/org/apache/flume/interceptor/TestRegexExtractorInterceptorMillisSerializer.java flume-ng-core/src/test/java/org/apache/flume/interceptor/TestRegexExtractorInterceptor.java flume-ng-core/src/test/java/org/apache/flume/interceptor/TestRegexExtractorInterceptorPassThroughSerializer.java flume-ng-core/src/main/java/org/apache/flume/interceptor/InterceptorType.java brock : http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=9f9c04813573d18c8055582c4cddbbba95c8693b Files : flume-ng-core/src/test/java/org/apache/flume/interceptor/TestRegexExtractorInterceptorPassThroughSerializer.java flume-ng-core/src/test/java/org/apache/flume/interceptor/TestRegexExtractorInterceptor.java flume-ng-doc/sphinx/FlumeUserGuide.rst flume-ng-core/src/main/java/org/apache/flume/interceptor/RegexExtractorInterceptorSerializer.java flume-ng-core/src/main/java/org/apache/flume/interceptor/InterceptorType.java flume-ng-core/src/main/java/org/apache/flume/interceptor/RegexExtractorInterceptorMillisSerializer.java flume-ng-core/src/main/java/org/apache/flume/interceptor/RegexExtractorInterceptor.java flume-ng-core/src/main/java/org/apache/flume/interceptor/RegexExtractorInterceptorPassThroughSerializer.java flume-ng-core/src/test/java/org/apache/flume/interceptor/TestRegexExtractorInterceptorMillisSerializer.java

            People

            • Assignee:
              Cameron Gandevia
              Reporter:
              Cameron Gandevia
            • Votes:
              1 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development