Flume
  1. Flume
  2. FLUME-2157

Spool directory source does not shut down correctly when Flume is reconfigured

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: v1.4.0
    • Fix Version/s: v1.5.0
    • Component/s: Sinks+Sources
    • Labels:
      None

      Description

      Spool directory source does not shut down correctly when Flume is reconfigured. This can lead to all sorts of problems stemming from the fact that we have threads running which should not be. In the logs, it looks like multiple spool directory sources are running on the same directory, even though the config may say otherwise.

        Issue Links

          Activity

          Mike Percy created issue -
          Mike Percy made changes -
          Field Original Value New Value
          Attachment FLUME-2157.patch [ 12597244 ]
          Mike Percy made changes -
          Remote Link This issue links to "Review Board (Web Link)" [ 12511 ]
          Hide
          Hari Shreedharan added a comment -

          +1. Looks good. Running tests and committing.

          Show
          Hari Shreedharan added a comment - +1. Looks good. Running tests and committing.
          Hide
          Hari Shreedharan added a comment -

          Committed, rev: f9da62be22101b00b907be3a66a6ce8d823c2f8f. Thanks Mike!

          Show
          Hari Shreedharan added a comment - Committed, rev: f9da62be22101b00b907be3a66a6ce8d823c2f8f. Thanks Mike!
          Hari Shreedharan made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Hide
          Hudson added a comment -

          SUCCESS: Integrated in flume-trunk #489 (See https://builds.apache.org/job/flume-trunk/489/)
          FLUME-2157. Spool directory source does not shut down correctly when Flume is reconfigured. (hshreedharan: http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=f9da62be22101b00b907be3a66a6ce8d823c2f8f)

          • flume-ng-tests/src/test/java/org/apache/flume/test/util/StagedInstall.java
          • flume-ng-tests/src/test/java/org/apache/flume/test/agent/TestSpooldirSource.java
          • flume-ng-core/src/test/java/org/apache/flume/source/TestSpoolDirectorySource.java
          • flume-ng-core/src/main/java/org/apache/flume/client/avro/ReliableSpoolingFileEventReader.java
          • flume-ng-core/src/main/java/org/apache/flume/source/SpoolDirectorySource.java
          Show
          Hudson added a comment - SUCCESS: Integrated in flume-trunk #489 (See https://builds.apache.org/job/flume-trunk/489/ ) FLUME-2157 . Spool directory source does not shut down correctly when Flume is reconfigured. (hshreedharan: http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=f9da62be22101b00b907be3a66a6ce8d823c2f8f ) flume-ng-tests/src/test/java/org/apache/flume/test/util/StagedInstall.java flume-ng-tests/src/test/java/org/apache/flume/test/agent/TestSpooldirSource.java flume-ng-core/src/test/java/org/apache/flume/source/TestSpoolDirectorySource.java flume-ng-core/src/main/java/org/apache/flume/client/avro/ReliableSpoolingFileEventReader.java flume-ng-core/src/main/java/org/apache/flume/source/SpoolDirectorySource.java
          Mike Percy made changes -
          Link This issue is duplicated by FLUME-1934 [ FLUME-1934 ]

            People

            • Assignee:
              Mike Percy
              Reporter:
              Mike Percy
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development