Flume
  1. Flume
  2. FLUME-2157

Spool directory source does not shut down correctly when Flume is reconfigured

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: v1.4.0
    • Fix Version/s: v1.5.0
    • Component/s: Sinks+Sources
    • Labels:
      None

      Description

      Spool directory source does not shut down correctly when Flume is reconfigured. This can lead to all sorts of problems stemming from the fact that we have threads running which should not be. In the logs, it looks like multiple spool directory sources are running on the same directory, even though the config may say otherwise.

        Issue Links

          Activity

          Hide
          Hari Shreedharan added a comment -

          +1. Looks good. Running tests and committing.

          Show
          Hari Shreedharan added a comment - +1. Looks good. Running tests and committing.
          Hide
          Hari Shreedharan added a comment -

          Committed, rev: f9da62be22101b00b907be3a66a6ce8d823c2f8f. Thanks Mike!

          Show
          Hari Shreedharan added a comment - Committed, rev: f9da62be22101b00b907be3a66a6ce8d823c2f8f. Thanks Mike!
          Hide
          Hudson added a comment -

          SUCCESS: Integrated in flume-trunk #489 (See https://builds.apache.org/job/flume-trunk/489/)
          FLUME-2157. Spool directory source does not shut down correctly when Flume is reconfigured. (hshreedharan: http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=f9da62be22101b00b907be3a66a6ce8d823c2f8f)

          • flume-ng-tests/src/test/java/org/apache/flume/test/util/StagedInstall.java
          • flume-ng-tests/src/test/java/org/apache/flume/test/agent/TestSpooldirSource.java
          • flume-ng-core/src/test/java/org/apache/flume/source/TestSpoolDirectorySource.java
          • flume-ng-core/src/main/java/org/apache/flume/client/avro/ReliableSpoolingFileEventReader.java
          • flume-ng-core/src/main/java/org/apache/flume/source/SpoolDirectorySource.java
          Show
          Hudson added a comment - SUCCESS: Integrated in flume-trunk #489 (See https://builds.apache.org/job/flume-trunk/489/ ) FLUME-2157 . Spool directory source does not shut down correctly when Flume is reconfigured. (hshreedharan: http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=f9da62be22101b00b907be3a66a6ce8d823c2f8f ) flume-ng-tests/src/test/java/org/apache/flume/test/util/StagedInstall.java flume-ng-tests/src/test/java/org/apache/flume/test/agent/TestSpooldirSource.java flume-ng-core/src/test/java/org/apache/flume/source/TestSpoolDirectorySource.java flume-ng-core/src/main/java/org/apache/flume/client/avro/ReliableSpoolingFileEventReader.java flume-ng-core/src/main/java/org/apache/flume/source/SpoolDirectorySource.java

            People

            • Assignee:
              Mike Percy
              Reporter:
              Mike Percy
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development