Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2785

Add default non-zero threads value for Thrift source, to avoid OutofMemoryException

Attach filesAttach ScreenshotAdd voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 1.6.0
    • notrack
    • Sinks+Sources
    • linux_64 2.6.32.57, Oracle JDK 1.7

    • Add default `threads` value for Thrift RPC source.
    • Patch

    Description

      The current implementation of thrift source in `flume-ng-core/src/main/java/org/apache/flume/source/ThriftSource.java`, there is something can be done to improve the usability of thrift source.

      If users did not config the `threads` parameter for thrift source, the default threads number will be Integer.MAX_VALUE, which may easily cause OutofMemoryError if no threads are in idle status.

      It's better to add a non-zero default value for it.

      And in the manual https://flume.apache.org/FlumeUserGuide.html#thrift-source, the `threads` parameter is not required, I think it is better to notice that it is required.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            jackeylyu Jackey Lyu

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - 10m
                10m
                Remaining:
                Remaining Estimate - 10m
                10m
                Logged:
                Time Spent - Not Specified
                Not Specified

                Slack

                  Issue deployment