Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-1660

Close "idle" hdfs handles

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 1.4.0
    • 1.3.0
    • None
    • None

    Description

      When hdfs paths are date dependent, many handles can get left open for a long time without anything happening to them.

      Idea here is to watch the last update of each bucketWriter, and track idle writers, closing them once they pass a configured timeout

      Attachments

        1. FLUME-1660-7.patch
          14 kB
          Juhani Connolly

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. FLUME-1350 HDFS file handle not closed properly when date bucketing

          • Major - Major loss of function.
          • Open
          links to

          Web Link review board

          Activity

            People

              juhanic Juhani Connolly
              juhanic Juhani Connolly
              Votes:
              1 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: