Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-2746

Max Open Files does not close files for the oldest entry

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 2.0.0, 1.x
    • None
    • None
    • None

    Description

      Description:

      AbstractHDFSBolt has WritersMap. This evicts least recently used AbstractHDFSWriter out of the writers map, however, does not close the file in open state by the oldest entry.

      Steps to reproduce error:

      1) Use new Max open files feature and set the value to 1.
      2) Write data to two or three different files in hdfs using AvroBolt.
      3) Check output directory using fsck in hdfs.

      Expected: only one file open in output directory.
      Actual: > 1 files are in open state.

      Attachments

        Activity

          People

            Unassigned Unassigned
            shoeb.aamer Shoeb
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: