Uploaded image for project: 'Metron (Retired)'
  1. Metron (Retired)
  2. METRON-1103

HdfsWirter outputPathFunction should support time based partitioning

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: To Do
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      Currently, outputPath Functions that partition by time will eventually lead to a 'Too many HDFS files open' IllegalStateException once maxOpenFiles is exceeded.

      Attachments

        Activity

          People

            Unassigned Unassigned
            dlyle David M. Lyle
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: