Uploaded image for project: 'Camel'
  1. Camel
  2. CAMEL-6864

camel-hdfs - split by BYTES or MESSAGES has dependent configs

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Not A Problem
    • 2.10.4, 2.11.0
    • Future
    • camel-hdfs
    • None
    • Unknown

    Description

      per the discussion/changes in CAMEL-5971...

      currently, if only the BYTES or MESSAGES split criteria is specified, then the output stream is closed with every message and creates a new file for subsequent messages regardless of BYTES/MESSAGES written to the file...

      that said, if used along with the IDLE config or by setting the header HdfsConstants.HDFS_CLOSE=false...it does work fine

      so, we should either update the wiki to reflect this (if 'as designed') or update the HdfsProducer to not close the stream in the absence of the IDLE config (rely only on the split logic, HdfsConstants.HDFS_CLOSE=true header or route stop to close the stream)

      Attachments

        Activity

          People

            boday Benjamin P. O'Day
            boday Benjamin P. O'Day
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: