Uploaded image for project: 'Apache Apex Malhar'
  1. Apache Apex Malhar
  2. APEXMALHAR-1197

AbstractHdfsTupleFileOutputOperator closes the file after every write

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • None
    • algorithms
    • None

    Description

      Even when this operator works in append mode, for every tuple it opens a file and closes it after every write.
      This is in-efficient as closing/flush are expensive operations and increases the latency substantially.

      Attachments

        Activity

          People

            PramodSSImmaneni Pramod Immaneni
            csingh Chandni Singh
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: