[AMBARI-17788] Refactor spooler code in OutputHDFSFile to be reusable for OutputS3File

• Type: Technical task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.4.0
• Fix Version/s: 2.5.0
• Component/s: ambari-logsearch
• Assignee: Hemanth Yamijala
• Reporter: Hemanth Yamijala
• Created: 19/Jul/16 12:16
• Updated: 10/Sep/16 21:28
• Resolved: 10/Sep/16 19:38

Description

AMBARI-17785 proposed to enhance logsearch capabilities to periodically upload logs to S3, by using a spooling mechanism. mdharmesh pointed out that such a facility already exists in the HDFS file copy handling. Looking at the code, there is a lot of similarity that can be reused in both cases. This task is to extract the common mechanisms and parameterize them so that it will make it easier to reuse and also help have similar improvements to spooling logic if any.

Issue Links

• links to: Review board link