[SLIDER-267] AM to serve up AM logs over web

• Type: New Feature
• Status: Resolved
• Priority: Minor
• Resolution: Won't Fix
• Affects Version/s: Slider 0.40
• Fix Version/s: Slider 0.60
• Component/s: appmaster
• Assignee: Unassigned
• Reporter: Steve Loughran
• Created: 01/Aug/14 09:40
• Updated: 12/Sep/14 17:35
• Resolved: 12/Sep/14 17:35

Description

To help debugging, AM could publish its logs as it goes along.

1. we can't use YARN logs unless they are collected as the AM continues to run
2. we can't collect container logs without much more work (feeding to kafka/copying to HDFS)
3. the AM would need to expect rolling logs and serve up the entire log dir
4. ...which implies secure serving up of only that log dir, not any subdirs or symlinked; reject relative paths in the URLs, etc, etc -and tests to verify that it is secure