[ACCUMULO-1197] Pass Accumulo trace functionality through the DFSClient

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.7.0
• Component/s: trace
• Labels: gsoc2013 mentor
• Assignee: Billie Rinaldi
• Reporter: Josh Elser
• Created: 22/Mar/13 17:48
• Updated: 07/Nov/14 23:11
• Resolved: 07/Nov/14 23:11

Description

The tracing functionality used by Accumulo provides nested regions of timing information for regular operations occurring inside of Accumulo, e.g. scans and compactions. There is basic functionality to view this information through the Accumulo monitor. This can be thought of as a distributed timing infrastructure for Accumulo which uses Accumulo to store its data.

Currently, this tracing doesn't fall through into HDFS. It would be awesome to actually introspect through the DFSClient, all the way down to the datanode writing to local disk. A large portion of the task would be investigating ways to inject the ability for calling applications (Accumulo, in this case) to provide the trace client through the Hadoop datanode code and record the necessary timings

Skills required would be a good understanding of Java. Some basic knowledge about Apache Hadoop would also be helpful.

Issue Links

• depends upon: HDFS-5274 Add Tracing to HDFS
• relates to: HBASE-6449 Dapper like tracing
• relates to: ACCUMULO-898 look into replacing cloudtrace