[HIVE-8456] Support Hive Counter to collect spark job metric[Spark Branch]

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.1.0
• Component/s: Spark
• Labels: Spark-M3
• Assignee: Chengxiang Li
• Reporter: Chengxiang Li
• Created: 14/Oct/14 09:31
• Updated: 29/May/15 02:28
• Resolved: 16/Oct/14 17:44

Description

Several Hive query metric in Hive operators is collected by Hive Counter, such as CREATEDFILES and DESERIALIZE_ERRORS, Besides, Hive use Counter as an option to collect table stats info. Spark support Accumulator which is pretty similiar with Hive Counter, we could try to enable Hive Counter based on it.

Issue Links

• duplicates: HIVE-7551 expand spark accumulator to support hive counter [Spark Branch]
• links to: https://reviews.apache.org/r/26733/