[HIVE-9088] Spark counter serialization error in spark.log [Spark Branch]

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.1.0
• Component/s: Spark
• Assignee: Chengxiang Li
• Reporter: Xuefu Zhang
• Created: 12/Dec/14 16:59
• Updated: 29/May/15 02:31
• Resolved: 19/Dec/14 19:24

Description

It seems that the counter didn't get registered. Increasing it in executor caused this error. Task itself succeeds nevertheless.

2014-12-11 05:24:48,951 ERROR [Executor task launch worker-0]: counter.SparkCounters (SparkCounters.java:increment(83)) -
counter[HIVE, RECORDS_IN] has not initialized before.
2014-12-11 05:24:48,951 ERROR [Executor task launch worker-0]: counter.SparkCounters (SparkCounters.java:increment(83)) -
counter[HIVE, DESERIALIZE_ERRORS] has not initialized before.