Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7292 Hive on Spark
  3. HIVE-9088

Spark counter serialization error in spark.log [Spark Branch]

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.1.0
    • Component/s: Spark
    • Labels:
      None

      Description

      It seems that the counter didn't get registered. Increasing it in executor caused this error. Task itself succeeds nevertheless.

      2014-12-11 05:24:48,951 ERROR [Executor task launch worker-0]: counter.SparkCounters (SparkCounters.java:increment(83)) -
      counter[HIVE, RECORDS_IN] has not initialized before.
      2014-12-11 05:24:48,951 ERROR [Executor task launch worker-0]: counter.SparkCounters (SparkCounters.java:increment(83)) -
      counter[HIVE, DESERIALIZE_ERRORS] has not initialized before.
      

        Attachments

        1. HIVE-9088.1-spark.patch
          1 kB
          Chengxiang Li

          Activity

            People

            • Assignee:
              chengxiang li Chengxiang Li
              Reporter:
              xuefuz Xuefu Zhang
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: