Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7292 Hive on Spark
  3. HIVE-8456

Support Hive Counter to collect spark job metric[Spark Branch]

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.1.0
    • Component/s: Spark
    • Labels:

      Description

      Several Hive query metric in Hive operators is collected by Hive Counter, such as CREATEDFILES and DESERIALIZE_ERRORS, Besides, Hive use Counter as an option to collect table stats info. Spark support Accumulator which is pretty similiar with Hive Counter, we could try to enable Hive Counter based on it.

        Attachments

        1. HIVE-8456.3-spark.patch
          10 kB
          Chengxiang Li
        2. HIVE-8456.2-spark.patch
          10 kB
          Chengxiang Li
        3. HIVE-8456.1-spark.patch
          10 kB
          Chengxiang Li

          Issue Links

            Activity

              People

              • Assignee:
                chengxiang li Chengxiang Li
                Reporter:
                chengxiang li Chengxiang Li
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: