Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-8548 Integrate with remote Spark context after HIVE-8528 [Spark Branch]
  3. HIVE-8574

Enhance metrics gathering in Spark Client [Spark Branch]

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Not A Problem
    • None
    • None
    • Spark
    • None

    Description

      The current implementation of metrics gathering in the Spark client is a little hacky. First, it's awkward to use (and the implementation is also pretty ugly). Second, it will just collect metrics indefinitely, so in the long term it turns into a huge memory leak.

      We need a simplified interface and some mechanism for disposing of old metrics.

      Attachments

        Issue Links

          depends upon

          Sub-task - The sub-task of the issue HIVE-8833 Unify spark client API and implement remote spark client.[Spark Branch]

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue HIVE-8528 Add remote Spark client to Hive [Spark Branch]

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              vanzin Marcelo Masiero Vanzin
              vanzin Marcelo Masiero Vanzin
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: