Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-12935

LLAP: Replace Yarn registry with Zookeeper registry

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.0.0
    • 2.1.0
    • None

    Description

      Existing YARN registry service for cluster membership has to depend on refresh intervals to get the list of instances/daemons that are running in the cluster. Better approach would be replace it with zookeeper based registry service so that custom listeners can be added to update healthiness of daemons in the cluster.

      Attachments

        1. 12935.1.patch
          63 kB
          Prasanth Jayachandran
        2. HIVE-12935.2.patch
          62 kB
          Prasanth Jayachandran
        3. HIVE-12935.3.patch
          62 kB
          Prasanth Jayachandran
        4. HIVE-12935.4.patch
          62 kB
          Prasanth Jayachandran
        5. HIVE-12935.5.patch
          62 kB
          Prasanth Jayachandran
        6. HIVE-12935.6.patch
          62 kB
          Prasanth Jayachandran
        7. HIVE-12935.7.patch
          62 kB
          Prasanth Jayachandran

        Issue Links

          is depended upon by

          Bug - A problem which impairs or prevents the functions of the product. HIVE-13168 LLAP: On voluntary restart daemons should unregister itself

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. HIVE-13167 LLAP: Remove yarn-site resource from zookeeper based registry

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-12959 LLAP: Add task scheduler timeout when no nodes are alive

          • Major - Major loss of function.
          • Closed
          is duplicated by

          Sub-task - The sub-task of the issue HIVE-10026 LLAP: AM should get notifications on daemons going down or restarting

          • Major - Major loss of function.
          • Closed
          supercedes

          Sub-task - The sub-task of the issue HIVE-10004 yarn service registry should be an optional dependency

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HIVE-10648 LLAP: registry; Tez attempted to schedule to daemon that didn't exist

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link RB

          Activity

            People

              prasanth_j Prasanth Jayachandran
              prasanth_j Prasanth Jayachandran
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: