Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9802 YARN Timeline Service v2 (post GA features)
  3. YARN-5760

[ATSv2] Create HBase connection only if an app collector is publishing from NM

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • None
    • None
    • timelineserver
    • None

    Description

      Irrespective of NM handling an app or not, we initialize HBaseTimelineWriterImpl in TimelineCollectorManager.
      This in turn calls ConnectionFactory#createConnection to manage connections with HBase.
      But it seems this opens up a connection with Zookeeper (i.e. as soon as NM starts up) instead of opening connection when atleast one app arrives for publishing and closing it if no apps are being published from this NM.

      This leads to unnecessary connections to Zookeeper.

      Attachments

        Issue Links

          relates to

          Sub-task - The sub-task of the issue HBASE-17327 Allow for lazy connection / BufferedMutator creation

          • Major - Major loss of function.
          • Closed

          Activity

            People

              varun_saxena Varun Saxena
              varun_saxena Varun Saxena
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: