Uploaded image for project: 'Phoenix'
  1. Phoenix
  2. PHOENIX-5810

PhoenixMRJobSubmitter is not working on a cluster with a single yarn RM

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 5.1.0, 4.16.0
    • None
    • None

    Description

      Exception in thread "main" org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /yarn-leader-election

      The error happens when we want to run scheduleIndexBuilds. In getSubmittedYarnApps, getActiveResourceManagerHost uses zookeeper to determine the active Resource Manager.
      But /yarn-leader-election only exists if yarn is in HA mode.

      I think this function should work well when we have single yarn RM and read its address from the config.

      Attachments

        1. PHOENIX-5810.master.v1.patch
          3 kB
          Richárd Antal
        2. PHOENIX-5810.master.v2.patch
          3 kB
          Richárd Antal
        3. PHOENIX-5810.master.v3.patch
          5 kB
          Richárd Antal
        4. PHOENIX-5810.master.v4.patch
          6 kB
          Richárd Antal
        5. PHOENIX-5810.master.v5.patch
          8 kB
          Richárd Antal

        Activity

          People

            richardantal Richárd Antal
            richardantal Richárd Antal
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: