Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-8231 Make topologies easier to set up and debug
  3. HADOOP-8232

Provide a command line entry point to view/test topology options

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Won't Fix
    • 0.23.1
    • None
    • util
    • None

    Description

      Add a new command line entry point "topo" with commands for preflight checking of a clusters topology setup.

      The initial operations would be to list the implementation class of the mapper, and attempt to load it, resolve a set of supplied hostnames, then dump the topology map after the resolution process.

      Target audience:

      1. ops teams trying to get a new/changed script working before deploying it on a cluster.
      2. someone trying to write their first script.

      Resolve and list the rack mappings of the given host

      hadoop topo test [host1] [host2] ... 
      

      This would load the hostnames from a given file, resolve all of them and list the results:

      hadoop topo testfile filename
      

      This version is intended for the ops team who have a list of hostnames, IP addresses.

      • Rather than just list them, the ops team may want to mandate that there were no /default-rack mappings found, as that is invariably a sign that the script isn't handling a hostname properly.
      • No attempt to be clever and do IP address resolution, FQDN to hostname mapping, etc.

      Attachments

        1. HADOOP-8232.patch
          12 kB
          Steve Loughran
        2. HADOOP-8232.patch
          19 kB
          Steve Loughran

        Issue Links

          Activity

            People

              Unassigned Unassigned
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: