Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-3695

[HOD] Have an ability to run multiple slaves per node

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.19.0
    • contrib/hod
    • None
    • Reviewed
    • Added an ability in HOD to start multiple workers (TaskTrackers and/or DataNodes) per node to assist testing and simulation of scale. A configuration variable ringmaster.workers_per_ring was added to specify the number of workers to start.

    Description

      Currently HOD launches at most one slave per node. For purposes of testing a large number of slaves on much fewer resources - for e.g. testing scalability of clusters, it will be useful if it can provision multiple slaves per node.

      Attachments

        1. patch_multiple_workers_1.txt
          7 kB
          Vinod Kumar Vavilapalli
        2. patch_multiple_workers_2.txt
          7 kB
          Hemanth Yamijala
        3. patch_multiple_workers_3.txt
          15 kB
          Vinod Kumar Vavilapalli
        4. patch_multiple_workers_4.txt
          15 kB
          Hemanth Yamijala

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            vinodkv Vinod Kumar Vavilapalli
            yhemanth Hemanth Yamijala
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment