Bigtop
  1. Bigtop
  2. BIGTOP-732

Support running multiple HBase region servers

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.6.0
    • Component/s: None
    • Labels:
      None

      Description

      Previously on the mailing list I submitted the idea of supporting multiple region server daemons on the same system. This can be done using the local-regionservers.sh and local-masters.sh scripts that we remove from our packaging (see BIGTOP-503), but apparently running multiple region servers in production can be useful. It should be possible through init scripts, and it should play nice with the more traditional use case.

      The modified init script template should make it safe and intuitive to run multiple region servers and masters on the same system, but only the regionserver package is using the new template - I don't know of a good reason to run multiple masters in production. Using the init script as before will control a single region-server daemon EXACTLY as it did before. If you specify numbers as additional parameters, you can control multiple daemons:

       
      service hbase-regionserver start # Starts a single region server daemon, as before
      (all other commands, with no additional parameters, will work as before)
      
      service hbase-regionserver start 1 2 3 4 # Starts a single region server daemon
      service hbase-regionserver restart 2 4 # Restarts the even daemons
      service hbase-regionserver stop 1 3 # Stops the odd daemons
      service hbase-regionserver stop # Stops all region servers in any mode of operation
      service hbase-regionserver restart 1 2 3 # Stops all region servers, then starts these 3
      

      I can see a case being made for changing the behavior of the stop and restart commands - so let me know if you disagree with the path I took. The log files and pid files get put in the same directory, but are also numbered according to their offset. The force-stop and force-reload command should also work as expected. When running a single daemon you can't start multiple daemons, and vice-versa. As recommended by Bruno for LSB-compliance and ease of administration, you can specify the offsets in /etc/hbase/conf/regionserver_offsets instead of on the command-line. Specifying offsets on the command-line anyway will override the file.

      1. BIGTOP-732.patch.5
        17 kB
        Sean Mackrory
      2. BIGTOP-732.patch.4
        17 kB
        Sean Mackrory
      3. BIGTOP-732.patch.3
        16 kB
        Sean Mackrory
      4. BIGTOP-732.patch.2
        16 kB
        Sean Mackrory
      5. BIGTOP-732.patch.1
        15 kB
        Sean Mackrory
      6. 0001-BIGTOP-732.-Support-running-multiple-HBase-region-se.patch
        17 kB
        Sean Mackrory
      7. 0001-BIGTOP-732.-Support-running-multiple-HBase-region-se.patch
        18 kB
        Sean Mackrory

        Issue Links

          Activity

          Sean Mackrory created issue -
          Sean Mackrory made changes -
          Field Original Value New Value
          Attachment BIGTOP-732.patch.1 [ 12548431 ]
          Sean Mackrory made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Andrew Purtell made changes -
          Link This issue relates to HBASE-7059 [ HBASE-7059 ]
          Sean Mackrory made changes -
          Attachment BIGTOP-732.patch.2 [ 12575061 ]
          Sean Mackrory made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Sean Mackrory made changes -
          Attachment BIGTOP-732.patch.3 [ 12575366 ]
          Sean Mackrory made changes -
          Attachment BIGTOP-732.patch.4 [ 12575404 ]
          Sean Mackrory made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Sean Mackrory made changes -
          Attachment BIGTOP-732.patch.5 [ 12575963 ]
          Sean Mackrory made changes -
          Sean Mackrory made changes -
          Sean Mackrory made changes -
          Fix Version/s 0.6.0 [ 12323895 ]
          Sean Mackrory made changes -
          Priority Major [ 3 ] Critical [ 2 ]
          Roman Shaposhnik made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Roman Shaposhnik made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Sean Mackrory
              Reporter:
              Sean Mackrory
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development