Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-1961 HBase EC2 scripts
  3. HBASE-2080

[EC2] Support multivolume local instance storage

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.20.3, 0.90.0
    • Component/s: None
    • Labels:
      None

      Description

      The (old) Hadoop EC2 scripts we used as a basis for our scripts do not properly handle instance types that have their local storage attached as multiple volumes. The AMI build script uses Amazon's latest Fedora 8 AMI as a base, which does not automatically mount instance storage on multiple volumes either.

      We recommend use of two instance types:

      • c1.medium for zookeeper, which has one vdisk of 340 GB as /dev/sdb mounted on /mnt by the base image
      • c1.xlarge for master and slaves, which have four vdisks of 420 GB as /dev/sd[bcde], only one of which is mounted on /mnt by the base image

      Additionally, the m1.xlarge instance type, which a user might use anyway, has two vdisks of 420 GB as /dev/sd[bc], only one of which is mounted on /mnt by the base image.

      The hbase-ec2-init-remote.sh script should probe for all available instance storage devices, mount them, and update the DataNode configuration appropriately.

        Attachments

        1. HBASE-2080.patch
          6 kB
          Andrew Kyle Purtell

          Activity

            People

            • Assignee:
              apurtell Andrew Kyle Purtell
              Reporter:
              apurtell Andrew Kyle Purtell
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: