Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-10303

Have snappy support properly documented would be helpful to hadoop and hbase users

    XMLWordPrintableJSON

Details

    • Task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • None
    • documentation
    • None

    Description

      The currentl document for configuring snappy support(http://hbase.apache.org/book/snappy.compression.html) is not complete and it's a bit obscure. IMO, there are several improvments can be made:
      1. Describe the relationship among hadoop,hbase,snappy. Is the snappy actually needed by hadoop hdfs or hbase itself? That's to make clear if you need to configure snappy support in hbase or hadoop.
      2. It didn't mention the default hadoop binary package is compiled without snappy support and you need to compile it with snappy option manually. Actually it didn't work with any native libs on 64 bits OS as the libhadoop.so in the binary package is only for 32 bits OS(this of course is a hadoop issue not hbase. but it's good to mention it.).
      3. In my experience, I actually need to install both snappy and hadoop-snappy. So the doc lack of the steps to install hadoop-snappy.
      4. During my set up, I found difference where hadoop and hbase to pick up the native lib files. hadoop picks those files in ./lib while hbase picks in ./lib/[PLATFORM]. If it's correct, it can also be mentioned.

      Attachments

        Activity

          People

            misty M Linville
            ruralhunter Rural Hunter
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: