Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-4620

Add namespace support to HBaseStorage

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Not A Problem
    • 0.12.0
    • 0.12.1, 0.13.0
    • None
    • Patch Available

    Description

      Since version 0.96 HBase introduced namespace support.
      Apace Pig has recently updated the HBase dependency to 0.98.12 (PIG-4544)

      Currently there's no way to specify the namespace for a table.
      I suggest to implement it is using a '-namespace' option.

      copy = STORE raw INTO 'hbase://SampleTableCopy'
             USING org.apache.pig.backend.hadoop.hbase.HBaseStorage(
             'info:first_name info:last_name friends:* info:*','-namespace SampleNamespace');
      

      We can't use the namespace in the hbase path as it will break the uri validation : 'hbase://SampleNamespace:SampleTableCopy'

      The patch is available. I will look to extend the unittest for the namespace option.

      Please review my changes and let me know if I can help with something.

      Kind regards,

      Andi

      Attachments

        1. HBaseStorageNamespace.patch
          3 kB
          Andi Chirita

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            achirita Andi Chirita
            achirita Andi Chirita
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment