Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-4620

Add namespace support to HBaseStorage

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Not A Problem
    • Affects Version/s: 0.12.0
    • Fix Version/s: 0.12.1, 0.13.0
    • Component/s: None
    • Labels:
    • Patch Info:
      Patch Available

      Description

      Since version 0.96 HBase introduced namespace support.
      Apace Pig has recently updated the HBase dependency to 0.98.12 (PIG-4544)

      Currently there's no way to specify the namespace for a table.
      I suggest to implement it is using a '-namespace' option.

      copy = STORE raw INTO 'hbase://SampleTableCopy'
             USING org.apache.pig.backend.hadoop.hbase.HBaseStorage(
             'info:first_name info:last_name friends:* info:*','-namespace SampleNamespace');
      

      We can't use the namespace in the hbase path as it will break the uri validation : 'hbase://SampleNamespace:SampleTableCopy'

      The patch is available. I will look to extend the unittest for the namespace option.

      Please review my changes and let me know if I can help with something.

      Kind regards,

      Andi

        Attachments

        1. HBaseStorageNamespace.patch
          3 kB
          Andi Chirita

          Activity

            People

            • Assignee:
              achirita Andi Chirita
              Reporter:
              achirita Andi Chirita
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: