Uploaded image for project: 'Forrest (Retired)'
  1. Forrest (Retired)
  2. FOR-1250

HIVE - Add support for pulling HBase columns with regex matching

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Invalid
    • None
    • None
    • Other
    • None

    Description

      Hi, we would like to create table that pulling HBase columns with regex matching. for example:
      CREATE EXTERNAL TABLE XXX(
      key string
      , DATES MAP<STRING, BIGINT>
      , FLOATS MAP<STRING, DOUBLE>
      , STRINGS MAP<STRING, STRING>
      )
      STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES (
      "hbase.columns.mapping" = ":key, FECF:D_[0-9]*, FECF:F_[0-9]*, FECF:C[0-9]*_[0-9]*",
      "hbase.table.default.storage.type" = "binary")
      TBLPROPERTIES ("hbase.table.name" = "XXX");

      currently only prefix work (with hive 0.12.0):
      CREATE EXTERNAL TABLE XXX(
      key string
      , DATES MAP<STRING, BIGINT>
      , FLOATS MAP<STRING, DOUBLE>
      , STRINGS MAP<STRING, STRING>
      )
      STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES (
      "hbase.columns.mapping" = ":key, FECF:D_.*, FECF:F_.*, FECF:C.*",
      "hbase.table.default.storage.type" = "binary")
      TBLPROPERTIES ("hbase.table.name" = "XXX");

      Attachments

        Activity

          People

            Unassigned Unassigned
            sucaz Sucaz Moshe
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: