Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-11821

[ImportTSV] Abstract labels tags creation into pluggable Interface

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.98.0
    • 0.99.0, 0.98.6
    • mapreduce, security
    • None
    • Reviewed
    • Hide
      Added a facade org.apache.hadoop.hbase.mapreduce.CellCreator to create Cells for HFileOutputFormat. When working with HFileOutputFormat (with or with out visibility labels) in bulk load one can use this facade to make Cells with visibility tags.
      Also we allow plugin an implementation of org.apache.hadoop.hbase.mapreduce.VisibilityExpressionResolver by configuring the the FQCN with key "hbase.mapreduce.visibility.expression.resolver.class". The default implementation will tag Cells with visibility label ordinal.
      Show
      Added a facade org.apache.hadoop.hbase.mapreduce.CellCreator to create Cells for HFileOutputFormat. When working with HFileOutputFormat (with or with out visibility labels) in bulk load one can use this facade to make Cells with visibility tags. Also we allow plugin an implementation of org.apache.hadoop.hbase.mapreduce.VisibilityExpressionResolver by configuring the the FQCN with key "hbase.mapreduce.visibility.expression.resolver.class". The default implementation will tag Cells with visibility label ordinal.

    Description

      HBASE-11553 abstracted out the VisibilityLabelService and using which one can go with String based labels tags instead of default ordinal based. In MapReduce side, ImportTSV also should support such an abstraction layer. This is applicable for HFileOutputFormat where mappers create Cells to be written to HFiles.

      Also every Mapper (custom written also) dealing with such low level HBase things (Creation of tags and Cells) is not a good idea. This issue plan to provide a public audience Facade class to facilitate such Cell creation so that Mappers can just make use of them.

      Attachments

        1. HBASE-11821_0.98.patch
          46 kB
          Anoop Sam John
        2. HBASE-11821_V3.patch
          45 kB
          Anoop Sam John
        3. HBASE-11821_V4.patch
          46 kB
          Anoop Sam John
        4. HBASE-11821.patch
          42 kB
          Anoop Sam John

        Activity

          People

            anoop.hbase Anoop Sam John
            anoop.hbase Anoop Sam John
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: