Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-7381

Lightweight data transfer for Class Result

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Trivial
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.94.4
    • Component/s: Client
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently,the data transferring between 2 Result objects in the same process, will cause additional/unnecessary data parsing & copying; as we have to do that via "Writables.copyWritable(result1, result2)", which internally is serialization, data copying, and de-serialization.

      The use case are quite common when integrated with Hadoop job running;
      The protocol org.apache.hadoop.mapred.RecordReader defined in Hadoop, provides 3 interfaces:
      1) K createKey();
      2) V createValue();
      3) boolean next(K key, V value) throws IOException;

      In the 3rd method implementation, most likely requires the value (should be Result object) to be filled, with the Result object from HBase.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                hcheng Cheng Hao
                Reporter:
                chenghao Cheng Hao
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: