[HBASE-15333] [hbase-spark] Enhance dataframe filters to handle naively encoded short, integer, long, float and double

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.0.0, connector-1.0.0
• Component/s: hbase-connectors, spark
• Hadoop Flags: Reviewed
• Assignee: Zhan Zhang
• Reporter: Zhan Zhang
• Created: 25/Feb/16 22:58
• Updated: 26/Apr/19 10:14
• Resolved: 13/May/16 14:01

Description

Currently, the range filter is based on the order of bytes. But for java primitive type, such as short, int, long, double, float, etc, their order is not consistent with their byte order, extra manipulation has to be in place to take care of them correctly.

For example, for the integer range (-100, 100), the filter <= 1, the current filter will return 0 and 1, and the right return value should be (-100, 1]

Issue Links

• Blocked: HBASE-15473 Documentation for the usage of hbase dataframe user api (JSON, Avro, etc)
• links to: ReviewBoard