Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-14789 Enhance the current spark-hbase connector
  3. HBASE-15333

[hbase-spark] Enhance dataframe filters to handle naively encoded short, integer, long, float and double

    XMLWordPrintableJSON

    Details

    • Hadoop Flags:
      Reviewed

      Description

      Currently, the range filter is based on the order of bytes. But for java primitive type, such as short, int, long, double, float, etc, their order is not consistent with their byte order, extra manipulation has to be in place to take care of them correctly.

      For example, for the integer range (-100, 100), the filter <= 1, the current filter will return 0 and 1, and the right return value should be (-100, 1]

        Attachments

        1. HBASE-15333-10.patch
          87 kB
          Zhan Zhang
        2. HBASE-15333-9.patch
          84 kB
          Zhan Zhang
        3. HBASE-15333-8.patch
          83 kB
          Zhan Zhang
        4. HBASE-15333-7.patch
          268 kB
          Zhan Zhang
        5. HBASE-15333-6.patch
          83 kB
          Zhan Zhang
        6. HBASE-15333-5.patch
          51 kB
          Zhan Zhang
        7. HBASE-15333-4.patch
          51 kB
          Zhan Zhang
        8. HBASE-15333-3.patch
          44 kB
          Zhan Zhang
        9. HBASE-15333-2.patch
          44 kB
          Zhan Zhang
        10. HBASE-15333-1.patch
          43 kB
          Zhan Zhang

          Issue Links

            Activity

              People

              • Assignee:
                zzhan Zhan Zhang
                Reporter:
                zzhan Zhan Zhang
              • Votes:
                0 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: