Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-14789 Enhance the current spark-hbase connector
  3. HBASE-15333

[hbase-spark] Enhance dataframe filters to handle naively encoded short, integer, long, float and double

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      Currently, the range filter is based on the order of bytes. But for java primitive type, such as short, int, long, double, float, etc, their order is not consistent with their byte order, extra manipulation has to be in place to take care of them correctly.

      For example, for the integer range (-100, 100), the filter <= 1, the current filter will return 0 and 1, and the right return value should be (-100, 1]

      Attachments

        1. HBASE-15333-1.patch
          43 kB
          Zhan Zhang
        2. HBASE-15333-2.patch
          44 kB
          Zhan Zhang
        3. HBASE-15333-3.patch
          44 kB
          Zhan Zhang
        4. HBASE-15333-4.patch
          51 kB
          Zhan Zhang
        5. HBASE-15333-5.patch
          51 kB
          Zhan Zhang
        6. HBASE-15333-6.patch
          83 kB
          Zhan Zhang
        7. HBASE-15333-7.patch
          268 kB
          Zhan Zhang
        8. HBASE-15333-8.patch
          83 kB
          Zhan Zhang
        9. HBASE-15333-9.patch
          84 kB
          Zhan Zhang
        10. HBASE-15333-10.patch
          87 kB
          Zhan Zhang

        Issue Links

          Activity

            People

              zzhan Zhan Zhang
              zzhan Zhan Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: