Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-2000 Coprocessors
  3. HBASE-1512

Coprocessors: Support aggregate functions

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.92.0
    • Coprocessors
    • None
    • Reviewed
    • A coprocessor to do basic aggregating; max, min, counts, etc.

    Description

      Chatting with jgray and holstad at the kitchen table about counts, sums, and other aggregating facility, facility generally where you want to calculate some meta info on your table, it seems like it wouldn't be too hard making a filter type that could run a function server-side and return the result ONLY of the aggregation or whatever.

      For example, say you just want to count rows, currently you scan, server returns all data to client and count is done by client counting up row keys. A bunch of time and resources have been wasted returning data that we're not interested in. With this new filter type, the counting would be done server-side and then it would make up a new result that was the count only (kinda like mysql when you ask it to count, it returns a 'table' with a count column whose value is count of rows). We could have it so the count was just done per region and return that. Or we could maybe make a small change in scanner too so that it aggregated the per-region counts.

      Attachments

        1. 1512.zip
          17 kB
          Himanshu Vashishtha
        2. addendum_1512.txt
          2 kB
          Himanshu Vashishtha
        3. AggregateCpProtocol.java
          4 kB
          Ted Yu
        4. AggregateProtocolImpl.java
          10 kB
          Ted Yu
        5. AggregationClient.java
          13 kB
          Ted Yu
        6. ColumnInterpreter.java
          2 kB
          Ted Yu
        7. patch-1512.txt
          25 kB
          Himanshu Vashishtha
        8. patch-1512-2.txt
          46 kB
          Himanshu Vashishtha
        9. patch-1512-3.txt
          60 kB
          Himanshu Vashishtha
        10. patch-1512-4.txt
          61 kB
          Himanshu Vashishtha
        11. patch-1512-5.txt
          61 kB
          Himanshu Vashishtha
        12. patch-1512-6.txt
          61 kB
          Himanshu Vashishtha
        13. patch-1512-7.txt
          61 kB
          Himanshu Vashishtha
        14. patch-1512-8.txt
          71 kB
          Himanshu Vashishtha
        15. patch-1512-9.txt
          61 kB
          Himanshu Vashishtha

        Issue Links

          Activity

            People

              v.himanshu Himanshu Vashishtha
              stack Michael Stack
              Votes:
              4 Vote for this issue
              Watchers:
              21 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: