Uploaded image for project: 'Apache HAWQ'
  1. Apache HAWQ
  2. HAWQ-779 support more pxf filter pushdwon
  3. HAWQ-953

Pushed down filter fails when quering partitioned Hive tables

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • 2.2.0.0-incubating
    • PXF
    • None

    Description

      After code changes in HAWQ-779 Hawq started sending filters to Hive, which fails on partitioned tables.

      # \d hive_partitions_all_types
      External table "public.hive_partitions_all_types"
       Column |            Type             | Modifiers 
      --------+-----------------------------+-----------
       t1     | text                        | 
       t2     | text                        | 
       num1   | integer                     | 
       dub1   | double precision            | 
       dec1   | numeric                     | 
       tm     | timestamp without time zone | 
       r      | real                        | 
       bg     | bigint                      | 
       b      | boolean                     | 
       tn     | smallint                    | 
       sml    | smallint                    | 
       dt     | date                        | 
       vc1    | character varying(5)        | 
       c1     | character(3)                | 
       bin    | bytea                       | 
      Type: readable
      Encoding: UTF8
      Format type: custom
      Format options: formatter 'pxfwritable_import' 
      External location: pxf://127.0.0.1:51200/hive_many_partitioned_table?PROFILE=Hive
      
      pxfautomation=# SELECT t1, t2, bg FROM hive_partitions_all_types where bg = 23456789;
      ERROR:  remote component error (500) from '127.0.0.1:51200':  type  Exception report   message   MetaException(message:Filtering is supported only on partition keys of type string)    description   The server encountered an internal error that prevented it from fulfilling this request.    exception   javax.servlet.ServletException: MetaException(message:Filtering is supported only on partition keys of type string) (libchurl.c:878)
      
      

      Attachments

        Activity

          People

            odiachenko Oleksandr Diachenko
            odiachenko Oleksandr Diachenko
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: