Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-4293

Predicates following UDTF operator are removed by PPD

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • 0.13.0
    • Query Processor
    • None

    Description

      For example,

      explain SELECT value from (
        select explode(array(key, value)) as (value) from (
          select * FROM src WHERE key > 200
        ) A
      ) B WHERE value > 300
      ;
      

      Makes plan like this, removing last predicates

        TableScan
          alias: src
          Filter Operator
            predicate:
                expr: (key > 200.0)
                type: boolean
            Select Operator
              expressions:
                    expr: array(key,value)
                    type: array<string>
              outputColumnNames: _col0
              UDTF Operator
                function name: explode
                Select Operator
                  expressions:
                        expr: col
                        type: string
                  outputColumnNames: _col0
                  File Output Operator
                    compressed: false
                    GlobalTableId: 0
                    table:
                        input format: org.apache.hadoop.mapred.TextInputFormat
                        output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
      

      Attachments

        1. HIVE-4293.D9933.1.patch
          34 kB
          Phabricator
        2. HIVE-4293.D9933.2.patch
          50 kB
          Phabricator
        3. HIVE-4293.D9933.3.patch
          60 kB
          Phabricator
        4. HIVE-4293.D9933.4.patch
          60 kB
          Phabricator
        5. HIVE-4293.D9933.5.patch
          60 kB
          Phabricator
        6. D9933.6.patch
          61 kB
          Phabricator
        7. HIVE-4293.7.patch.txt
          64 kB
          Navis Ryu
        8. HIVE-4293.8.patch.txt
          65 kB
          Navis Ryu
        9. HIVE-4293.9.patch.txt
          64 kB
          Navis Ryu
        10. HIVE-4293.10.patch
          81 kB
          Harish Butani
        11. HIVE-4293.11.patch.txt
          89 kB
          Navis Ryu
        12. HIVE-4293.12.patch
          89 kB
          Harish Butani
        13. HIVE-4293.13.patch
          92 kB
          Harish Butani

        Issue Links

          Activity

            People

              navis Navis Ryu
              navis Navis Ryu
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: