Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-4345

Pushing down query conditions to support on-the-fly filtering at the file parsing

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 0.10.0
    • None
    • Query Processor

    Description

      Serialize "predicate" conditions in query plan to MapredWork class, so the FileFormat class can use the conditions to do on-the-fly filtering on the files. It can improve the performance a lot for processsing certain binary files(NetCDF files for example).

      Attachments

        1. HIVE-4345.patch
          5 kB
          Yifeng Geng

        Activity

          People

            Unassigned Unassigned
            gengyifeng Yifeng Geng
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: