Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-28410 Partition-Aware Optimization for Iceberg or OTF
  3. HIVE-28414

Flexible join optimization based on partition transform specs

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Iceberg integration, StorageHandler
    • None

    Description

      This ticket would try to introduce as flexible join optimization as Apache Spark.

      Apache Spark can optimize a join algorithm when joining keys on both tables share compatible partition specs. For example, both tables have `PARTITION SPEC(day(ts))` and a statement has `FROM a JOIN b ON a.ts = b.ts`, Spark can optimize the join.

      https://docs.google.com/document/d/1foTkDSM91VxKgkEcBMsuAvEjNybjja-uHk-r3vtXWFE/edit#heading=h.82w8qxfl2uwl

      Attachments

        Activity

          People

            Unassigned Unassigned
            okumin Shohei Okumiya
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: